Processing device, imaging device, processing method, and program

Abstract

This processing device includes a processor. The processor acquires post-imaging processing information relating to post-imaging processing that is image processing executed after imaging on a captured image obtained by imaging by the imaging device. The processor executes first imaging condition processing that is processing corresponding to a first imaging condition determined on the basis of the post-imaging processing information.

Description

Processing apparatus, imaging apparatus, processing method, and program

[0001] This disclosure relates to an processing apparatus, an imaging apparatus, a processing method, and a program.

[0002] Japanese Patent Publication No. 2017-169216 discloses an imaging device comprising an imaging unit, a first metadata acquisition unit, a second metadata acquisition unit, and an output unit. In the imaging device described in Japanese Patent Publication No. 2017-169216, the imaging unit performs imaging and generates RAW data. The second metadata acquisition unit acquires the first metadata, which is automatically generated during imaging. The second metadata acquisition unit acquires the second metadata, which is information set for the image obtained by developing the RAW data after imaging and includes information for image processing by an external image processing device. The output unit outputs the RAW data, the first metadata, and the second metadata in relation to each other.

[0003] Japanese Patent Publication No. 2019-213130 ​​discloses an imaging device comprising an imaging unit, a scene determination unit, a classifier, and a display control unit. In the imaging device described in Japanese Patent Publication No. 2019-213130, the imaging unit can generate image data. The scene determination unit determines the scene at the time of imaging based on the image data. The classification unit estimates the optimal basic setting type and the range of basic settings to be changed for the scene and image data determined by the scene determination unit, based on a first learning result obtained by learning basic setting types including at least shooting parameters for each scene using a plurality of image data. The display control unit causes the display unit to display first information prompting a change to the basic setting type estimated by the classifier.

[0004] Japanese Patent Application Laid-Open No. 2010-045613 discloses an image identification method for classifying block images of input image data into a plurality of predetermined categories based on the feature amounts of the block images. The image identification method described in Japanese Patent Application Laid-Open No. 2010-045613 includes a block image generation step, an image feature amount calculation step, a separating hyperplane calculation step, and a category determination step. In the image identification method described in Japanese Patent Application Laid-Open No. 2010-045613, the block image generation step divides image data into a plurality of blocks to generate block images. The image feature amount calculation step calculates the feature amounts of the respective block images based on the color space information and frequency components of the block images. The separating hyperplane calculation step reads in teacher data images assigned with categories for each block, calculates the image feature amounts for each block of the teacher data images, and learns the separating hyperplane that serves as the boundary for identifying each category. The category determination step executes the block image generation step and the image feature amount calculation step for a newly acquired image to calculate the image feature amount of the block image, and determines the category to which the block image belongs based on the distance from the separating hyperplane of each category in the feature amount space.

[0005] Japanese Patent Application Laid-Open No. 2010-045613 discloses an imaging device that identifies the category of an image by the above-described image identification method. The imaging device described in Japanese Patent Application Laid-Open No. 2010-045613 includes a photographing condition storage means, an imaging means, and an image processing means. In the imaging device described in Japanese Patent Application Laid-Open No. 2010-045613, the photographing condition storage means stores the setting conditions of the parameters of the imaging device and the image processing method after photographing for each category. The imaging means sets the parameters of the imaging device based on the category of the imaging target image output by the image identification method at the time of photographing, and acquires the captured image. The image processing means executes image processing on the captured image by the image processing method for the category.

[0006] Japanese Patent Application Laid-Open No. 2010-213090 discloses an imaging device including an imaging means, an image recording means, an image processing means, a registration means, a storage means, a feature portion detection means, a subject identification means, a condition acquisition means, a control means, a communication means, a transmission means, a reception means, and an additional information storage means.

[0007] In the imaging device described in Japanese Patent Publication No. 2010-213090, the imaging means captures an image of a subject. The image recording means records the image captured by the imaging means. The image processing means performs image processing on the image captured by the imaging means. The registration means registers subject information for identifying a subject captured in the image captured by the imaging means, and shooting conditions or image processing conditions corresponding to the subject identified by the subject information. The storage means stores the subject information for identifying the subject registered by the registration means, and the shooting conditions or image processing conditions corresponding to the subject identified by the subject information, as related subject information. The feature portion detection means detects feature portions of a subject from the image captured by the imaging means. The subject identification means identifies the subject corresponding to the feature portion of the subject detected by the feature portion detection means by referring to the subject information stored in the storage means. The condition acquisition means acquires subject-related information corresponding to the subject identified by the subject identification means from the storage means. The control means causes the imaging means to perform imaging or the image processing means to perform image processing based on the shooting conditions or image processing conditions specified in the subject-related information acquired by the condition acquisition means.

[0008] Furthermore, in the imaging device described in Japanese Patent Publication No. 2010-213090, the storage means stores subject-related information registered by the registration means as subject-related information corresponding to its own imaging device. The communication means communicates with other imaging devices. The transmission means transmits the subject-related information corresponding to its own imaging device, stored by the storage means, to other imaging devices via the communication means.

[0009] Furthermore, in the imaging device described in Japanese Patent Publication No. 2010-213090, the receiving means receives subject-related information from another imaging device via a communication means. The additional information storage means stores the subject-related information received by the receiving means as subject-related information corresponding to the other imaging device, adding it to the storage means.

[0010] Furthermore, in the imaging device described in Japanese Patent Publication No. 2010-213090, the registration means registers subject information for identifying a subject in an image captured by the imaging means, image processing conditions for the subject identified by the subject information, and shooting conditions for the subject identified by the subject information. The storage means stores the subject information for identifying a subject registered by the registration means, the image processing conditions for the subject identified by the subject information, and the shooting conditions for the subject identified by the subject information as subject-related information, associating them with each other. The control means performs imaging by the imaging means based on the shooting conditions specified in the subject-related information acquired by the condition acquisition means, and also causes the image processing means to perform image processing based on the image processing conditions specified in the subject-related information.

[0011] One embodiment of the present disclosure provides a processing device, an imaging device, a processing method, and a program that can perform processing according to imaging conditions that meet the needs of a user who plans to perform image processing on the captured image after imaging.

[0012] A first aspect of the present disclosure is a processing device comprising a processor, the processor acquiring post-imaging processing information relating to post-imaging processing, which is image processing performed after imaging on an image captured by an imaging device, and executing a first imaging condition processing, which is processing according to a first imaging condition determined based on the post-imaging processing information.

[0013] A second aspect of this disclosure is a processing device according to the first aspect, wherein post-imaging processing is performed outside the imaging device.

[0014] A third aspect of the present disclosure is a processing apparatus according to the first or second aspect, wherein the first imaging condition is a condition including settings for the imaging apparatus when imaging is performed.

[0015] A fourth aspect of the present disclosure is a processing device relating to any one of the first to third aspects, wherein the first imaging condition processing includes a first imaging process that causes an imaging device to perform imaging under first imaging conditions.

[0016] A fifth aspect of the present disclosure is a processing device according to the fourth aspect, wherein, when a first imaging process is performed, the processor outputs information indicating that post-imaging processing is incomplete, and / or scheduled information indicating that post-imaging processing is scheduled.

[0017] A sixth aspect of this disclosure is a processing device according to the fifth aspect, wherein the information on incomplete and / or planned post-imaging processing includes post-imaging processing information and / or information based on post-imaging processing information.

[0018] A seventh aspect of the present disclosure is a processing device relating to any one of the fourth to sixth aspects, wherein a first image obtained by performing a first imaging process is displayed on a first screen.

[0019] An eighth aspect of the present disclosure is a processing device relating to any one of the first to seventh aspects, wherein the first imaging condition processing includes a first perception processing, which is a process for making information regarding the first imaging condition perceptible.

[0020] The ninth aspect of the present disclosure is a processing device relating to any one of the first to seventh aspects, wherein the first imaging condition processing includes a first perception processing, which is a processing that makes information regarding the first imaging conditions perceptible, and a first imaging processing, which causes an imaging device to perform imaging under the first imaging conditions, and in response to the execution of the first perception processing, the first imaging processing is executed based on a given imaging start instruction.

[0021] The tenth aspect of the present disclosure is a processing device relating to any one of the first to ninth aspects, wherein the first imaging condition is determined based on the second imaging condition, and the second imaging condition is determined based on standard imaging information relating to standard imaging processing performed by the imaging device.

[0022] An eleventh aspect of the present disclosure is a processing device relating to any one of the first to tenth aspects, wherein the processor selectively performs a first imaging condition processing and a second imaging condition processing, which is processing according to a second imaging condition determined based on standard imaging information relating to a standard imaging process performed by an imaging device.

[0023] A twelfth aspect of the present disclosure is a processing device relating to any one of the first to tenth aspects, wherein the processor performs a second perception process, which is a process that makes information relating to a first imaging condition and information relating to a second imaging condition determined based on standard imaging information relating to a standard imaging process performed by an imaging device perceptible, and selectively performs a first imaging condition process and a second imaging condition process, which is a process corresponding to the second imaging condition, on the condition that the second perception process is performed.

[0024] A thirteenth aspect of the present disclosure is a processing device relating to any one of the first to tenth aspects, wherein the processor acquires presence or absence information regarding whether or not post-imaging processing is performed, and selectively performs a first imaging condition processing and a second imaging condition processing, which is processing according to a second imaging condition determined based on standard imaging information relating to standard imaging processing performed by an imaging device, based on the presence or absence information.

[0025] A fourteenth aspect of the present disclosure is a processing device relating to any one of the tenth to thirteenth aspects, wherein the processor performs a second imaging condition processing, which is processing according to a second imaging condition determined based on standard imaging information relating to a standard imaging process performed by an imaging device, the second imaging condition processing includes a second imaging process that causes the imaging device to perform imaging under the second imaging condition, and a second image obtained by performing the second imaging process is displayed on a second screen.

[0026] A 15th aspect of the present disclosure is a processing device relating to any one of the 10th to 13th aspects, wherein the first imaging condition processing includes a first imaging process that causes an imaging device to perform imaging under first imaging conditions, the processor executes a second imaging condition processing which is processing according to second imaging conditions determined based on standard imaging information relating to a standard imaging process performed by the imaging device, the second imaging condition processing includes a second imaging process that causes the imaging device to perform imaging under second imaging conditions, and the first imaging process and the second imaging process are performed in succession.

[0027] A sixteenth aspect of the present disclosure is a processing apparatus according to the fourteenth aspect, wherein the first imaging condition processing includes a first imaging process that causes an imaging device to perform imaging under first imaging conditions, and the first image obtained by the execution of the first imaging process and the second image obtained by the execution of the second imaging process are displayed on a third screen in a manner that allows for comparison.

[0028] A 17th aspect of the present disclosure is a processing device relating to any one of the 10th to 16th aspects, wherein the second imaging condition is a condition that includes settings relating to the imaging device when imaging is performed.

[0029] The eighteenth aspect of this disclosure is a processing apparatus relating to any one of the first to seventeenth aspects, wherein the first imaging condition is determined based on a given finish requirement, and the finish requirement is a requirement relating to the finish of the captured image.

[0030] A 19th aspect of this disclosure is a processing apparatus according to the 18th aspect, wherein, upon input of a finish request, a first imaging condition is determined based on a trained model that outputs a first imaging condition corresponding to the input finish request.

[0031] A 20th aspect of this disclosure is a processing device according to the 19th aspect, wherein a trained model, upon receiving a finish request and post-imaging processing information, outputs a first imaging condition corresponding to the input finish request and post-imaging processing information.

[0032] A 21st aspect of the present disclosure is a processing device relating to any one of the first to 20th aspects, wherein the processor outputs post-imaging processing information.

[0033] A 22nd aspect of the present disclosure is a processing device relating to any one of the first to 21st aspects, wherein the first imaging condition processing includes a first imaging process that causes an imaging device to perform imaging under first imaging conditions, and post-imaging processing information is stored in association with a first image obtained by performing the first imaging process.

[0034] A 23rd aspect of the present disclosure is an imaging apparatus comprising a processing device according to any one of the first to 22nd aspects and an imaging system, wherein a first imaging condition processing includes a first imaging process that causes the imaging system to perform imaging under first imaging conditions.

[0035] A 24th aspect of this disclosure is a processing method that includes acquiring post-imaging processing information relating to post-imaging processing, which is image processing performed after imaging on an image captured by an imaging device, and executing a first imaging condition processing, which is processing according to a first imaging condition determined based on the post-imaging processing information.

[0036] A 25th aspect of this disclosure is a program for causing a computer to perform a process that includes acquiring post-imaging processing information, which is image processing performed after imaging on an image captured by an imaging device, and executing a first imaging condition processing, which is processing according to a first imaging condition determined based on the post-imaging processing information.

[0037] This is a conceptual diagram showing an example of how the imaging system is used. This is a block diagram showing an example of the hardware configuration and essential functions of the imaging device. This is a conceptual diagram showing an example of processing performed by the processor when presence / absence information received by the receiving device is acquired by the processor. This is a conceptual diagram showing an example of processing performed by the processor when the release key is in the imaging preparation instruction state. This is a conceptual diagram showing an example of processing performed by the processor when the flag is on and the release key is in the imaging preparation instruction state. This is a conceptual diagram showing an example of processing performed by the processor when the flag is off and the release key is in the imaging start instruction state. This is a conceptual diagram showing an example of processing performed by the processor when the flag is on and the release key is in the imaging start instruction state. This is a flowchart showing an example of the imaging control processing flow. This is a continuation of the flowchart shown in Figure 8A. This is a flowchart showing a first modified example of the imaging control processing flow. This is a flowchart showing a second modified example of the imaging control processing flow. This is a continuation of the flowchart shown in Figure 10A. This is a conceptual diagram showing a first modified example of processing performed by the processor when the flag is on and the release key is in the imaging start instruction state. This is a conceptual diagram showing a modified version of the processing performed by the processor when the flag is on and the release key is in the imaging preparation instruction state. This is a conceptual diagram showing an example of a configuration in which standard imaging processing and custom imaging processing are performed consecutively and the standard image and custom image are displayed on the screen in a comparable state. This is a conceptual diagram showing a second modified version of the processing performed by the processor when the flag is on and the release key is in the imaging start instruction state. This is a conceptual diagram showing an example of a configuration in which imaging control processing is performed by a smart device. This is a conceptual diagram showing an example of a series of processes in which a processor included in a computer gives a processing execution instruction to an external device via a network, the external device executes processing according to the processing execution instruction, and the processor included in the computer receives the processing result from the external device.

[0038] Hereinafter, an example of an embodiment of the processing apparatus, imaging apparatus, processing method, and program related to this disclosure will be described with reference to the attached drawings.

[0039] First, let's explain the terminology used in the following explanation.

[0040] CPU stands for "Central Processing Unit". GPU stands for "Graphics Processing Unit". GPGPU stands for "General-Purpose computing on Graphics Processing Units". APU stands for "Accelerated Processing Unit". TPU stands for "Tensor Processing Unit". NPU stands for "Neural Processing Unit". DSP stands for "Digital Signal Processor". RAM stands for "Random Access Memory". ASIC stands for "Application Specific Integrated Circuit". PLD stands for "Programmable Logic Device". FPGA stands for "Field-Programmable Gate Array". CD-ROM stands for "Compact Disc Read Only Memory". DVD-ROM is an abbreviation for "Digital Versatile Disc Read Only Memory". SSD is an abbreviation for "Solid State Drive". USB is an abbreviation for "Universal Serial Bus". EL is an abbreviation for "Electro-Luminescence". UI is an abbreviation for "User Interface". I / F is an abbreviation for "Interface". AI is an abbreviation for "Artificial Intelligence". LAN is an abbreviation for "Local Area Network". WAN is an abbreviation for "Wide Area Network". 5G is an abbreviation for "5th Generation Mobile Communication System". Exif is an abbreviation for "Exchangeable Image File Format".ISO stands for "International Organization for Standardization." JPEG stands for "Joint Photographic Experts Group." TIFF stands for "Tag Image File Format." CMOS stands for "Complementary Metal Oxide Semiconductor." CCD stands for "Charge Coupled Device." AE stands for "Auto Focus." AE stands for "Auto Exposure."

[0041] In the following description, a signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, a processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU, GPU, GPGPU, APU, TPU, or DSP.

[0042] In the following explanation, signed memory refers to memory such as RAM where information is temporarily stored, and is used as work memory by the processor.

[0043] In the following description, signed storage refers to one or more non-volatile memory devices (in other words, storage devices) that store various programs and parameters. Examples of non-volatile memory devices include flash memory, magnetic disks, or magnetic tapes. Another example of storage is cloud storage.

[0044] In the following description, the labeled external I / F manages the exchange of various information between a plurality of interconnected devices. As an example of the external I / F, a USB interface can be cited. A communication I / F including a communication processor and an antenna, etc. may be applied to the external I / F. The communication I / F manages communication between a plurality of computers. As an example of the communication standard applied to the communication I / F, a wireless communication standard including 5G, Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc. can be cited.

[0045] In this specification, "A and / or B" is synonymous with "at least one of A and B". That is, "A and / or B" means that it may be only A, it may be only B, or it may be a combination of A and B. Also, in this specification, when expressing three or more matters connected by "and / or", the same concept as "A and / or B" is applied.

[0046] FIG. 1 shows an example of the configuration of the imaging system 10. As shown in FIG. 1 as an example, the imaging system 10 includes an imaging device 12 and an information processing device 14. The imaging device 12 and the information processing device 14 are used by the user 15. In the present embodiment, the imaging device 12 is an example of the "imaging device" according to the present disclosure. Also, in the present embodiment, the information processing device 14 is an example of the "outside of the imaging device" according to the present disclosure.

[0047] The imaging device 12 is a consumer digital camera. As an example of a consumer digital camera, an interchangeable-lens digital camera or a fixed-lens digital camera can be cited. The consumer digital camera is only an example, and the present disclosure also holds even if the imaging device 12 is an industrial digital camera. The present disclosure also holds even if the imaging device 12 is an imaging device mounted on various electronic devices such as a drive recorder, a smart device, a wearable terminal, a cell observation device, or a modality (for example, an endoscope device, an ophthalmic observation device, or a surgical microscope, etc.).

[0048] The imaging device 12 captures a subject 16 when operated by the user 15. Then, the imaging device 12 generates an image file 18 by capturing the subject 16. The image file 18 includes an image 20 showing the subject 16 and metadata 22 which is data related to the image 20 (in other words, data attached to the image 20). Examples of the file format of the image file 18 include JPEG or TIFF, etc. In the present embodiment, the image 20 is an example of the "captured image" according to the present disclosure.

[0049] An example of the metadata 22 refers to data in Exif format. For example, the metadata 22 includes, as various data used for generating the image 20, shutter speed, F value, ISO sensitivity, focal length, exposure correction amount (that is, the correction amount used for exposure correction), white balance information (for example, color temperature and preset mode name), imaging mode, imaging date and time, imaging location, name of the manufacturer of the imaging device 12, model name of the imaging device 12, name of the lens used in the imaging device 12, resolution of the image 20, and creation date and time of the image file 18, etc.

[0050] [[ID=**6**]]The imaging device 12 is communicably connected to the information processing device 14 via the network 24. Examples of the network 24 include WAN or LAN, etc. The imaging device 12 may be connected to the network 24 in a wireless manner or in a wired manner, and the same can be said for the information processing device 14.

[0051] The imaging device 12 transmits the image file 18 to the information processing device 14 via the network 24. The information processing device 14 receives the image file 18 transmitted from the imaging device **12** via the network 24.

[0052] It should be noted that there seems to be a small error in the original text where it says "from the imaging device **12**" in the last sentence of which might be a typo as it should probably be "from the imaging device 12" consistently. I've translated it as "from the imaging device 12" in the translation. Also, I've corrected the "12" in the translation of which was missing in the original text's "12" in the relevant sentence.Here, an example is given in which the image file 18 is exchanged via the network 24, but this is merely one example. For example, the image file 18 may be exchanged via a portable storage medium such as a USB memory stick (in other words, a portable storage medium), or the imaging device 12 may be directly connected to the information processing device 14, and the image file 18 may be transferred from the imaging device 12 to the information processing device 14.

[0053] An example of an information processing device 14 is a personal computer. Here,

[0054] Although a personal computer is used as an example, this is merely one example, and the information processing device 14 may be a server or a smart device or other information processing device.

[0055] The information processing device 14 is connected to a reception device 26, such as a keyboard and mouse, and a display 28, such as a liquid crystal display or an EL display. The reception device 26 receives instructions from the user 15. The display 28 displays the processing results of the information processing device 14 on the screen.

[0056] The information processing device 14 acquires an image 20 and metadata 22 from the image file 18. The information processing device 14 displays the image 20 or metadata 22 on the screen of the display 28 in accordance with the instructions received by the receiving device 26.

[0057] The information processing device 14 performs post-imaging processing 29. Post-imaging processing 29 is image processing performed on the image 20 contained in the image file 18 obtained by imaging by the imaging device 12 after imaging by the imaging device 12. For example, post-imaging processing 29 can be implemented by launching conventionally known image editing software. An example of post-imaging processing 29 is processing to modify the image 20. Examples of processing to modify the image 20 include processing to adjust the brightness of the image 20, processing to remove noise from the image 20 (so-called noise reduction), processing to adjust the color of the image 20, processing to adjust the resolution of the image 20, processing to emphasize or blur the outlines of objects in the image 20, processing to erase or replace the contents of the image 20, processing to trim the outline of the image 20, and processing to add visible information (an image, color, pattern, mark, character, or number different from the image 20) to the image 20. In the example shown in Figure 1, post-processing 29 is performed on the image 20 in the image file 18, resulting in an example where the image 20 is brightened overall.

[0058] When post-imaging processing 29 is performed, metadata 22 may be displayed on the screen of the display 28 in accordance with instructions received by the receiving device 26 and referred to by the user 15. In this case, the user 15 performs the necessary image processing on the image 20 contained in the image file 18 while referring to the metadata 22.

[0059] Figure 2 shows an example of the hardware configuration of the imaging device 12 in a block diagram. As an example, as shown in Figure 2, the imaging device 12 includes a computer 30, an image sensor 32, a drive unit 34, a UI system 36, an external I / F 38, a photometering sensor 40, an optical system 42, and a mechanical shutter 44. In this embodiment, the computer 30 is an example of the "processing device" and "computer" according to the disclosure. Also, in this embodiment, the image sensor 32, the optical system 42, and the mechanical shutter 44 are an example of the "imaging system" according to the disclosure. In other words, the "imaging system" can also be called the "imaging device body".

[0060] The computer 30 comprises a processor 46, storage 48, and memory 50. The processor 46, storage 48, and memory 50 are connected to a bus 51. In this embodiment, the processor 46 is an example of a "processor" according to the disclosure.

[0061] The image sensor 32 is connected to the bus 51. An example of the image sensor 32 is a CMOS image sensor. Under the control of the processor 46, the image sensor 32 captures an image of the subject 16 (see Figure 1), generates RAW data 20A, and outputs it to the processor 46. Here, a CMOS image sensor is given as an example of the image sensor 32, but this is merely an example, and the image sensor 32 may be other types of image sensors such as a CCD image sensor.

[0062] The processor 46 generates an image 20 (see Figure 1) by performing various processes (for example, offset correction, white balance correction, demosaicing, color correction, gamma correction, color space conversion, brightness processing, color difference processing, and resizing) on ​​the RAW data 20A input from the image sensor 32, and generates an image file 18 (see Figure 1) using the generated image 20.

[0063] The optical system 42 includes a lens 42A and an aperture 42B. The lens 42A captures subject light, which is light indicating the subject 16 (see Figure 1), and forms an image on the light-receiving surface of the image sensor 32. The lens 42A includes a movable lens that moves when powered. The movable lens includes a focusing lens (not shown), a magnification lens (not shown), and a blur-correcting lens (not shown). The focusing lens focuses on the subject 16 by moving in the optical axis direction. The magnification lens changes the focal length by moving in the optical axis direction. The blur-correcting lens corrects the misalignment of the optical axis by moving based on the detection result of vibrations applied to the imaging device 12 detected by a gyro sensor or the like (not shown). By correcting the misalignment of the optical axis, blur that appears in the image due to vibrations applied to the imaging device 12 is suppressed.

[0064] On the optical axis, the aperture 42B is positioned between the lens 42A and the light-receiving surface of the image sensor 32. The aperture 42B adjusts the amount of light. The aperture 42B opens and closes when power is received. By opening and closing the aperture 42B, the exposure and depth of field are controlled.

[0065] The mechanical shutter 44 is positioned between the aperture 42B and the light-receiving surface of the image sensor 32. The mechanical shutter 44 opens and closes when power is received. By opening and closing, the mechanical shutter 44 blocks or allows light from the optical system 42 to pass through. This controls the exposure.

[0066] The drive unit 34 generates power under the control of the processor 46. The drive unit 34 applies the generated power to the lens 42A (for example, the movable lens described above) and the aperture 42B, thereby operating the lens 42A and the aperture 42B.

[0067] The UI device 36 is connected to the bus 51. The UI device 36 receives instructions from the user 15 (see Figure 1) and displays various information. The UI device 36 includes a reception device 36A and a display 36B.

[0068] The receiving device 36A receives instructions from the user 15 and outputs a signal indicating the received instruction to the processor 46. The processor 46 executes processing according to the signal input from the receiving device 36A.

[0069] The reception device 36A includes a plurality of hard keys (not shown). The reception device 36A also includes a plurality of soft keys (not shown). The soft keys are implemented by a touch panel and a display 36B.

[0070] The multiple hard keys and multiple soft keys include a so-called release key and various setting keys. The release key functions as an imaging preparation instruction unit and an imaging instruction unit, and can detect two-stage operations: an imaging preparation instruction state and an imaging start instruction state. For example, if the release key is a hard key, the imaging preparation instruction state refers to the state where it is pressed from the standby position to an intermediate position (half-press position), and the imaging start instruction state refers to the state where it is pressed beyond the intermediate position to the final pressed position (full-press position). Also, for example, if the release key is a soft key, the imaging preparation instruction state refers to the state where the user 15's finger is in contact with the release key, and the imaging start instruction state refers to the state where the user 15's finger has moved away from the state where it was in contact with the release key.

[0071] Here, an example is given in which the reception device 36A includes multiple hard keys and multiple soft keys, but this is merely one example, and the reception device 36A may also include a microphone for receiving voice instructions from the user 15, and / or a gesture detector for receiving gesture instructions from the user 15.

[0072] The display 36B is a liquid crystal display or an EL display, and under the control of the processor 46, it displays various information on the screen. Here, the display 36B is given as an example of a device that outputs various information, but this is merely an example, and the UI system device 36 may also include a speaker that outputs various information as sound, and / or a vibrator that generates vibrations indicating various information, in addition to the display 36B.

[0073] The photometering sensor 40 is connected to the bus 51. The photometering sensor 40 measures the brightness of the entire scene and outputs a photometric value indicating the brightness of the entire scene to the processor 46. The photometric value is used by the processor 46 for various processes, including automatic imaging (for example, imaging using AF and / or AE).

[0074] The external interface 38 is connected to the network 24 and is responsible for the exchange of various types of information between the external device and the processor 46. For example, the external interface 38 is responsible for the exchange of various types of information between the external device on the network 24 (for example, the information processing device 14 shown in Figure 1) and the processor 46.

[0075] Incidentally, conventionally known imaging devices are sometimes unable to perform processing that requires a heavy processing load, mainly due to processing time and power consumption. In contrast, image editing software installed on a personal computer, etc. (i.e., software for editing images obtained by imaging devices) can be used without worrying about processing time and power consumption compared to when image processing is completed by the imaging device alone. Therefore, it can perform higher performance and a wider range of processing than processing performed by the imaging device alone.

[0076] Conventional imaging devices are designed so that the final image is obtained by completing image processing within the imaging device itself, without considering image quality improvement through external software (for example, image editing software installed on a personal computer, etc.) after acquisition. Therefore, for users who plan to improve image quality with external software after acquisition, the image may be generated by the imaging device with image quality that does not meet their intentions (i.e., image quality obtained by processing the image obtained by the imaging device according to imaging conditions that do not meet the user's requirements).

[0077] Therefore, in view of these circumstances, in this embodiment, the imaging control process is executed by the processor 46 of the imaging device 12. The storage 48 stores the imaging control program 52. In this embodiment, the imaging control program 52 is an example of the "program" according to the present disclosure. The processor 46 reads the imaging control program 52 from the storage 48 and executes the read imaging control program 52 on the memory 50. The imaging control process is realized by the execution of the imaging control program 52 by the processor 46.

[0078] The storage 48 stores the trained model 53. The trained model 53 is used by the processor 46 that performs the imaging control processing. As will be described in more detail later, the trained model 53 is used to derive imaging conditions to be set for the imaging device 12 when post-imaging processing 29 (see Figure 1) is scheduled to be performed on the image 20 (see Figure 1) by the information processing device 14 (see Figure 1) after imaging by the imaging device 12.

[0079] Figures 3 to 7 show an example of imaging control processing. As an example, as shown in Figure 3, the receiving device 36A receives presence / absence information 54. The presence / absence information 54 is information regarding whether or not post-imaging processing 29 (see Figure 1) is performed. An example of information regarding whether or not post-imaging processing 29 is performed is information indicating whether or not post-imaging processing 29 is performed by the information processing device 14 after imaging by the imaging device 12. In this embodiment, presence / absence information 54 is an example of "present / absence information" as described herein.

[0080] The processor 46 acquires presence / absence information 54 received by the receiving device 36A. Here, an example of how the processor 46 acquires presence / absence information 54 received by the receiving device 36A is given, but this is merely one example, and the processor 46 may also acquire presence / absence information 54 from an external device (for example, an information processing device 14 or a portable storage medium, etc.) via an external I / F 38.

[0081] The processor 46 refers to the presence / absence information 54 to determine whether or not post-imaging processing 29 is performed by the information processing device 14 after imaging by the imaging device 12. The processor 46 controls flag F. Flag F is a flag that makes it possible to identify whether or not post-imaging processing 29 is performed by the information processing device 14 after imaging by the imaging device 12. If post-imaging processing 29 is performed by the information processing device 14 after imaging by the imaging device 12, the processor 46 turns flag F on. If post-imaging processing 29 is not performed by the information processing device 14 after imaging by the imaging device 12, the processor 46 turns flag F off.

[0082] When flag F is off, the processor 46 executes the processes shown in Figures 4 and 6. When flag F is on, the processor 46 executes the processes shown in Figures 4, 5, and 7. In other words, the processor 46 selectively executes the processes shown in Figures 4 and 6 and the processes shown in Figures 4, 5, and 7 based on the state of flag F.

[0083] Figure 4 shows an example of the processing performed by the processor 46 when the release key is in the imaging preparation instruction state.

[0084] When the user 15 gives an instruction to the imaging device 12 to prepare for imaging, the processor 46 acquires various information to be used to derive the imaging conditions for automatic imaging. For example, as shown in Figure 4, the processor 46 acquires RAW data 20A generated by the image sensor 32. The processor 46 also acquires a photometric value 58 indicating the brightness of the entire scene from the photometric sensor 40. The processor 46 acquires a live view image 55 by generating a live view image 55 based on the RAW data 20A. The processor 46 displays the live view image 55 on the screen of the display 36B.

[0085] In the imaging device 12, information including the live view image 55 and photometric values ​​58 is used by the processor 46 to derive the imaging conditions for automatic imaging. That is, the processor 46 generates standard imaging conditions 56 based on the live view image 55 and photometric values ​​58. For example, the processor 46 identifies the brightness of the entire scene from the live view image 55 and photometric values ​​58, generates standard imaging conditions 56 corresponding to the identified brightness, and stores the generated standard imaging conditions 56 in the memory 50. In this embodiment, the standard imaging conditions 56 are an example of the "second imaging conditions" according to this disclosure. Also, in this embodiment, the live view image 55 and photometric values ​​58 are an example of the "standard imaging information" according to this disclosure.

[0086] For example, the generation of standard imaging conditions 56 can be achieved by using a rule-based approach that employs a table and / or formulas capable of deriving the standard imaging conditions 56 from the overall brightness of the scene. The use of a rule-based approach is merely one example; the generation of standard imaging conditions 56 may also be achieved by using a trained model obtained by optimizing a model (e.g., a neural network) through machine learning with various overall scene brightness levels and the standard imaging conditions 56.

[0087] The standard imaging conditions 56 correspond to the imaging conditions used for exposure control by the imaging device 12 (for example, imaging conditions used in conventionally known AE). The standard imaging conditions 56 are conditions that include settings for the imaging device 12 when imaging is performed. The settings for the imaging device 12 when imaging is performed are exposure conditions. In the example shown in Figure 4, an example of settings for the imaging device 12 when imaging is performed is the F-number 56A applied to the aperture 42B (see Figure 2), the shutter speed 56B applied to the mechanical shutter 44 (see Figure 2), and the ISO sensitivity 56C applied to the image sensor 32. The live view image 55 and / or metering value 58 are also used for focus control by the imaging device 12 (for example, conventionally known AF).

[0088] Figure 5 shows an example of the processing performed by the processor 46 when flag F is on and the release key is in the imaging preparation instruction state.

[0089] As an example, as shown in Figure 5, the processor 46 acquires post-imaging processing information 29A. Post-imaging processing information 29A is information relating to post-imaging processing. A first example of post-imaging processing information 29A is information that identifies the software used in post-imaging processing 29 (for example, software used to perform image processing on the image 20 shown in Figure 1). A second example of post-imaging processing information 29A is information that identifies the specific processing content performed by the software used in post-imaging processing. Examples of specific processing content performed by the software include whether or not brightness adjustment processing is performed, the brightness adjustment capability if brightness adjustment processing is performed, whether or not noise reduction is performed, and the noise removal capability if noise reduction is performed. In this embodiment, post-imaging processing information 29A is an example of "post-imaging processing information" relating to this disclosure.

[0090] One example of a method by which the processor 46 acquires post-imaging processing information 29A is that, when communication is established between the imaging device 12 and the information processing device 14, the processor 46 acquires post-imaging processing information 29A from the information processing device 14 in response to instructions given to the imaging device 12 and / or the information processing device 14 by the user 15 (i.e., receives post-imaging processing information 29A transmitted from the information processing device 14 in response to instructions given to the imaging device 12 and / or the information processing device 14 by the user 15). Another example of a method by which the processor 46 acquires post-imaging processing information 29A is that, when a portable storage medium such as a USB memory (not shown) containing the post-imaging processing information 29A is connected to an external I / F 38 (see Figure 2), the processor 46 acquires post-imaging processing information 29A from the portable storage medium. A third example of how the processor 46 can acquire post-imaging processing information 29A is that the processor 46 acquires post-imaging processing information 29A received by the receiving device 36A (see Figure 2) (i.e., post-imaging processing information 29A provided to the imaging device 12 by the user 15 via the receiving device 36A).

[0091] The processor 46 generates custom imaging conditions 62 and stores the generated custom imaging conditions 62 in the memory 50. Custom imaging conditions 62 are imaging conditions that have been customized based on the reference imaging conditions using post-imaging processing information 29A (for example, imaging conditions that reflect the intention of the user 15 who plans to perform post-imaging processing 29 on the reference imaging conditions). In other words, custom imaging conditions 62 can also be said to be imaging conditions that have been optimized according to the content of the post-imaging processing information 29A. The reference imaging conditions refer to the standard imaging conditions 56. Optimized imaging conditions refer to imaging conditions that allow for image quality enhancement by post-imaging processing 29, under the premise that an image 20 with image quality that can be enhanced by post-imaging processing 29 can be obtained. For example, if it is possible to remove noise from image 20 by performing post-processing 29 on image 20, an example of optimized imaging conditions would be an F-number that maintains depth of field (i.e., the same F-number as F-number 56A shown in Figure 4), a shutter speed slower than the shutter speed 56B shown in Figure 4 to a level where motion blur does not occur, and an ISO sensitivity higher than the ISO sensitivity 56C shown in Figure 4 to a level where noise can be removed by post-processing 29.

[0092] To generate custom imaging conditions 62, the processor 46 obtains standard imaging conditions 56 from the memory 50. Then, the processor 46 generates custom imaging conditions 62 based on the post-imaging processing information 29A and the standard imaging conditions 56. Custom imaging conditions 62 are imaging conditions determined based on the post-imaging processing information 29A. Custom imaging conditions 62 are also imaging conditions determined based on the standard imaging conditions 56. For example, custom imaging conditions 62 are imaging conditions in which the standard imaging conditions 56 have been customized based on the post-imaging processing information 29A (in other words, imaging conditions in which the standard imaging conditions 56 have been optimized according to the content of the post-imaging processing information 29A). In this embodiment, custom imaging conditions 62 are an example of the "first imaging conditions" according to this disclosure.

[0093] The custom imaging conditions 62 are conditions that include settings for the imaging device 12 when imaging is performed. In the example shown in Figure 5, an example of settings for the imaging device 12 when imaging is performed is the F-number 62A applied to the aperture 42B (see Figure 2), the shutter speed 62B applied to the mechanical shutter 44 (see Figure 2), and the ISO sensitivity 62C applied to the image sensor 32.

[0094] The generation of custom imaging conditions 62 is achieved by using a trained model 53 stored in storage 48. The trained model 53 is an optimized model obtained by performing machine learning on a model (e.g., a neural network) using training data that uses information corresponding to post-imaging processing information 29A and information corresponding to standard imaging conditions 56 as example data, and custom imaging conditions 62 as ground truth data.

[0095] The processor 46 retrieves the trained model 53 from the storage 48 and inputs the post-imaging processing information 29A and the standard imaging conditions 56 to the trained model 53. As a result, the trained model 53 outputs custom imaging conditions 62 corresponding to the post-imaging processing information 29A and the standard imaging conditions 56.

[0096] Here, we have given an example of how the generation of custom imaging conditions 62 is achieved by using a trained model 53 stored in storage 48. However, this is merely one example, and the generation of custom imaging conditions 62 may also be achieved, for example, by using a rule-based system that uses a table and / or calculation formula that can derive the standard imaging conditions 56 from the post-imaging processing information 29A and the standard imaging conditions 56.

[0097] Here, we will explain three examples of the correspondence between the F-number 56A, shutter speed 56B, and ISO sensitivity 56C included in the standard imaging conditions 56 and the F-number 62A, shutter speed 62B, and ISO sensitivity 62C included in the custom imaging conditions 62. The first to third examples of the correspondence all assume that the entire scene is dark and that a moving subject 16 is being imaged by the imaging device 12.

[0098] The first example of the relationship is an example of the correspondence between the F-number 56A, shutter speed 56B, and ISO sensitivity 56C included in the standard imaging conditions 56, when user 15 does not want blur (e.g., motion blur) of the subject 16 in the image 20, and accepts that noise in the image 20 can be removed by post-imaging processing 29, and the F-number 62A, shutter speed 62B, and ISO sensitivity 62C included in the custom imaging conditions 62. Here, "when user 15 does not want blur of the subject 16 in the image 20, and accepts that noise in the image 20 can be removed by post-imaging processing 29" can be rephrased as a case where the execution of noise reduction by the imaging device 12 is something that user 15 wants to avoid from the standpoint of processing time and power consumption, and where it is difficult to correct subject blur (i.e., motion blur, etc., in the image 20) after imaging. The first example of the relationship is shown in Table 1 below. The values ​​shown in Table 1 are merely examples, and other values ​​may be used as long as they do not deviate from the intent of the first related example.

[0099]

[0100] In the example shown in Table 1, the following relationships hold true: “F-number 56A (=2.8) = F-number 62A (=2.8)”, “Shutter speed 56B (=1 / 250) < Shutter speed 62B (=1 / 1000)”, and “ISO sensitivity 56C (=3200) < ISO sensitivity 62C (=12800)”. Shutter speed 62B is a shutter speed that reduces subject blur more than shutter speed 56B. ISO sensitivity 62C increases noise more than ISO sensitivity 56C, but the overall image 20 is brighter than when ISO sensitivity 56C is used. Reasons for “F-number 56A = F-number 62A” include maintaining depth of field, or because both F-number 56A and F-number 62A are lower limits.

[0101] The second example of the relationship is an example of the correspondence between the F-number 56A, shutter speed 56B, and ISO sensitivity 56C included in the standard imaging conditions 56 when user 15 tolerates blurring of the subject 16 in the image 20 (i.e., user 15 desires a sense of dynamism in the subject 16) and wants to suppress noise in the image 20, and the F-number 62A, shutter speed 62B, and ISO sensitivity 62C included in the custom imaging conditions 62. The second example of the relationship is shown in Table 2 below. Note that the values ​​shown in Table 2 are merely examples, and other values ​​may be used as long as they do not deviate from the intent of the second example of the relationship.

[0102]

[0103] In the example shown in Table 2, the following relationships hold true: “F-number 56A (=2.8) < F-number 62A (=5.6)”, “Shutter speed 56B (=1 / 250) = Shutter speed 62B (=1 / 250)”, and “ISO sensitivity 56C (=6400) = ISO sensitivity 62C (=6400)”. Shutter speed 62A is the shutter speed at which the subject 16 in image 20 is blurred (for example, the shutter speed at which motion blur etc. appears at a level that is visible in image 20). ISO sensitivity 62C is the ISO sensitivity at which noise in image 20 is suppressed to below a certain level. When the ISO sensitivity is set to suppress noise to below a certain level in this way, image 20 becomes dark, so F-number 62A is adopted as an F-number that can capture the amount of light necessary to suppress the darkening of image 20.

[0104] The third relationship example is an example of the correspondence between the F-number 56A, shutter speed 56B, and ISO sensitivity 56C included in the standard imaging conditions 56, where the user 15 does not want blurring of the subject 16 in the image 20, and accepts the darkness of the image 20 because brightening the image 20 can be achieved by post-processing 29 (for example, gradation processing using AI), and the F-number 62A, shutter speed 62B, and ISO sensitivity 62C included in the custom imaging conditions 62. The third relationship example is shown in Table 3 below. Note that the values ​​shown in Table 3 are merely examples, and other values ​​may be used as long as they do not deviate from the intent of the third relationship example.

[0105]

[0106] In the example shown in Table 3, the following relationships hold true: “F-number 56A (=4.0) = F-number 62A (=4.0)”, “Shutter speed 56B (=1 / 500) < Shutter speed 62B (=1 / 1000)”, and “ISO sensitivity 56C (=1600) = ISO sensitivity 62C (=1600)”. Shutter speed 62B is a shutter speed that can suppress the blur of the subject 16 in the image 20 to below a certain level. By increasing the shutter speed 62B, it is possible to suppress the blur of the subject 16 in the image 20 to below a certain level, but the exposure amount decreases by the amount the shutter speed 62B is increased, so the image 20 becomes darker. However, the brightness can be compensated for by post-processing 29.

[0107] Figure 6 shows an example of the processing performed by the processor 46 when flag F is off and the release key is in the image acquisition start instruction state.

[0108] As an example, as shown in Figure 6, the processor 46 obtains standard imaging conditions 56 from the memory 50. The processor 46 then executes a standard imaging process 64, which is a process corresponding to the standard imaging conditions 56. The standard imaging process 64 is a process that causes the imaging device 12 to perform imaging under the standard imaging conditions 56. In this embodiment, the standard imaging process 64 is an example of the "second imaging condition processing" and "second imaging process" according to the present disclosure.

[0109] When the processor 46 instructs the imaging device 12 to perform imaging under standard imaging conditions 56, the processor 46 controls the aperture 42B via the drive unit 34 so that the aperture diameter of the aperture 42B corresponds to the aperture diameter of the F value 56A included in the standard imaging conditions 56. The processor 46 also controls the mechanical shutter 44 via the drive unit 34 so that the speed of the mechanical shutter 44 becomes the shutter speed 56B included in the standard imaging conditions 56. Furthermore, the processor 46 controls the analog gain and / or conversion efficiency of the image sensor 32 so that the ISO sensitivity 56C included in the standard imaging conditions 56 is achieved. Note that the conversion efficiency refers to the conversion efficiency of the variable capacitor connected to each photodode included in the image sensor 32. Conversion efficiency is the efficiency of converting the charge stored in the variable capacitor into voltage. Control of the conversion efficiency is achieved by changing the capacitance of the variable capacitor.

[0110] The processor 46 generates an image 20 based on the RAW data 20A obtained from the image sensor 32 by executing a standard imaging process 64. The processor 46 generates an image file 18 that associates the image 20 with metadata 22 including the standard imaging conditions 56 used in the standard imaging process 64. Hereinafter, the image 20 included in the image file 18 obtained by executing the standard imaging process 64 will be referred to as the "standard imaging image 20B1". In this embodiment, the "standard imaging image 20B1" is an example of the "second image" according to this disclosure.

[0111] The processor 46 displays the standard captured image 20B1 on the screen 36B1 of the display 36B. In the example shown in Figure 6, screen 36B1 is an example of the "second screen" according to this disclosure.

[0112] Figure 7 shows an example of the processing performed by the processor 46 when flag F is on and the release key is in the image acquisition start instruction state.

[0113] As an example, as shown in Figure 7, the processor 46 obtains custom imaging conditions 62 from the memory 50. The processor 46 then executes a custom imaging process 66, which is a process corresponding to the custom imaging conditions 62. The custom imaging process 66 is a process that causes the imaging device 12 to perform imaging under the custom imaging conditions 62. In this embodiment, the custom imaging process 66 is an example of the "first imaging condition processing" and "first imaging process" according to the present disclosure.

[0114] When the processor 46 causes the imaging device 12 to perform imaging under custom imaging conditions 62, the processor 46 controls the aperture 42B via the drive unit 34 so that the aperture diameter of the aperture 42B corresponds to the aperture diameter of the F value 62A included in the custom imaging conditions 62. The processor 46 also controls the mechanical shutter 44 via the drive unit 34 so that the speed of the mechanical shutter 44 becomes the shutter speed 62B included in the custom imaging conditions 62. Furthermore, the processor 46 controls the analog gain and / or conversion efficiency of the image sensor 32 so that the ISO sensitivity 62C included in the custom imaging conditions 62 is achieved.

[0115] The processor 46 generates an image 20 based on the RAW data 20A obtained from the image sensor 32 by executing a custom imaging process 66. The processor 46 outputs post-imaging processing information 29A and custom imaging conditions 62. For example, the output destination for the post-imaging processing information 29A and custom imaging conditions 62 is the image file 18. That is, the image file 18 stores metadata 22 including the post-imaging processing information 29A and custom imaging conditions 62.

[0116] The processor 46 generates an image file 18 that associates the image 20 with metadata 22, which includes post-imaging processing information 29A and custom imaging conditions 62 used in the custom imaging process 66. The processor 46 stores the image file 18 in the storage 48. Thus, the image file 18 is stored in the storage 48.

[0117] Hereinafter, the image 20 included in the image file 18 obtained by executing the custom imaging process 66 will be referred to as the "custom image 20B2". In this embodiment, the "custom image 20B2" is an example of the "first image" according to this disclosure.

[0118] The processor 46 displays the custom captured image 20B2 on the screen 36B1 of the display 36. The processor 46 also displays scheduled information 68 on the screen 36B1. The scheduled information 68 is information indicating that post-imaging processing 29 is scheduled. In the example shown in Figure 7, the scheduled information 68 is text indicating that post-imaging processing 29 is scheduled, superimposed on the custom captured image 20B2. In this embodiment, the scheduled information 68 is an example of the "scheduled information" as described in this disclosure. Also, in the example shown in Figure 7, the screen 36B1 is an example of the "first screen" as described in this disclosure.

[0119] The scheduled information 68 may include post-imaging processing information 29A and / or information based on the post-imaging processing information 29A. In the example shown in Figure 7, the message "Software A noise reduction processing is scheduled to be performed later." is displayed as text indicating that post-imaging processing 29 is scheduled. Here, "Software A" and "noise reduction processing" are examples of post-imaging processing information 29A, and the message "Software A noise reduction processing is scheduled to be performed later." is an example of information based on the post-imaging processing information 29A.

[0120] Here, an example of how the schedule information 68 is expressed in text is given, but this is merely one example. The schedule information 68 may also be output as sound from a speaker (not shown) or printed by a printer. Furthermore, the schedule information 68 may be stored in a storage area (for example, storage 48, or storage of an external device such as the information processing device 14). In addition, the schedule information 68 may be transmitted via the network 24 (see Figure 1) to an external device on the network 24 (for example, the information processing device 14 or a device other than the information processing device 14).

[0121] In the example shown in Figure 7, the custom image 20B2 has more noise than the standard image 20B1 shown in Figure 6, and is also brighter overall. For example, this could be because the user 15 is willing to accept the amount of noise in the custom image 20B2, since it is possible to remove the noise from the custom image 20B2 through post-processing 29, while still wanting the custom image 20B2 to be as bright as possible. For example, the phenomenon in which the custom image 20B2 has more noise than the standard image 20B1 and is also brighter overall is caused by setting the ISO sensitivity 62C included in the custom imaging conditions 62 used in the custom imaging process 66 to be higher than the ISO sensitivity 56C included in the standard imaging conditions 56 used in the standard imaging process 64.

[0122] Furthermore, if user 15 is willing to tolerate motion blur and other noises in the custom image 20B2, while also wanting to make the entire custom image 20B2 brighter, the shutter speed 62B included in the custom imaging conditions 62 will be slower than the shutter speed 56B included in the standard imaging conditions 56.

[0123] Furthermore, if user 15 wishes to make the entire custom image 20B2 brighter even if the depth of field becomes shallower, the F-number 62A included in the custom imaging condition 62 will be smaller than the F-number 56A included in the standard imaging condition 56.

[0124] In any of the above cases, the user 15 tolerates the presence of noise in the custom image 20B2, on the premise that the noise in the custom image 20B2 will be removed by performing post-processing 29 on the custom image 20B2.

[0125] Therefore, in the example shown in Figure 7, assuming that noise is removed from the custom captured image 20B2 by post-imaging processing 29, the standard imaging conditions 56 are customized based on the post-imaging processing information 29A, and these customized imaging conditions are used as custom imaging conditions 62 in the custom imaging processing 66.

[0126] Next, the operation of the imaging device 12 will be explained with reference to Figures 8A and 8B. Figures 8A and 8B show a flowchart of an example of the flow of imaging control processing executed by the processor 46 when presence / absence information 54 received by the receiving device 36A is acquired by the processor 46 via the receiving device 36A. In this embodiment, the flowchart shown in Figures 8A and 8B is an example of a "processing method" according to the present disclosure.

[0127] In the imaging control process shown in Figure 8A, first, in step ST100, the processor 46 determines whether or not flag F (see Figure 3) is turned off. If flag F is turned on in step ST100, the determination is denied, and the imaging control process proceeds to step ST118 shown in Figure 8B. If flag F is turned off in step ST100, the determination is affirmed, and the imaging control process proceeds to step ST102.

[0128] In step ST102, the processor 46 determines whether the release key is in the imaging preparation instruction state. If the release key is not in the imaging preparation instruction state in step ST102, the determination is denied and the imaging control process proceeds to step ST104. If the release key is in the imaging preparation instruction state in step ST102, the determination is affirmed and the imaging control process proceeds to step ST108.

[0129] In step ST104, the processor 46 determines whether the conditions for terminating the imaging control process (hereinafter referred to as "termination conditions") have been met. A first example of a termination condition is that an instruction has been given to the imaging device 12 to terminate the imaging control process. A second example of a termination condition is that some error has occurred during the execution of the imaging control process that makes it impossible to continue the imaging control process. The first and second examples of termination conditions are merely examples, and the termination conditions may be conditions other than those listed in the first and second examples.

[0130] In step ST104, if the termination conditions are not met, the determination is denied, and the imaging control process proceeds to step ST106. In step ST104, if the termination conditions are met, the determination is affirmed, and the imaging control process ends.

[0131] In step ST106, the processor 46 determines whether flag F is turned on or off. If flag F is turned off in step ST106, the determination is denied and the imaging control process proceeds to step ST102. If flag F is turned on in step ST106, the determination is affirmed and the imaging control process proceeds to step ST118 shown in Figure 8B.

[0132] In step ST108, the processor 46 acquires the live view image 55 and the photometric value 58 (see Figure 4). After the processing in step ST108 is completed, the imaging control process moves on to step ST110.

[0133] In step ST110, the processor 46 generates standard imaging conditions 56 based on the live view image 55 and photometric values ​​58 acquired in step ST108 and stores them in the memory 50 (see Figure 4). After the processing in step ST110 is completed, the imaging control process moves on to step ST112.

[0134] In step ST112, the processor 46 determines whether or not an imaging start command has been received by the release key. If, in step ST112, an imaging start command has not been received by the release key, the determination is denied and the imaging control process proceeds to step ST104. If, in step ST112, an imaging start command has been received by the release key, the determination is affirmed and the imaging control process proceeds to step ST114.

[0135] In step ST114, the processor 46 executes standard imaging processing 64 (see Figure 6). The execution of standard imaging processing 64 generates an image file 18, which is stored in storage 48 (see Figure 6). The image file 18 contains a standard image 20B1 generated based on RAW data 20A, and metadata 22 containing the standard imaging conditions 56 used in standard imaging processing 64 (see Figure 6), with the standard image 20B1 and metadata 22 being associated. Standard imaging processing 64 is performed using an image sensor 32, a mechanical shutter 44, and an aperture 42B controlled based on the standard imaging conditions 56 (see Figure 6). After the processing in step ST114 is completed, the imaging control process moves to step ST116.

[0136] In step ST116, the processor 46 displays the standard captured image 20B1 contained in the image file 18 generated in step ST114 on the screen 36B1 (see Figure 6). After the processing in step ST116 is completed, the imaging control process proceeds to step ST138 shown in Figure 8B.

[0137] In step ST118 shown in Figure 8B, the processor 46 determines whether the release key is in the imaging preparation instruction state. If the release key is not in the imaging preparation instruction state in step ST118, the determination is denied and the imaging control process proceeds to step ST120. If the release key is in the imaging preparation instruction state in step ST118, the determination is affirmed and the imaging control process proceeds to step ST124.

[0138] In step ST120, the processor 46 determines whether the termination conditions have been met. If the termination conditions are not met in step ST120, the determination is denied, and the imaging control process proceeds to step ST122. If the termination conditions are met in step ST120, the determination is affirmed, and the imaging control process ends.

[0139] In step ST122, the processor 46 determines whether flag F is turned off or not. If flag F is turned on in step ST122, the determination is denied and the imaging control process proceeds to step ST118. If flag F is turned off in step ST122, the determination is affirmed and the imaging control process proceeds to step ST102 shown in Figure 8A.

[0140] In step ST124, the processor 46 acquires the live view image 55 and the photometric value 58 (see Figure 4). After the processing in step ST124 is completed, the imaging control process moves on to step ST126.

[0141] In step ST126, the processor 46 generates standard imaging conditions 56 based on the live view image 55 and photometric values ​​58 acquired in step ST124 and stores them in memory 50 (see Figure 4). After the processing in step ST126 is completed, the imaging control process moves on to step ST128.

[0142] In step ST128, the processor 46 acquires post-imaging processing information 29A (see Figure 5). After the processing in step ST128 is completed, the imaging control process moves to step ST130.

[0143] In step ST130, the processor 46 generates custom imaging conditions 62 based on the standard imaging conditions 56 stored in memory 50 in step ST126 and the post-imaging processing information 29A acquired in step ST128 (see Figure 5). After the processing in step ST130 is executed, the imaging control processing moves to step ST132.

[0144] In step ST132, the processor 46 determines whether or not an imaging start command has been received by the release key. If, in step ST132, an imaging start command has not been received by the release key, the determination is denied and the imaging control process proceeds to step ST120. If, in step ST132, an imaging start command has been received by the release key, the determination is affirmed and the imaging control process proceeds to step ST134.

[0145] In step ST134, the processor 46 executes a custom imaging process 66 (see Figure 7). The custom imaging process 66 generates an image file 18, which is then stored in the storage 48 (see Figure 7).

[0146] The image file 18 contains a custom captured image 20B2 generated based on RAW data 20A, and metadata 22 including post-imaging processing information 29A and custom imaging conditions 62 used in custom imaging processing 66 (see Figure 7), with the custom captured image 20B2 and metadata 22 being associated. Furthermore, custom imaging processing 66 is performed using an image sensor 32, a mechanical shutter 44, and an aperture 42B controlled based on the custom imaging conditions 62 (see Figure 7). After the processing in step ST134 is performed, the imaging control processing moves to step ST136.

[0147] In step ST136, the processor 46 displays the custom image capture image 20B2 contained in the image file 18 generated in step ST134 on the screen 36B1 (see Figure 7). After the processing in step ST136 is completed, the imaging control process moves on to step ST138.

[0148] In step ST138, the processor 46 determines whether the termination conditions have been met. If the termination conditions are not met in step ST138, the determination is denied, and the imaging control process proceeds to step ST100 shown in Figure 8A. If the termination conditions are met in step ST138, the determination is affirmed, and the imaging control process ends.

[0149] As described above, in this embodiment, the custom imaging process 66 is executed as a process according to the custom imaging conditions 62 determined based on the post-imaging processing information 29A, which is information regarding post-imaging processing 29 to be performed on the image 20 obtained by imaging. Post-imaging processing 29 is image processing that the user 15 plans to perform on the image 20 after imaging. Therefore, according to this embodiment, the custom imaging process 66 according to the custom imaging conditions 62 that meet the user 15's request to perform post-imaging processing 29 on the image 20 after imaging can be executed. Furthermore, according to this embodiment, since there is no need to solve image quality issues that can be solved by performing post-imaging processing 29 within the imaging device 12, the processing time and power consumption of the imaging device 12 can be reduced.

[0150] Furthermore, in this embodiment, the post-imaging processing 29 is performed by the information processing device 14. Therefore, according to this embodiment, a custom imaging process 66 can be executed according to custom imaging conditions 62 that meet the requirements of the user 15 who plans to perform post-imaging processing 29 on the image 20 in the information processing device 14 after imaging.

[0151] Furthermore, in this embodiment, the custom imaging conditions 62 include conditions that include settings for the imaging device 12 when imaging is performed. Examples of settings for the imaging device 12 when imaging is performed include the F-number 62A, shutter speed 62B, and ISO sensitivity 62C (see Figure 5). Therefore, according to this embodiment, a custom imaging process 66 can be performed according to the F-number 62A, shutter speed 62B, and ISO sensitivity 62C that meet the needs of the user 15 who plans to perform post-imaging processing 29 on the image 20 after imaging.

[0152] Furthermore, in this embodiment, when the custom imaging process 66 is executed, scheduled information 68 is displayed on the screen 36B1. The scheduled information 68 indicates that post-imaging processing 29 is scheduled to be performed on the custom image 20B2 after the custom imaging process 66. Therefore, according to this embodiment, the user 15 can be made aware that the custom image 20B2 is not in its final form and that post-imaging processing 29 is scheduled to be performed after imaging.

[0153] Furthermore, in this embodiment, the scheduled information 68 displayed on screen 36B1 is information based on the post-imaging processing information 29A (for example, the message "Software A noise reduction processing is scheduled to be performed later" as shown in Figure 7). The scheduled information 68 also includes the post-imaging processing information 29A (for example, the text "Software A" and "noise reduction processing" in the message "Software A noise reduction processing is scheduled to be performed later" as shown in Figure 9). Therefore, according to this embodiment, the user 15 can be made aware of information regarding the post-imaging processing 29 that will be performed on the custom image 20B2 after the custom imaging processing 66.

[0154] Furthermore, in this embodiment, the custom captured image 20B2 is displayed on screen 36B1 (see Figure 7). Therefore, according to this embodiment, the user 15 can visually view the custom captured image 20B2.

[0155] Furthermore, in this embodiment, the standard imaging conditions 56 used in the standard imaging process 64 performed by the imaging device 12 are determined based on the live view image 55 and the photometric value 58 (see Figure 4). Then, the custom imaging conditions 62 used in the custom imaging process 66 performed by the imaging device 12 are determined based on the standard imaging conditions 56 (see Figure 5). This means that the custom imaging conditions 62 are determined based on the live view image 55 and the photometric value 58. Therefore, according to this embodiment, the custom imaging conditions 62 are determined with greater accuracy compared to the case where the custom imaging conditions 62 are determined independently of the live view image 55 and the photometric value 58.

[0156] Furthermore, in this embodiment, the standard imaging process 64 and the custom imaging process 66 are selectively executed (see step ST114 in Figure 8A and step ST134 in Figure 8B). Therefore, according to this embodiment, the user 15 can selectively execute the standard imaging process 64 and the custom imaging process 66 according to their will.

[0157] Furthermore, in this embodiment, the standard imaging process 64 and the custom imaging process 66 are selectively executed based on the presence / absence information 54 (see Figure 3) (see step ST114 in Figure 8A and step ST134 in Figure 8B). The presence / absence information 54 is information regarding whether or not the post-imaging process 29 is executed. Therefore, according to this embodiment, the imaging process selected from the standard imaging process 64 and the custom imaging process 66 based on whether or not the post-imaging process 29 is executed can be executed. For example, it is possible to avoid the custom imaging process 66 being executed even though the post-imaging process 29 is not executed, or the standard imaging process 64 being executed even though the post-imaging process 29 is executed. Conversely, it is possible to configure the system so that the custom imaging process 66 is executed when the post-imaging process 29 is executed, and the standard imaging process 64 is executed when the post-imaging process 29 is not executed.

[0158] Furthermore, in this embodiment, the standard captured image 20B1 is displayed on screen 36B1 (see Figure 6). Therefore, according to this embodiment, the user 15 can visually view the standard captured image 20B1.

[0159] Furthermore, in this embodiment, the standard imaging conditions 56 include conditions that include settings for the imaging device 12 when imaging is performed. Examples of settings for the imaging device 12 when imaging is performed include the F-number 56A, shutter speed 56B, and ISO sensitivity 56C (see Figure 4). Therefore, according to this embodiment, a standard imaging process 64 can be executed according to the F-number 56A, shutter speed 56B, and ISO sensitivity 56C set in the imaging device 12.

[0160] Furthermore, in this embodiment, the processor 46 outputs post-imaging processing information 29A. For example, the output destination of the post-imaging processing information 29A is the image file 18. In this case, the image file 18 stores the post-imaging processing information 29A in metadata 22. Therefore, according to this embodiment, the post-imaging processing information 29A can be provided to the user 15 through the image file 18 obtained by executing the custom imaging process 66. In this embodiment, the output of post-imaging processing information 29A by the processor 46 is shown as an example in which the post-imaging processing information 29A is stored in the image file 18 by the processor 46. However, this is merely one example, and the post-imaging processing information 29A may also be displayed on the screen 36B1 or output as sound from a speaker (not shown).

[0161] Furthermore, in this embodiment, the custom captured image 20B2 and the post-processing information 29A are stored in association with each other. For example, the post-processing information 29A is included in metadata 22, which is data in Exif format, and the custom captured image 20B2 and the metadata 22 are stored in association with each other in the image file 18. The image file 18 is stored in storage 48. Therefore, according to this embodiment, the user 15 can understand the post-processing information 29A corresponding to the custom captured image 20B2 obtained by executing the custom imaging process 66. As a result, the user 15 can understand what kind of image processing will be performed on the custom captured image 20B2 as post-processing 29.

[0162] In the above embodiment, when custom imaging conditions 62 are generated, a custom imaging process 66 is executed on the condition that the user 15 gives an instruction to start imaging to the imaging device 12 (see steps ST130 to ST134 shown in Figure 8B). However, this is merely one example, and for example, the process shown in the flowchart in Figure 9 may be executed. The flowchart in Figure 9 differs from the flowchart in Figure 8B in that step ST200 is provided between step ST130 and step ST132.

[0163] In step ST200 shown in Figure 9, the processor 46 executes a first perception process. The first perception process is a process that makes information about the custom imaging conditions 62 perceptual. An example of information about the custom imaging conditions 62 is the information included in the custom imaging conditions 62 (for example, the F-number 62A, the shutter speed 62B, and the ISO sensitivity 62C). A first example of the first perception process is the process of displaying information about the custom imaging conditions 62 on the screen 36B1. A second example of the first perception process is the process of outputting information about the custom imaging conditions 62 as sound from a speaker (not shown). Thus, the first perception process only needs to be a process that makes information about the custom imaging conditions 62 perceptual to the user 15.

[0164] As shown in Figure 9, in the example shown, a process is performed to make the user 15 aware of information regarding the custom imaging conditions 62, so that the user 15 can grasp the information regarding the custom imaging conditions 62. Also, in the example shown in Figure 9, the custom imaging process 66 is executed based on the given imaging start instruction in response to the execution of the process in step ST200 (see steps ST132 and ST134). That is, the processes in steps ST132 and ST134 are executed on the condition that the process in step ST200 has been executed. As a result, the user 15 can grasp the information regarding the custom imaging conditions 62, and the imaging device 12 can be instructed to perform imaging under the custom imaging conditions 62 according to the user 15's intentions.

[0165] In the above embodiment, an example was given in which the standard imaging process 64 and the custom imaging process 66 are selectively executed according to the state of a flag F, which is switched on and off by the processor 46 based on presence / absence information 54. However, this is merely one example, and the user 15 may be allowed to decide whether to have the processor 46 execute the standard imaging process 64 or the custom imaging process 66. In this case, for example, the imaging control process shown in Figures 10A and 10B (i.e., a modified version of the imaging control process shown in Figures 8A and 8B) is executed.

[0166] In the imaging control process shown in Figure 10A, first, in step ST300, the processor 46 determines whether the release key is in the imaging preparation instruction state. If the release key is not in the imaging preparation instruction state in step ST300, the determination is denied, and the imaging control process proceeds to step ST328 shown in Figure 10B. If the release key is in the imaging preparation instruction state in step ST300, the determination is affirmed, and the imaging control process proceeds to step ST302.

[0167] In step ST302, the processor 46 acquires the live view image 55 and the photometric value 58. After the processing in step ST302 is completed, the imaging control process proceeds to step ST304.

[0168] In step ST304, the processor 46 generates standard imaging conditions 56 based on the live view image 55 and photometric values ​​58 acquired in step ST302 and stores them in the memory 50. After the processing in step ST304 is completed, the imaging control process moves on to step ST306.

[0169] In step ST306, the processor 46 acquires post-imaging processing information 29A. After the processing in step ST306 is executed, the imaging control process proceeds to step ST308.

[0170] In step ST308, the processor 46 generates custom imaging conditions 62 based on the standard imaging conditions 56 stored in the memory 50 in step ST304 and the post-imaging processing information 29A acquired in step ST306. After the processing in step ST308 is executed, the imaging control process moves to step ST310.

[0171] In step ST310, the processor 46 performs a second perception process. The second perception process is a process that makes information regarding standard imaging conditions 56 (e.g., F-number 56A, shutter speed 56B, and ISO sensitivity 56C) and information regarding custom imaging conditions 62 (e.g., F-number 62A, shutter speed 62B, and ISO sensitivity 62C) perceptible. A first example of the second perception process is a process that displays the information regarding standard imaging conditions 56 and the information regarding custom imaging conditions 62 on the screen 36B1 in a comparable manner. A second example of the first perception process is a process that outputs one of the information regarding standard imaging conditions 56 and the other of the information regarding custom imaging conditions 62 sequentially as sound from a speaker (not shown). Thus, the second perception process only needs to be a process that makes the user 15 perceive the information regarding standard imaging conditions 56 and the information regarding custom imaging conditions 62.

[0172] In step ST312, the processor 46 determines whether the user 15 has selected an imaging type via the receiving device 36A. The imaging type refers to either the standard imaging process 64 or the custom imaging process 66. If the user 15 has not selected an imaging type via the receiving device 36A in step ST312, the determination is denied, and the imaging control process proceeds to step ST328 shown in Figure 10B. If the user 15 has selected an imaging type via the receiving device 36A in step ST312, the determination is affirmed, and the imaging control process proceeds to step ST314.

[0173] In step ST314, the processor 46 determines whether the imaging type selected by the user 15 is the standard imaging process 64. If, in step ST314, the imaging type selected by the user 15 is not the standard imaging process 64 (i.e., the imaging type selected by the user 15 is the custom imaging process 66), the imaging control process proceeds to step ST322 shown in Figure 10B. If, in step ST314, the imaging type selected by the user 15 is the standard imaging process 64, the imaging control process proceeds to step ST316.

[0174] In step ST316, the processor 46 determines whether or not an imaging start command has been received by the release key. If, in step ST316, an imaging start command has not been received by the release key, the determination is denied, and the imaging control process proceeds to step ST328 shown in Figure 10B. If, in step ST316, an imaging start command has been received by the release key, the determination is affirmed, and the imaging control process proceeds to step ST318.

[0175] In step ST318, the processor 46 executes standard imaging processing 64. The execution of standard imaging processing 64 generates an image file 18, which is stored in storage 48. The image file 18 contains a standard image 20B1 generated based on RAW data 20A, and metadata 22 containing the standard imaging conditions 56 used in standard imaging processing 64, with the standard image 20B1 and metadata 22 being associated. Furthermore, standard imaging processing 64 uses an image sensor 32, a mechanical shutter 44, and an aperture 42B controlled based on the standard imaging conditions 56. After the processing in step ST318 is completed, the imaging control process proceeds to step ST320.

[0176] In step ST320, the processor 46 displays the standard captured image 20B1 contained in the image file 18 generated in step ST318 on the screen 36B1. After the processing in step ST320 is completed, the imaging control process proceeds to step ST328 shown in Figure 10B.

[0177] In step ST322 shown in Figure 10B, the processor 46 determines whether or not an imaging start command has been received by the release key. If, in step ST322, an imaging start command has not been received by the release key, the determination is denied and the imaging control process proceeds to step ST328. If, in step ST322, an imaging start command has been received by the release key, the determination is affirmed and the imaging control process proceeds to step ST324.

[0178] In step ST324, the processor 46 executes a custom imaging process 66. The execution of the custom imaging process 66 generates an image file 18, which is stored in the storage 48. The image file 18 contains a custom image 20B2 generated based on the RAW data 20A, and metadata 22 including post-imaging processing information 29A and custom imaging conditions 62 used in the custom imaging process 66, with the custom image 20B2 and metadata 22 being associated. In addition, the custom imaging process 66 uses an image sensor 32, a mechanical shutter 44, and an aperture 42B controlled based on the custom imaging conditions 62. After the processing in step ST324 is executed, the imaging control process moves to step ST326.

[0179] In step ST326, the processor 46 displays the custom captured image 20B2 contained in the image file 18 generated in step ST324 on the screen 36B1. After the processing in step ST326 is completed, the imaging control process proceeds to step ST328.

[0180] In step ST328, the processor 46 determines whether the termination conditions have been met. If the termination conditions are not met in step ST328, the determination is denied, and the imaging control process proceeds to step ST300 shown in Figure 10A. If the termination conditions are met in step ST328, the determination is affirmed, and the imaging control process ends.

[0181] Thus, in the examples shown in Figures 10A and 10B, the standard imaging process 64 and the custom imaging process 66 are selectively executed according to instructions given by the user 15 (in this case, an instruction to start imaging) provided that the second perception process has been executed. Therefore, according to the examples shown in Figures 10A and 10B, the user 15 can be made aware of information regarding the standard imaging conditions 56 and the custom imaging conditions 62, and then the standard imaging process 64 and the custom imaging process 66 can be selectively executed according to the user 15's wishes.

[0182] In the above embodiment, an example of the form in which the scheduled information 68 is displayed on the screen 36B1 is given (see Figure 7), but this is merely an example. For example, as shown in Figure 11, the processor 46 may display incomplete post-imaging processing information 70 on the screen 36B1. Incomplete post-imaging processing information 70 is information indicating that the post-imaging processing 29 is incomplete. In the example shown in Figure 11, the incomplete post-imaging processing information 70 is shown as text indicating that the post-imaging processing 29 is incomplete. An example of text indicating that the post-imaging processing 29 is incomplete is the message, "Image processing by software A after imaging is incomplete." In the example shown in Figure 11, an example of the form in which text indicating that the post-imaging processing 29 is incomplete is displayed on the screen 36B1 is given, but this is merely an example. For example, audio indicating that the post-imaging processing 29 is incomplete may be output from a speaker (not shown).

[0183] In this way, user 15 can be made aware that the post-imaging processing 29 is incomplete. Furthermore, the message "Image processing by software A after imaging is incomplete" is information based on the post-imaging processing information 29A, and "software A" is the post-imaging processing information 29A. Therefore, user 15 can be made aware of information regarding the image processing to be performed as post-imaging processing 29 on the custom captured image 20B2. In the example shown in Figure 11, the incomplete post-imaging processing information 70 is an example of "incomplete post-imaging information" and "information based on post-imaging processing information" related to this disclosure.

[0184] In the example shown in Figure 11, the post-processing information 70 is displayed on screen 36B1. However, both the scheduled information 68 and the post-processing information 70 may be displayed on screen 36B1.

[0185] In the above embodiment, custom imaging conditions 62 were exemplified as imaging conditions used in custom imaging processing 66. However, as shown in Figure 12, for example, custom imaging conditions 72 may be used in place of custom imaging conditions 62 in custom imaging processing 66. The difference between custom imaging conditions 62 and custom imaging conditions 72 is that custom imaging conditions 62 are determined based on post-imaging processing information 29A and standard imaging conditions 56, while custom imaging conditions 72 are determined based on post-imaging processing information 29A, standard imaging conditions 56, and finish requirements 74.

[0186] The finish request 74 is information including requests, instructions, or demands regarding the image quality of the final image (hereinafter simply referred to as the "final image") obtained by performing the post-imaging processing 29. The finish request 74 is received by the receiving device 36A, and the processor 46 acquires the finish request 74 received by the receiving device 36A. In the example shown in Figure 12, the finish request 74 is an example of the "finish request" in this disclosure.

[0187] Here, the finishing request 74 is exemplified by information including requests, instructions, or demands regarding the image quality of the final image obtained by executing the post-imaging processing 29. However, this is merely an example, and the finishing request 74 may be a request for the finishing of the custom captured image 20B2 to the imaging device 12 (in other words, information including requests, instructions, or demands regarding the finishing that are realized within the imaging device 12).

[0188] One example of the final image requirement 74 is the requirement to prioritize the sense of dynamism of the subject 16 in the final image over other image quality requirements. In this case, an example of the correspondence between the F-number 56A, shutter speed 56B, and ISO sensitivity 56C included in the standard imaging conditions 56 and the F-number 62A, shutter speed 62B, and ISO sensitivity 62C included in the custom imaging conditions 62 is shown in Table 4 below. Note that the values ​​shown in Table 4 are merely examples, and other values ​​may be used as long as they do not deviate from the spirit of this disclosure.

[0189]

[0190] A second example of the finish requirement 74 is the requirement to prioritize the suppression of motion blur appearing in the final image over other image quality requirements. In this case, an example of the relationship between the F-number 56A, shutter speed 56B, and ISO sensitivity 56C included in the standard imaging conditions 56 and the F-number 62A, shutter speed 62B, and ISO sensitivity 62C included in the custom imaging conditions 62 is shown in Table 5 below. Note that the values ​​shown in Table 5 are merely examples, and other values ​​may be used as long as they do not deviate from the spirit of this disclosure.

[0191]

[0192] A third example of the finish requirement 74 is the requirement to prioritize the sharpness of the background in the final image over other image quality requirements. In this case, an example of the relationship between the F-number 56A, shutter speed 56B, and ISO sensitivity 56C included in the standard imaging conditions 56 and the F-number 62A, shutter speed 62B, and ISO sensitivity 62C included in the custom imaging conditions 62 is shown in Table 6 below. Note that the values ​​shown in Table 6 are merely examples, and other values ​​may be used as long as they do not deviate from the spirit of this disclosure.

[0193]

[0194] In the example shown in Figure 12, the storage 48 stores the trained model 76. The trained model 76 is a model optimized by performing machine learning on a model (e.g., a neural network) using training data that uses information corresponding to post-imaging processing information 29A, information corresponding to standard imaging conditions 56, and information corresponding to finish requirements 74 as example data, and custom imaging conditions 62 as ground truth data. In the example shown in Figure 12, the trained model 76 is an example of the "trained model" according to this disclosure.

[0195] The processor 46 generates custom imaging conditions 72 based on post-imaging processing information 29A, standard imaging conditions 56, and final image requirements 74. The generation of custom imaging conditions 72 is achieved by using a trained model 76 stored in storage 48. The processor 46 retrieves the trained model 76 from storage 48 and inputs the post-imaging processing information 29A, standard imaging conditions 56, and final image requirements 74 to the trained model 76. As a result, the trained model 76 outputs custom imaging conditions 72 corresponding to the post-imaging processing information 29A, standard imaging conditions 56, and final image requirements 74. Similar to the above embodiment, the processor 46 stores the custom imaging conditions 72 in memory 50. Then, similar to the above embodiment, the processor 46 executes custom imaging processing 66 under the custom imaging conditions 72 stored in memory 50.

[0196] In this way, the imaging device 12 can obtain the final image with the desired finish as intended by the user 15. Furthermore, in the example shown in Figure 12, the generation of custom imaging conditions 72 is achieved using a trained model 76, so custom imaging conditions 72 corresponding to the post-imaging processing information 29A, standard imaging conditions 56, and finish request 74 can be easily obtained.

[0197] In the example shown in Figure 12, the generation of custom imaging conditions 72 is shown as an example of a form in which a trained model 76 is used, but this is merely one example. For example, the generation of custom imaging conditions 72 may be achieved by using a rule-based approach that uses a table and / or calculation formula that can derive custom imaging conditions 72 from post-imaging processing information 29A, standard imaging conditions 56, and finish requirements 74.

[0198] In the example shown in Figure 12, the trained model 76 is shown as a model optimized by performing machine learning on the model using training data with example data consisting of information corresponding to post-imaging processing information 29A, information corresponding to standard imaging conditions 56, and information corresponding to finish requirements 74, and the custom imaging conditions 62 as the ground truth data. However, this is merely one example. The trained model 76 may also be a model optimized by performing machine learning on the model using training data with example data consisting of information corresponding to post-imaging processing information 29A and information corresponding to finish requirements 74, and the custom imaging conditions 62 as the ground truth data. In this case, the processor 46 inputs the post-imaging processing information 29A and the finish requirements 74 to the trained model 76, and the trained model 76 outputs the custom imaging conditions 62. The custom imaging conditions 62 may be obtained based on a rule-based system using a table and / or calculation formulas that can derive the custom imaging conditions 72 from the post-imaging processing information 29A and the finish requirements 74.

[0199] Furthermore, the trained model 76 may be a model optimized by performing machine learning on the model using training data where the information corresponding to the finish requirement 74 is used as example data and the custom imaging conditions 62 are used as ground truth data. In this case, the processor 46 inputs the finish requirement 74 to the trained model 76, and the trained model 76 outputs the custom imaging conditions 62. The custom imaging conditions 62 may be obtained based on a rule-based system using a table and / or calculation formulas that can derive the custom imaging conditions 72 from the finish requirement 74.

[0200] In the above embodiment, an example was given in which the processor 46 selectively executes the standard imaging process 64 and the custom imaging process 66, but this is merely one example. For example, as shown in Figure 13, the processor 46 may perform the standard imaging process 64 and the custom imaging process 66 consecutively. In this case, the custom imaging process 66 may be performed after the standard imaging process 64, or the standard imaging process 64 may be performed after the custom imaging process 66. By performing the standard imaging process 64 and the custom imaging process 66 consecutively in this way, the user 15 can obtain the standard image 20B1 and the custom image 20B2 more quickly than when the standard imaging process 64 and the custom imaging process 66 are selectively executed according to instructions from the user 15.

[0201] In the above embodiment, an example was given in which the standard image 20B1 and the custom image 20B2 are displayed separately on the screen 36B1, but this is merely one example. For example, as shown in Figure 13, the processor 46 may display the standard image 20B1 and the custom image 20B2 on the screen 36B1 in a manner that allows for comparison. In this way, the user 15 can visually compare the standard image 20B1 and the custom image 20B2. In the example shown in Figure 13, the screen 36B1 is an example of the "third screen" according to this disclosure.

[0202] The screen that displays the standard image 20B1 and the custom image 20B2 in a way that allows for comparison, the screen that displays the standard image 20B1 separately from the custom image 20B2, and the screen that displays the custom image 20B2 separately from the standard image 20B1 may be the same screen (for example, screen 36B1) or they may be separate screens.

[0203] As an example, as shown in Figure 13, the processor 46 may display on the screen 36B1 in a manner that allows comparison between the standard imaging conditions 56 used in the standard imaging process 64 (e.g., F-number 56A, shutter speed 56B, and ISO sensitivity 56C, etc.) and the custom imaging conditions 62 or 72 used in the custom imaging process 66 (e.g., F-number 62A, shutter speed 62B, and ISO sensitivity 62C, etc.). In this case, the processor 46 may display the standard imaging image 20B1 and the standard imaging conditions 56 on the screen 36B1 in a manner that allows visual identification of the relationship between the standard imaging image 20B1 and the standard imaging conditions 56 on the screen 36B1. In a similar manner, the processor 46 may also display the custom captured image 20B2 and the custom imaging conditions 62 or 72 on the screen 36B1 in a manner that makes it visually possible to identify that the custom captured image 20B2 and the custom imaging conditions 62 or 72 are related to each other.

[0204] In this way, the user 15 can visually compare the standard imaging conditions 56 used in the standard imaging process 64 with the custom imaging conditions 62 or 72 used in the custom imaging process 66. Furthermore, the user 15 can visually understand that the standard image 20B1 and the standard imaging conditions 56 are related to each other, and that the custom image 20B2 and the custom imaging conditions 62 or 72 are related to each other.

[0205] In the above embodiment, as shown in Figure 7, it is assumed that noise will be removed by post-imaging processing 29, and an example is given in which the message "Noise reduction processing by software A is scheduled to be performed later." is displayed on the screen 36B1. However, this is merely one example. For example, if the brightness of the custom image 20B2 is adjusted by post-imaging processing 29, the processor 46 may display scheduled information 78 on the screen 36B1, as shown in Figure 14. The scheduled information 78 is information indicating that the brightness of the custom image 20B2 will be adjusted by post-imaging processing 29. In the example shown in Figure 14, the scheduled information 78 is "Brightness adjustment processing by software B is scheduled to be performed later."

[0206] The message "[...] is displayed. In this way, user 15 can visually understand that brightness adjustment will be performed on the custom captured image 20B2 by post-processing 29.

[0207] In the above embodiment, an example was given in which the post-imaging processing 29 is performed by the information processing device 14, but this is merely one example. For example, if software capable of executing post-imaging processing 29 (for example, image processing using the above software A and / or the above software B, etc.) (for example, software equivalent to the above software A and / or the above software B, etc.) is installed in the imaging device 12, the post-imaging processing 29 may be performed by the imaging device 12. A first example of post-imaging processing 29 performed by the imaging device 12 is image processing that is not performed in the imaging device 12 due to the large processing load and / or power consumption when normal imaging processing (for example, standard imaging processing 64) is performed. A second example of post-imaging processing 29 performed by the imaging device 12 is image processing that is not performed in the imaging device 12 due to the large processing load and / or power consumption when normal imaging processing (for example, standard imaging processing 64) is performed, but is performed by the imaging device 12 only when instructed by the user 15. Even in this configuration, the same effects as in the above embodiment can be obtained.

[0208] In the above embodiment, an imaging device 12 is exemplified, but as an example, as shown in Figure 15, the present disclosure can also be established by using a smart device 80 instead of the imaging device 12. The smart device 80 includes a computer 82 corresponding to the computer 30, a processor 84 corresponding to the processor 46, a storage 86 corresponding to the storage 48, and a memory 88 corresponding to the memory 50. The smart device 80 also includes imaging device bodies 90 and 92. The imaging device bodies 90 and 92 are arranged side by side and operate independently of each other under the control of the processor 84. In the example shown in Figure 15, the imaging device bodies 90 and 92 are shown as in-cameras, but the imaging device bodies 90 and 92 may be out-cameras, or one of the imaging device bodies 90 and 92 may be an in-camera and the other may be an out-camera.

[0209] The imaging device body 90 includes an image sensor 94 corresponding to the image sensor 32 and an optical system 96 corresponding to the optical system 42. The imaging device body 92 includes an image sensor 98 corresponding to the image sensor 32 and an optical system 100 corresponding to the optical system 42.

[0210] For example, in this case, the standard imaging process 64 is realized by the processor 84 controlling one of the imaging device bodies 90 and 92, and the custom imaging process 66 is realized by the processor 84 controlling the other of the imaging device bodies 90 and 92. Alternatively, both the standard imaging process 64 and the custom imaging process 66 may be realized by the processor 84 controlling the imaging device body 90, and both the standard imaging process 64 and the custom imaging process 66 may be realized by the processor 84 controlling the imaging device body 92. In this case, the standard imaging process 64 and the custom imaging process 66 may be executed selectively as described in the above embodiment, or the standard imaging process 64 and the custom imaging process 66 may be executed consecutively as shown in Figure 13. Also, similar to the example shown in Figure 13, the standard image 20B1 and the custom image 20B2 may be displayed on the screen of the smart device 80 in a comparable state.

[0211] In the above embodiment, a custom imaging process 66 was provided as an example of the "first imaging condition processing" according to the present disclosure, but this is merely one example. For example, the processor 46 may, instead of or in combination with the custom imaging process 66, execute any one of the first to third examples shown below as an example of the "first imaging condition processing" according to the present disclosure.

[0212] The first example is a process that outputs the custom imaging conditions 62 or information based on the custom imaging conditions 62 when the degree of deviation between the contents of the custom imaging conditions 62 and the contents of the pre-specified imaging conditions (for example, the contents of the standard imaging conditions 56, or the contents of the imaging conditions specified by the user 15) exceeds a threshold. In this case, examples of information based on the custom imaging conditions 62 include information that can identify that the degree of deviation between the contents of the custom imaging conditions 62 and the contents of the pre-specified imaging conditions has exceeded a threshold, visible information that allows the contents of the custom imaging conditions 62 to be perceived, and / or audio information that allows the contents of the custom imaging conditions 62 to be perceived.

[0213] The second example is a process that outputs the custom imaging conditions 62 or information based on the custom imaging conditions 62 to different output destinations depending on the degree of discrepancy between the contents of the custom imaging conditions 62 and the contents of the pre-specified imaging conditions.

[0214] The third example is a process that outputs perceptible information (e.g., visible information and / or sound information, etc.) when the content of the custom imaging conditions 62 differs from the content of the imaging conditions specified in advance.

[0215] In the above embodiment, an example was given in which the standard image 20B1 and the custom image 20B2 are displayed on the screen 36B1 of the imaging device 12. However, the standard image 20B1 and / or the custom image 20B2 may also be displayed on the screen of a display located outside the imaging device 12 (for example, display 28).

[0216] In the above embodiment, an example was given in which the processor 46 generates standard imaging conditions 56 based on the live view image 55 and the photometric value 58, but this is merely one example. For example, the processor 46 may determine the brightness of the entire scene from the live view image 55 or the photometric value 58 and generate standard imaging conditions 56 corresponding to the determined brightness.

[0217] In the above embodiment, an example of a configuration in which the imaging control processing is performed by a computer 30 was described, but this disclosure is not limited thereto, and at least some of the processing included in the imaging control processing may be performed by a device provided outside the computer 30. An example of this case will be described below with reference to Figure 16.

[0218] Figure 16 is a conceptual diagram showing an example of the configuration of the imaging system 102. The imaging system 102 is an example of an "imaging device" according to this disclosure. The imaging system 102 differs from the imaging device 12 described in the above embodiment in that it has an external device 104.

[0219] The external device 104 is connected to the computer 30 via the network 24 so as to be able to communicate with it. An example of the external device 104 is at least one server that directly or indirectly sends and receives data with the computer 30 via the network 24. The external device 104 receives processing execution instructions from the processor 46 of the computer 30 via the network 24. The external device 104 then executes the processing according to the received processing execution instructions and transmits the processing results to the computer 30 via the network 24. In the computer 30, the processor 46 receives the processing results transmitted from the external device 104 via the network 24 and executes processing using the received processing results.

[0220] Examples of processing execution instructions include an instruction to have the external device 104 execute at least a part of the imaging control processing.

[0221] One example of at least a part of the imaging control processing (i.e., processing to be performed by the external device 104) is the process of generating standard imaging conditions 56 (see Figure 4). In this case, the external device 104 executes the process of generating standard imaging conditions 56 in accordance with the processing execution instructions given from the processor 46 via the network 24, and transmits the standard imaging conditions 56 as a result of the processing to the computer 30 via the network 24. In the computer 30, the processor 46 receives the standard imaging conditions 56 and performs the same processing as in the above embodiment using the received standard imaging conditions 56.

[0222] One example of at least a part of the imaging control processing (i.e., processing to be performed by the external device 104) is the process of generating custom imaging conditions 62 or 72 (see Figures 5 and 12). In this case, the external device 104 executes the process of generating custom imaging conditions 62 or 72 in accordance with the processing execution instructions given from the processor 46 via the network 24, and transmits the custom imaging conditions 62 or 72 as a result of the processing to the computer 30 via the network 24. In the computer 30, the processor 46 receives the custom imaging conditions 62 or 72 and executes the same processing as in the above embodiment using the received custom imaging conditions 62 or 72.

[0223] As a first example of at least a part of the imaging control processing (i.e., processing to be performed by the external device 104), there is the process of generating an image file 18 (see Figures 6 and 7). In this case, the external device 104 executes the process of generating an image file 18 according to the processing execution instructions given from the processor 46 via the network 24, and transmits the image file 18 as a result of the processing to the computer 30 via the network 24. In this case, the processing execution instructions include an image 20 and metadata 22. Alternatively, the processing execution instructions may include RAW data 20A instead of an image 20, in which case the external device 104 generates the image 20 based on the RAW data 20A. In the computer 30, the processor 46 receives the image file 18 and performs the same processing as in the above embodiment using the received image file 18.

[0224] The external device 104 may be implemented through cloud computing. Cloud computing is merely one example; the external device 104 may also be implemented through network computing such as fog computing, edge computing, or grid computing.

[0225] In the above embodiments, each process is executed on any computer. Furthermore, any computer may execute these processes using a processor as hardware, a program as software, or a combination thereof. In this case, the processor is configured to work in cooperation with the program to execute the various processes in the above embodiments, and can function as a unit or means in the above embodiments. Also, the execution order of the processes by the processor is not limited to the order described and may be changed as appropriate. Any computer may be a general-purpose computer, a computer designed for a specific purpose, a workstation, or any other system capable of executing each process.

[0226] A processor may consist of one or more hardware components, and the type of hardware is not limited. For example, a processor may consist of hardware such as a CPU, MPU, FPGA or other programmable logic device, ASIC or other dedicated circuitry for executing specific processes, GPU, and / or NPU. The type of hardware may also be a combination of different types of hardware. When multiple hardware components are configured to execute one or more processes of a processor, the multiple hardware components may reside in physically separate devices or in the same device. Furthermore, in any embodiment, the order of each process performed by the processor is not limited to the order described above and may be changed as appropriate. Hardware is composed of electrical circuits (circuitry) that combine circuit elements such as semiconductor elements.

[0227] Furthermore, the program may be software such as firmware or microcode. Alternatively, the program may be, for example, a group of program modules, each function of which may be implemented by a processor configured to perform its respective function. The program may also be program code and / or multiple code segments stored on one or more non-temporary computer-readable media (e.g., storage). The program may be divided and stored on multiple non-temporary computer-readable media located in physically separate devices. Program code or code segments may represent any combination of procedures, functions, subprograms, routines, subroutines, modules, software packages, classes, instructions, data structures, or program statements. Program code or code segments may be connected to other code segments or hardware circuits by sending and receiving information, data, arguments, parameters, or memory contents.

[0228] Furthermore, while the above embodiment illustrates a configuration in which the imaging control program 52 is pre-stored in the storage 48 (i.e., installed), this disclosure is not limited thereto. The imaging control program 52 may be provided in a form stored on a storage medium such as a CD-ROM, DVD-ROM, and / or USB memory. Alternatively, the imaging control program 52 may be downloaded from an external device via a network.

[0229] This disclosure covers all program products. Program products include all forms of products for providing programs. For example, program products include programs provided via networks such as the Internet, and non-temporary computer-readable storage media such as CD-ROMs, DVDs, and USB memory sticks on which programs are stored.

[0230] The imaging control process described above is merely an example. Therefore, it goes without saying that you may remove unnecessary steps, add new steps, or change the processing order, as long as it does not deviate from the main purpose.

[0231] The descriptions and illustrations presented above are detailed explanations of the parts related to this disclosure and are merely examples of this disclosure. For example, the above explanation of the structure, function, operation, and effect is an example of the structure, function, operation, and effect of the parts related to this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace parts of the descriptions and illustrations presented above, as long as you do not deviate from the spirit of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the parts related to this disclosure, explanations of common technical knowledge, etc., that do not require special explanation to enable the implementation of this disclosure have been omitted from the descriptions and illustrations presented above.

[0232] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

Claims

1. A processing device comprising a processor, wherein the processor acquires post-imaging processing information relating to post-imaging processing, which is image processing performed after imaging on an image obtained by imaging by an imaging device, and executes a first imaging condition processing, which is processing according to a first imaging condition determined based on the post-imaging processing information.

2. The processing apparatus according to claim 1, wherein the post-imaging processing is performed outside the imaging device.

3. The processing apparatus according to claim 1, wherein the first imaging condition includes a setting relating to the imaging apparatus when the imaging is performed.

4. The processing apparatus according to claim 1, wherein the first imaging condition processing includes a first imaging process that causes the imaging device to perform imaging under the first imaging conditions.

5. The processing apparatus according to claim 4, wherein, when the first imaging process is performed, the processor outputs information indicating that the post-imaging processing is incomplete, and / or information indicating that the post-imaging processing is scheduled.

6. The processing apparatus according to claim 5, wherein the information on incomplete post-processing and / or the planned information includes the post-processing information and / or information based on the post-processing information.

7. The processing apparatus according to claim 4, wherein the first image obtained by performing the first imaging process is displayed on the first screen.

8. The apparatus according to claim 1, wherein the first imaging condition processing includes a first perception processing, which is a process for making information relating to the first imaging condition perceptible.

9. The processing apparatus according to claim 1, wherein the first imaging condition processing includes a first perception processing which is a processing which makes information relating to the first imaging conditions perceptible, and a first imaging processing which causes the imaging device to perform imaging under the first imaging conditions, and in response to the execution of the first perception processing, the first imaging processing is performed based on a given imaging start instruction.

10. The processing apparatus according to claim 1, wherein the first imaging condition is determined based on the second imaging condition, and the second imaging condition is determined based on standard imaging information relating to a standard imaging process performed by the imaging device.

11. The processing apparatus according to claim 1, wherein the processor selectively performs the first imaging condition processing and the second imaging condition processing, which is processing according to the second imaging condition determined based on standard imaging information relating to the standard imaging processing performed by the imaging device.

12. The processing apparatus according to claim 1, wherein the processor performs a second perception process, which is a process that makes information relating to the first imaging conditions and information relating to the second imaging conditions determined based on standard imaging information relating to standard imaging processing performed by the imaging device, pertain to the execution of the second perception process, and selectively performs the first imaging condition processing and the second imaging condition processing, which is a process corresponding to the second imaging conditions.

13. The processing apparatus according to claim 1, wherein the processor acquires presence or absence information regarding whether or not the post-imaging processing is performed, and selectively performs the first imaging condition processing and the second imaging condition processing, which is processing according to the second imaging condition determined based on standard imaging information relating to the standard imaging processing performed by the imaging device, based on the presence or absence information.

14. The processing apparatus according to claim 10, wherein the processor executes a second imaging condition processing, which is processing according to a second imaging condition determined based on standard imaging information relating to a standard imaging process performed by the imaging device, the second imaging condition processing includes a second imaging process that causes the imaging device to perform imaging under the second imaging condition, and the second image obtained by executing the second imaging process is displayed on a second screen.

15. The apparatus according to claim 10, wherein the first imaging condition processing includes a first imaging process that causes the imaging device to perform imaging under the first imaging conditions, the processor performs a second imaging condition processing which is processing according to second imaging conditions determined based on standard imaging information relating to a standard imaging process performed by the imaging device, the second imaging condition processing includes a second imaging process that causes the imaging device to perform imaging under the second imaging conditions, and the first imaging process and the second imaging process are performed in succession.

16. The processing apparatus according to claim 14, wherein the first imaging condition processing includes a first imaging process that causes the imaging device to perform imaging under the first imaging conditions, and the first image obtained by the execution of the first imaging process and the second image obtained by the execution of the second imaging process are displayed on a third screen in a manner that allows for comparison.

17. The processing apparatus according to claim 10, wherein the second imaging condition includes a setting relating to the imaging apparatus when the imaging is performed.

18. The processing apparatus according to claim 1, wherein the first imaging conditions are determined based on a given finish requirement, and the finish requirement is a requirement relating to the finish of the captured image.

19. The processing apparatus according to claim 18, wherein, upon input of the finish request, the first imaging conditions are determined based on a trained model that outputs the first imaging conditions corresponding to the input finish request.

20. The processing apparatus according to claim 19, wherein the trained model outputs the first imaging conditions corresponding to the input finishing request and the post-imaging processing information when the finishing request and the post-imaging processing information are input.

21. The processing apparatus according to claim 1, wherein the processor outputs the post-imaging processing information.

22. The processing apparatus according to claim 1, wherein the first imaging condition processing includes a first imaging process that causes the imaging device to perform imaging under the first imaging conditions, and the post-imaging processing information is stored in association with the first image obtained by performing the first imaging process.

23. An imaging apparatus comprising: a processing device according to any one of claims 1 to 22; and an imaging system, wherein the first imaging condition processing includes a first imaging process that causes the imaging system to perform imaging under the first imaging conditions.

24. A processing method comprising: acquiring post-imaging processing information relating to post-imaging processing, which is image processing performed after imaging on an image captured by an imaging device; and executing a first imaging condition processing, which is processing according to a first imaging condition determined based on the post-imaging processing information.

25. A program for causing a computer to perform a process that includes acquiring post-imaging processing information relating to post-imaging processing, which is image processing performed after imaging on an image captured by an imaging device, and executing a first imaging condition processing, which is processing according to a first imaging condition determined based on the post-imaging processing information.

Images