Image processing device, control method for image processing device, program

Abstract

When switching image adjustment environments (modes), the system aims to provide users with a more accurate understanding of the image processing currently being applied to the image. [Solution] The image processing apparatus includes a mode setting means for setting an adjustment mode to one of a plurality of image adjustment modes, an image processing means for applying image processing to an image based on the adjustment mode, and a display control means for displaying history information of the image processing applied to the image on a display means. When the adjustment mode is switched, the image processing means changes at least one of the adjustment parameters of the image processing applied to the image. When the adjustment mode is switched, the display control means displays the information of the image processing whose adjustment parameters have been changed due to the adjustment mode switch in the history information in a manner that distinguishes it from the information of the image processing whose adjustment parameters have not been changed due to the adjustment mode switch.

Description

Technical Field

[0005]

[0001] The present invention relates to an image processing apparatus that controls the display of an image processing history, a control method for the image processing apparatus, and a program.

Background Art

[0002] Environments capable of adjusting and displaying high dynamic range (hereinafter referred to as "HDR") images are becoming widespread. Along with this, systems that can perform image adjustment and display suitable for the HDR color gamut in an HDR environment have emerged. On the other hand, since the display environment in the conventional standard dynamic range (hereinafter referred to as "SDR") is still being used, image adjustment and display suitable for the SDR environment are still required. For this reason, systems that can switch between and execute image adjustment (display) suitable for the SDR environment and image adjustment (display) suitable for the HDR environment have also emerged.

[0003] In Patent Document 1, when adjustment parameters (parameters that are appropriate in each environment and are different) for images with different characteristics are adjusted in an SDR environment and an HDR environment, the information processing apparatus detects that readjustment of the adjustment parameters is necessary. Then, the information processing apparatus notifies the user that readjustment of the adjustment parameters is necessary.

[0004] Patent Document 2 describes a history display method in which a user can distinguish between the adjustment content being applied to an image and the adjustment content not being applied for each editing item in the adjustment history.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

[0006] If adjustment parameters have been adjusted to produce images with different characteristics in SDR and HDR environments, these adjustment parameters will not be reflected when the display environment is switched afterward. Even using the technologies described in Patent Documents 1 and 2, when switching between SDR and HDR environments, adjustment parameters that produce images with different characteristics in SDR and HDR environments will not be reflected in the image. Therefore, even if a user checks the history items after switching environments, they cannot properly understand the image processing applied to the image.

[0007] Therefore, the present invention aims to enable users to better understand the image processing being applied to an image when switching image adjustment environments (modes). [Means for solving the problem]

[0008] One aspect of the present invention is, An image processing device that operates according to a set adjustment mode, A mode setting means for setting one of several image adjustment modes as the adjustment mode, Image processing means that applies image processing to an image based on the adjustment mode set by the mode setting means, A display control means that displays the history information of the image processing applied to the image by the image processing means on a display means, It has, When the adjustment mode is switched, the image processing means changes the adjustment parameters of at least one of the image processing operations applied to the image. When the adjustment mode is switched, the display control means displays the image processing information in the history information in a manner that distinguishes it from the image processing information in which the adjustment parameters have been changed by the adjustment mode switch, and from the image processing information in which the adjustment parameters have not been changed by the adjustment mode switch. This is an image processing apparatus characterized by the following features. [Effects of the Invention]

[0009] According to the present invention, when switching the image adjustment environment (mode), the user can be given a more appropriate understanding of the image processing being applied to the image. [Brief explanation of the drawing]

[0010] [Figure 1] This is a hardware configuration diagram of an image processing device. [Figure 2] This is a functional configuration diagram of an image processing device. [Figure 3] This diagram illustrates the GUI for switching between adjustment modes. [Figure 4] This diagram illustrates the flow of image adjustment processing. [Figure 5] This figure shows an example of the edit history screen. [Figure 6] This is a flowchart for image editing processing. [Figure 7] This diagram illustrates the process of displaying the editing history. [Modes for carrying out the invention]

[0011] Embodiments of the present invention will be described below with reference to the drawings.

[0012] The image processing device according to this embodiment acquires, for example, a recording file of a RAW image captured by a digital camera. The image processing device then develops the RAW image in the recording file (converts it into an image format that can be visually recognized by humans). Furthermore, the image processing device can switch between and perform "image adjustment suitable for an SDR environment" and "image adjustment suitable for an HDR environment" during the development process.

[0013] Whether to perform image adjustment suitable for the SDR environment or image adjustment suitable for the HDR environment can be switched, for example, by a user's selection. Note that the SDR environment is an environment in which image adjustment or display is performed in SDR (Standard Dynamic Range). The HDR environment is an environment in which image adjustment or display is performed in HDR (High Dynamic Range) with a wider dynamic range than SDR.

[0014] Note that in this embodiment, as adjustment modes that can be set in the image processing apparatus, an SDR adjustment mode and an HDR adjustment mode are given, but it is not limited thereto. Modes with different image characteristics such as "color gamut" such as sRGB and AdobeRGB, and "gamma" such as LOG gamma may be treated as one adjustment mode. For example, modes with different characteristics such as HLG and PQ in HDR may be treated as different adjustment modes.

[0015] Here, in this embodiment, the image processing performed by the image processing apparatus will be described separately as "image processing from development processing to gamma processing (γ processing)" and further "image processing performed on the image after the image processing".

[0016] "Image processing from development processing to gamma processing (γ processing)" includes image adjustments such as white balance processing, digital gain processing, noise reduction processing, correction processing according to lens characteristics, and correction processing according to a preset shooting mode. Also, in γ processing, in particular As the gamma characteristic (γ characteristic) suitable for the SDR environment, for example, a γ of 1 / 2.2 is used. As the γ characteristic suitable for the HDR environment, for example, a γ of the PQ (Perceptual Quantization) method is used. That is, in the image processing apparatus of this embodiment, when image adjustment suitable for the SDR environment is performed, a γ characteristic of 1 / 2.2 is particularly applied, and when image adjustment suitable for the HDR environment is performed, a γ characteristic of the PQ method is particularly applied.

[0017] Image processing after gamma processing includes, for example, at least one image adjustment such as RGB tone curve adjustment, 8-axis color adjustment, partial adjustment within the image, copy stamp processing to copy and paste areas within the image, cropping, rotation, and scaling. In addition, in the image processing apparatus of this embodiment, it is also possible to use adjustment parameters arbitrarily specified by the user or a separately prepared set of adjustment parameters when performing image adjustments.

[0018] In the following explanation, the image processing from the development process to the gamma processing described above will be referred to as the "first image adjustment." Furthermore, any image adjustments performed after the first image adjustment will be referred to as the "second image adjustment." In addition, in this embodiment, the adjustment parameters used in the first image adjustment will be referred to as the "first adjustment parameters," and the adjustment parameters used in the second image adjustment will be referred to as the "second adjustment parameters."

[0019] The first adjustment parameter includes the settings for "white balance processing, digital gain processing, noise reduction processing, lens characteristic correction processing, preset shooting modes, or gamma processing, etc."

[0020] The second adjustment parameter includes the settings for each of the following: "RGB tone curve adjustment, 8-axis color adjustment, partial adjustment, copy stamp processing, cropping processing, rotation processing, or scaling processing as described above."

[0021] (Hardware configuration of the image processing device) Figure 1 is a hardware configuration diagram of the image processing device 100 according to this embodiment. The image processing device 100 includes a control unit 101, a ROM 102, a RAM 103, an operation unit 104, a display unit 105, an external storage medium 106, and a communication unit 107.

[0022] The control unit 101 is a processing unit (CPU) that controls the entire image processing device 100. The control unit 101 also controls the image editing process (image processing) and the process of managing the history of the editing process (history management process).

[0023] ROM102 is a hard disk drive or SSD (Solid State Drive), among other things. ROM102 stores digital data, such as image editing execution programs and encoded image signals, in a readable format.

[0024] The RAM103 is loaded with program code and digital data recorded in the ROM102.

[0025] The operation unit 104 includes a keyboard, mouse, or touch control unit. When input from the operation unit 104 is detected by the control unit 101, processing is performed according to the program loaded into the RAM 103.

[0026] The display unit 105 is a CRT (Cathode Ray Tube) display or a liquid crystal panel, etc. The display unit 105 displays various information. In this embodiment, the operation unit 104 and the display unit 105 are integrated as a touch panel.

[0027] The external storage medium 106 is capable of storing images and image editing results generated by applying editing processes to the images.

[0028] The communication unit 107 is an interface for connecting to a network line such as the Internet, or an interface for communicating with an external device. The communication unit 107 receives the image to be edited.

[0029] The control unit 101 reads an image editing application program (hereinafter referred to as the "image adjustment app") stored in the ROM 102 or external storage medium 106 and executes this image adjustment app. This enables the function and processing of the image processing device 100.

[0030] Furthermore, the image processing device 100 may be implemented by a single computer device. Alternatively, the image processing device 100 may be implemented by distributing the execution of each function of the image processing device 100 among multiple computer devices as needed. When the image processing device 100 is composed of multiple computer devices, the multiple computer devices are connected to each other via communication such as a Local Area Network (LAN) to send and receive various data and commands.

[0031] (Functional configuration of image processing equipment) Figure 2 shows a diagram illustrating the functional configuration of the image processing device 100. The image processing device 100 includes a reception unit 201, a development processing unit 202, a detection unit 203, a history management unit 204, and a display processing unit 205.

[0032] The reception unit 201 receives various instructions in response to user operations. Through the reception unit 201, the user can give instructions such as "switching adjustment modes," "setting the first adjustment parameters used for the first image adjustment," and "setting the second adjustment parameters used for the second image adjustment." Instructions from the user are sent to the development processing unit 202 (control unit 101). As a result, the development processing unit 202 controls the operation of the image processing device 100 according to the image adjustment mode selected by the user, and also sets each adjustment parameter.

[0033] The "adjustment mode switching instruction" is an instruction to select either the image adjustment mode suitable for an SDR environment (hereinafter referred to as "SDR image adjustment mode") or the image adjustment mode suitable for an HDR environment (hereinafter referred to as "HDR image adjustment mode"). Details on switching adjustment modes in response to user operations will be described later.

[0034] Furthermore, the "Instruction to Set the First Adjustment Parameter" allows for the input or selection of setting values ​​for various parameters such as white balance processing, digital gain processing, noise reduction processing, lens characteristic correction processing, shooting mode, and gamma processing.

[0035] In the "Second Adjustment Parameter Setting Instructions," you can input or select setting values ​​for various processes such as RGB tone curve adjustment, 8-axis color adjustment, partial adjustment, copy stamp processing, trimming, rotation, and scaling.

[0036] The development processing unit 202 operates as an "image processing unit" that performs development processing on the original image (RAW image in Embodiment 1). The development processing unit 202 also operates as a "mode setting unit" that sets the image adjustment mode selected by the user as the adjustment mode of the image processing device 100. The development processing unit 202 has a first adjustment unit 221 and a second adjustment unit 222.

[0037] The first adjustment unit 221 is a processing unit that performs a first image adjustment according to the adjustment mode of the image processing device 100 (the image adjustment mode selected by the user). Specifically, if the HDR image adjustment mode is selected, the first adjustment unit 221 performs a first image adjustment suitable for an HDR environment. If the SDR image adjustment mode is selected, the first adjustment unit 221 performs a first image adjustment suitable for an SDR environment.

[0038] The second adjustment unit 222 is a processing unit that performs a second image adjustment on the image after the first image adjustment by the first adjustment unit 221.

[0039] The detection unit 203 determines (detects) whether or not readjustment of the adjustment parameters used for image adjustment is necessary. In this embodiment, the detection unit 203 specifically determines whether or not readjustment of the second adjustment parameter applied in the second image adjustment is necessary.

[0040] The history management unit 204 manages the values ​​(adjustment parameters) of editing processes such as exposure or white balance in the adjustment of a series of development processes, as well as the order in which the editing processes were performed, as history information. The history management unit 204 stores the history information in a predetermined recording area of ​​the external storage medium 106. In addition, the history management unit 204 also records the order in which editing processes such as rotation and cropping were performed on the RAW image, as well as the angles and coordinates related to rotation and cropping, as history information.

[0041] The display processing unit 205 is a processing unit (display control unit) that controls the display of history information managed by the history management unit 204, and the GUI for selecting the image adjustment mode. The display processing unit 205 converts the image after the second image adjustment by the second adjustment unit 222 into an image for display. The display processing unit 205 displays the image for display on the display unit 105.

[0042] Figure 3 shows an example of a graphical user interface (GUI) for the image processing device 100, where the user switches between adjustment modes of the image processing device 100. Figure 3 shows an example of the GUI 300 when one of two modes, SDR image adjustment mode or HDR image adjustment mode, is selected by an option button (radio button). The GUI 300 is displayed on the display unit 105.

[0043] As shown in Figure 3, the GUI 300 for selecting the image adjustment mode is provided with option buttons 301 and 302. Option button 301 is for selecting the SDR image adjustment mode. Option button 302 is for selecting the HDR image adjustment mode.

[0044] The user can select an adjustment mode by operating the reception unit 201 and selecting either option button 301 or option button 302. For example, if option button 301 is selected, the first adjustment unit 221 performs image adjustment with adjustment parameters suitable for an SDR environment. On the other hand, if option button 302 is selected, the first adjustment unit 221 performs image adjustment with adjustment parameters suitable for an HDR environment.

[0045] Figure 4 illustrates the flow of image adjustment processing according to the selected adjustment mode.

[0046] First, the RAW image 400 (recording file) of the original image stored in the ROM 102 or external storage medium 106 is input to the first adjustment unit 221. Then, if the selected image adjustment mode is the SDR image adjustment mode, the first adjustment unit 221 performs a first image adjustment 401 suitable for the SDR environment on the RAW image 400. In the first image adjustment 401, after development processing, etc., gamma processing suitable for SDR display (for example, gamma processing using a gamma characteristic of 1 / 2.2) is performed. It will take place.

[0047] On the other hand, if the selected image adjustment mode is the HDR image adjustment mode, the first adjustment unit 221 performs a first image adjustment 402 suitable for the HDR environment on the RAW image. In the first image adjustment 402, after development processing, etc., gamma processing suitable for HDR display (for example, gamma processing using the gamma characteristics of the PQ method) is performed.

[0048] Then, the second adjustment unit 222 performs a second image adjustment 403, such as RGB tone curve adjustment, on the image data after the first image adjustment (first image adjustment 401 or first image adjustment 402) has been performed by the first adjustment unit 221.

[0049] Figure 5 shows an example of the editing history screen displayed on the display unit 105.

[0050] The editing history area 500 displays multiple history information items 501 showing past edits in chronological order.

[0051] The history information 501 includes a thumbnail image 502 of the edited image and the editing details 503. The editing details 503 include an editing item 504 indicating what kind of editing process (image processing) was performed, and an adjustment value 505 indicating the amount of adjustment (adjustment parameter) for that editing process. In other words, in the editing history area 500, the editing item 504 and adjustment value 505 for each editing process are displayed in correspondence.

[0052] Furthermore, each time editing is performed by the development processing unit 202, history information 501 indicating the newly performed editing (image processing) is added to the editing history area 500. The series of history information 501 is then linked to the RAW image being edited and stored as a single group on the external storage medium 106. Therefore, each time new editing is performed on the RAW image, the newly performed editing and the corresponding history information 501 are added to the series of history information and stored. It is also possible to link and store multiple groups for a single RAW image.

[0053] Here, as described above, the image processing device 100 can switch between SDR image adjustment mode and HDR image adjustment mode. The image processing device 100 also allows the user to set adjustment parameters as they wish. As described above, if adjustment parameters (such as gamma characteristics, brightness adjustment, and color gamut) that result in images with different characteristics in SDR and HDR environments are adjusted, then when the adjustment mode is switched, the adjustments (image processing; editing) will be removed from the image. In such cases, the editing items displayed in the editing history will include "editing content currently applied to the image being processed" (hereinafter referred to as "applied content") and "editing content that has changed to be removed when the adjustment mode is switched" (hereinafter referred to as "unapplied content").

[0054] Therefore, the image processing device 100 of this embodiment displays the applied and non-applied edits to an image in a way that allows the user to identify (distinguish) them. Specifically, in the editing history display, the image processing device 100 displays the history information 501 of applied edits in the normal way, while also highlighting the "history information 501 of non-applied edits" and the "history information 501 indicating that the adjustment mode has been switched."

[0055] In this embodiment, highlighting is achieved by assigning a specific icon image (display item) to the history information 501. Note that the icon image assigned to the history information 501 indicating inapplicable content is different from the icon image assigned to the history information 501 indicating that the adjustment mode has been switched.

[0056] The highlighted display does not need to be limited to any display format that allows the user to distinguish it from the normal display. The normal display and the highlighted display may be displayed in different colors. In addition, the text colors of the editing items 504 and adjustment values ​​505 included in the history information 501 may be different for the normal display and the highlighted display.

[0057] The image editing process performed by the image processing device 100 will be explained with reference to the flowchart in Figure 6. The process performed in this flowchart is realized by the control unit 101 controlling the configuration shown in Figure 2 according to the operating system (OS) and the image editing application program. When the image editing application is started, the control unit 101 controls the display unit 105 to display the editing history area 500 (image editing screen). In the editing history area 500 at startup, the image editing result is displayed, in which development processing has been performed on the RAW image to be edited with default adjustment values.

[0058] In step S601, the reception unit 201 determines whether or not it has received an editing instruction. For example, when an image is edited by a user, the reception unit 201 receives an editing instruction. If it is determined that an editing instruction has been received, the process proceeds to step S602. If it is determined that an editing instruction has not been received, the process proceeds to step S615.

[0059] In step S602, the receiving unit 201 determines whether the received editing instruction is an instruction to switch adjustment modes (mode change instruction). If it is determined that the received editing instruction is a mode change instruction, the process proceeds to step S603. If it is determined that the received editing instruction is another editing instruction (an editing instruction other than a mode change instruction), the process proceeds to step S604.

[0060] In step S603, the display processing unit 205 explicitly notifies the user that "edited content will not be reflected and will be reset when switching adjustment modes." The display processing unit 205 displays, for example, a text message or icon indicating that the edited content will be reset. Alternatively, the display processing unit 205 displays text messages or icons representing the specific edited content that will be reset.

[0061] Step S604 includes steps S605 to S608.

[0062] In step S605, the development processing unit 202 performs editing on the image to be processed according to the editing instructions. The history management unit 204 then associates (links) the "history information including the editing content related to the editing process" with the "edited image" and stores it in the external storage medium 106. Here, the editing content includes "editing items related to the editing process" and "setting values ​​(adjustment values) corresponding to the editing items," as shown in Figure 5. Note that the image associated with the history information may be the image before editing.

[0063] In step S606, the development processing unit 202 generates a thumbnail image from the edited image. The history management unit 204 then associates the thumbnail image (reduced image) with the editing content stored in step S605, adds the history information indicating the editing content to a series of history information groups, and stores it on the external storage medium 106. The thumbnail image generated in step S606 only needs to be an image with a smaller data size than the edited image.

[0064] In step S607, the display processing unit 205 controls the display unit 105 to display the image after editing.

[0065] In step S608, the display processing unit 205 displays the editing history, which associates the edited content with the thumbnail image, in the editing history area 500.

[0066] In step S609, the reception unit 201 receives a response from the user regarding the notification displayed in step S603. The reception unit 201 then determines whether the user's response is an agreement to the notification (i.e., whether a specific instruction has been received from the user). If it is determined that the user's response is an agreement to the notification, the process proceeds to step S610. On the other hand, if it is determined that the user's response is not an agreement to the notification, the process proceeds to step S615 without switching the adjustment mode.

[0067] In step S610, the development processing unit 202 removes the association between the editing items that are reset by switching adjustment modes and the image performed in step S605. The development processing unit 202 also removes the effect of the image adjustments related to those editing items from the current image (returns it to its pre-adjustment state). In other words, the development processing unit 202 changes the adjustment parameters of the image processing so that the application of that image processing to the image is removed (reset). For example, the editing items that are reset by switching adjustment modes are image processing items related to gamma or color gamut.

[0068] Here, we will explain the editing items whose application is reset in step S610. As mentioned above, images that have undergone image adjustments suitable for an SDR environment and images that have undergone image adjustments suitable for an HDR environment have significantly different characteristics. For this reason, for example, if you use the same adjustment parameters when switching adjustment modes, or set adjustment parameters arbitrarily specified by the user, the resulting image may have characteristics different from those expected in the image adjustment. This is especially likely to occur in the second image adjustment after the first image adjustment has been made to suit an SDR or HDR environment.

[0069] Therefore, in this embodiment, for example, the detection unit 203 detects whether or not a reset is necessary for the second adjustment parameter used in the second image adjustment. In other words, the detection unit 203 determines whether or not applying the second adjustment parameter used in the second image adjustment results in an image with characteristics different from those expected by the user.

[0070] The detection unit 203 then determines that the second adjustment parameter is one that results in images with different characteristics in SDR display and HDR display, and detects that a reset of the second adjustment parameter is necessary. In this case, the development processing unit 202 performs the reset process. On the other hand, the detection unit 203 determines that the second adjustment parameter used in the second image adjustment is one that does not result in images with different characteristics in SDR display and HDR display, and detects that a reset of the second adjustment parameter is not necessary. In this case, the development processing unit 202 does not perform the reset process for the second adjustment parameter.

[0071] In this embodiment, in step S603, the display processing unit 205 notifies the user of a reset simply by determining that the adjustment mode has been switched, regardless of whether the editing item contains any editing content that needs to be reset. However, the display processing unit 205 may also determine whether the editing item contains any editing content that needs to be reset, and notify the user of a reset only if the editing item contains any editing content that needs to be reset.

[0072] Step S611 involves the same processing as step S604. Therefore, in step S611, steps S605 to S608 are performed according to the mode conversion instruction. For example, in step S605, the development processing unit 202 performs a process (mode change process) to switch the adjustment mode of the image processing device 100 in response to a mode change instruction.

[0073] The subsequent steps S612 to S614 are processes to update the display content of the edit history area 500.

[0074] In step S612, the display processing unit 205 highlights the newly added history information 501 in the editing history area 500, which indicates a switch in the adjustment mode (mode change process). This allows the user to identify at what point in the editing history the reset edited content occurred.

[0075] Next, steps S613 and S614 are processes to highlight the reset edited content so that it can be identified. Steps S613 and S614 are repeated for the number of "history information 501 managed by the history management unit 204 and displayed in the edit history area 500".

[0076] In step S613, the history management unit 204 selects one history information 501 displayed in the editing history area 500 as the target for processing. The history management unit 204 then determines whether the edited content to be processed is edited content (inapplicable content) that has been reset by switching the adjustment mode. If it is determined that the edited content to be processed is inapplicable content, the process proceeds to step S614. If it is determined that the edited content to be processed is not inapplicable content, the process in step S613 is performed for the next history information 501.

[0077] In step S614, the display processing unit 205 highlights the edited content to be processed in the edit history area 500. In this embodiment, the highlighting is done by adding an icon image to the history information 501. The display processing unit 205 distinguishes and displays the icon image to be added to the history information 501 that has been reset due to the switching of the adjustment mode and the icon image to be added to the history information 501 that has been switched using different icons.

[0078] In step S615, the reception unit 201 determines whether or not it has received an instruction to terminate the image editing process. If it is determined that an instruction to terminate has been received, the process in this flowchart (image editing process) is terminated. If it is determined that an instruction to terminate has not been received, the process proceeds to step S601.

[0079] Next, we will specifically explain the process of displaying the editing history with reference to Figures 7A to 7C. In the following, we will assume that the image being processed has undergone various editing processes as shown in Figure 7A in response to user operations, and that the user is instructed to switch (change) the adjustment mode.

[0080] In this case, in step S603 described above, the display processing unit 205 explicitly notifies the user that "editing content that will be reset when the image adjustment mode is switched (= unapplied content)" will occur. For example, as shown in Figure 7B, an icon 701 is displayed in the history information 501 of the gamma adjustment, which is unapplied content. A text message (not shown) indicating that the editing content will be reset may also be displayed.

[0081] Figure 7C shows the edit history area 500 after it is determined in step S609 that the user has consented to the notification and the processes in steps S610 to S614 have been executed. The process in step S612 adds an icon 702 to the adjustment mode history information 501, indicating the timing of a reset in the adjustment mode history information 501. Furthermore, the process in step S614 adds an icon 703 to the gamma adjustment history information 501, indicating the reset edit history information 501. The display of icon 703 allows the user to identify that the gamma adjustment has been reset at the time of switching adjustment modes.

[0082] In this embodiment, icons 702 and 703 are always displayed, but this is not limited to this, and the user may be able to select whether or not to display them. Alternatively, icon 703 may be displayed only when the history information 501 with icon 702, which indicates the timing of a reset, is selected, and the history information 501 of the adjustments that were reset at that time is displayed.

[0083] As described above, according to this embodiment, even if adjustment parameters have been adjusted to produce images with different characteristics in the SDR environment and the HDR environment, it becomes possible to identify which editing items are currently applied in the history display when switching between the SDR and HDR environments.

[0084] In the above, when switching adjustment modes causes an editing process (image processing) that completely removes its application to the image (i.e., the adjustment parameters of the editing process are changed to 0), the information of that editing process is highlighted in the editing history area. However, the processing of this embodiment is applicable not only when switching adjustment modes causes an editing process (image processing) that completely removes its application to the image, but also when the adjustment parameters of the editing process are changed. In this case, when switching adjustment modes changes the adjustment parameters of at least some of the editing processes applied to the image, the information of those editing processes is highlighted. In this case, the display processing unit 205 may also display information about the amount of change in the changed adjustment parameters in the editing history area. Here, for example, when switching adjustment modes changes the color gamut or gamma adjustment parameters of the editing processes applied to the image,

[0085] Furthermore, in the above, "If A is greater than or equal to B, proceed to step S1; if A is less than (lower than) B, proceed to step S2" may be rephrased as "If A is greater than (higher than) B, proceed to step S1; if A is less than or equal to B, proceed to step S2." Conversely, "If A is greater than (higher than) B, proceed to step S1; if A is less than or equal to B, proceed to step S2" may be rephrased as "If A is greater than or equal to B, proceed to step S1; if A is less than (lower than) B, proceed to step S2." Therefore, as long as no contradiction arises, "greater than or equal to A" may be rephrased as "greater than (higher; longer; more) than A," and "less than or equal to A" may be rephrased as "less than (lower; shorter; fewer) than A." And "greater than (higher; longer; more) than A" may be rephrased as "greater than or equal to A," and "less than (lower; shorter; fewer) than A" may be rephrased as "less than or equal to A."

[0086] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). Multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0087] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices). Examples include BLE Logic Device.

[0088] Furthermore, although embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0089] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0090] The above-disclosed embodiments include the following configurations, methods, and programs. (Composition 1) An image processing device that operates according to a set adjustment mode, A mode setting means for setting one of several image adjustment modes as the adjustment mode, Image processing means that applies image processing to an image based on the adjustment mode set by the mode setting means, A display control means that displays the history information of the image processing applied to the image by the image processing means on a display means, It has, When the adjustment mode is switched, the image processing means changes the adjustment parameters of at least one of the image processing operations applied to the image. When the adjustment mode is switched, the display control means displays the image processing information in the history information in a manner that distinguishes it from the image processing information in which the adjustment parameters have been changed by the adjustment mode switch, and from the image processing information in which the adjustment parameters have not been changed by the adjustment mode switch. An image processing apparatus characterized by the following: (Configuration 2) When the adjustment mode is switched, the image processing means modifies the adjustment parameters of at least one of the image processing methods applied to the image so that the application of at least one of the image processing methods applied to the image is canceled. The image processing apparatus according to configuration 1, characterized in that... (Composition 3) The mode setting means switches the adjustment mode in response to a mode change instruction from the user. The system further includes notification means for notifying that a change occurs in the adjustment parameters of at least one of the image processing applied to the image, before the adjustment mode is switched in response to the instruction to change the mode. An image processing apparatus according to configuration 1 or 2, characterized by the above. (Composition 4) Even if the user gives an instruction to change the mode, the mode setting means will not switch the adjustment mode if the user does not give a specific instruction in response to the notification from the notification means. The image processing apparatus according to configuration 3, characterized in that (Composition 5) When the adjustment mode is switched, the image processing means changes the color gamut or gamma adjustment parameter among the image processing applied to the image. An image processing apparatus according to any one of configurations 1 to 4, characterized by the above. (Composition 6) When the adjustment mode is switched, the display control means will The image processing information indicating that the adjustment mode has been switched is displayed by a first highlighting. The image processing information, in which the adjustment parameters have been changed by switching the adjustment mode, is displayed by a second highlighting that is different from the first highlighting. An image processing apparatus according to any one of configurations 1 to 5, characterized by the above. (Composition 7) The aforementioned multiple image adjustment modes include an image adjustment mode compatible with SDR (Standard Dynamic Range) and an image adjustment mode compatible with HDR (High Dynamic Range). An image processing apparatus according to any one of configurations 1 to 6, characterized by the above. (method) A method for controlling an image processing device that operates according to a set adjustment mode, A mode setting step in which one of several image adjustment modes is set as the adjustment mode, An image processing step in which image processing is applied to an image based on the adjustment mode set in the mode setting step, A display control step in which the image processing history information applied to the image in the image processing step is displayed on a display means, It has, In the image processing step, when the adjustment mode is switched, the adjustment parameters of at least one of the image processing steps applied to the image are changed. In the display control step, when the adjustment mode is switched, the information of the image processing in which the adjustment parameters have been changed due to the switching of the adjustment mode is displayed in the history information in a manner that distinguishes it from the information of the image processing in which the adjustment parameters have not been changed due to the switching of the adjustment mode. A control method for an image processing apparatus, characterized by the features described above. (program) A program for causing a computer to function as one of the means of an image processing apparatus described in any of configurations 1 to 7. [Explanation of Symbols]

[0091] 100: Image processing device, 202: Development processing device, 205: Display Processing Unit

Claims

1. An image processing device that operates according to a set adjustment mode, A mode setting means for setting one of several image adjustment modes as the adjustment mode, Image processing means that applies image processing to an image based on the adjustment mode set by the mode setting means, A display control means that displays the history information of the image processing applied to the image by the image processing means on a display means, It has, When the adjustment mode is switched, the image processing means changes the adjustment parameters of at least one of the image processing operations applied to the image. When the adjustment mode is switched, the display control means displays the image processing information in the history information in a manner that distinguishes it from the image processing information in which the adjustment parameters have been changed by the adjustment mode switch, and from the image processing information in which the adjustment parameters have not been changed by the adjustment mode switch. An image processing apparatus characterized by the following:

2. When the adjustment mode is switched, the image processing means modifies the adjustment parameters of at least one of the image processing methods applied to the image so that the application of at least one of the image processing methods applied to the image is canceled. The image processing apparatus according to feature 1.

3. The mode setting means switches the adjustment mode in response to a mode change instruction from the user. The system further includes notification means for notifying that a change occurs in the adjustment parameters of at least one of the image processing applied to the image, before the adjustment mode is switched in response to the instruction to change the mode. The image processing apparatus according to feature 1.

4. Even if the user gives an instruction to change the mode, the mode setting means will not switch the adjustment mode if the user does not give a specific instruction in response to the notification from the notification means. The image processing apparatus according to claim 3.

5. When the adjustment mode is switched, the image processing means changes the color gamut or gamma adjustment parameter among the image processing applied to the image. The image processing apparatus according to feature 1.

6. When the adjustment mode is switched, the display control means will The image processing information indicating that the adjustment mode has been switched is displayed by a first highlighting. The image processing information, in which the adjustment parameters have been changed by switching the adjustment mode, is displayed by a second highlighting that is different from the first highlighting. The image processing apparatus according to feature 1.

7. The aforementioned multiple image adjustment modes include an image adjustment mode compatible with SDR (Standard Dynamic Range) and an image adjustment mode compatible with HDR (High Dynamic Range). The image processing apparatus according to feature 1.

8. A method for controlling an image processing device that operates according to a set adjustment mode, A mode setting step in which one of several image adjustment modes is set as the adjustment mode, An image processing step in which image processing is applied to an image based on the adjustment mode set in the mode setting step, A display control step in which the image processing history information applied to the image in the image processing step is displayed on a display means, It has, In the image processing step, when the adjustment mode is switched, the adjustment parameters of at least one of the image processing steps applied to the image are changed. In the display control step, when the adjustment mode is switched, the information of the image processing in which the adjustment parameters have been changed due to the switching of the adjustment mode is displayed in the history information in a manner that distinguishes it from the information of the image processing in which the adjustment parameters have not been changed due to the switching of the adjustment mode. A control method for an image processing apparatus, characterized by the features described above.

9. A program for causing a computer to function as one of the means of an image processing apparatus according to any one of claims 1 to 7.

Images