Imaging apparatus
The imaging device enables easy application of multiple color conversion data with adjustable densities, allowing users to customize image processing and achieve desired color tones and qualities through user-friendly interfaces and real-time preview capabilities.
Patent Information
- Application Number
- JP2023207663
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-08
- Publication Date
- 2024-11-21
AI Technical Summary
Existing imaging devices lack the ability to easily apply color conversion data according to user preferences, making it difficult for users to achieve desired color tones in their images.
The imaging device includes an imaging unit, storage for multiple color conversion data, an output unit for live view screens, an operation unit for user interaction, and a control unit to specify and apply multiple color conversion data with adjustable densities, allowing users to easily customize image processing.
Users can apply multiple color conversion data with adjustable densities, easily achieving desired color tones and image qualities according to their preferences, with the ability to preview and adjust settings in real-time.
Smart Images

Figure 2024162981000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an imaging device. [Background technology]
[0002] The imaging device disclosed in Patent Document 1 includes an acquisition means for acquiring a first lookup table (LUT) for converting image data, a setting means for setting a degree of application of the first LUT, and a generating means for generating a second LUT from the first LUT based on the set degree of application. The imaging device disclosed in Patent Document 1 converts image data obtained by the imaging means using the second LUT generated by the generating means. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2023-121532 A Summary of the Invention [Problem to be solved by the invention]
[0004] The present disclosure provides an imaging device that can easily apply color transformation data to an image according to a user's preferences. [Means for solving the problem]
[0005] An imaging device according to one aspect of the present disclosure includes: an imaging unit that captures an image of a subject and generates image data; a storage unit that stores a plurality of color conversion data that respectively define correspondence relationships before and after conversion of color information in an image; an output unit that outputs a live view screen based on image data; an operation unit that accepts user operations; a control unit that designates the first color conversion data and the second color conversion data from the plurality of color conversion data in response to a user operation; The live view screen displays a live view image in which image processing has been performed on image data by applying the first color conversion data and the second color conversion data. Effect of the Invention
[0006] According to the imaging device according to the present disclosure, it is possible to easily apply color transformation data to an image in accordance with the user's preferences. [Brief description of the drawings]
[0007] [Figure 1] FIG. 1 is a block diagram showing an example of the arrangement of a digital camera according to a first embodiment. [Diagram 2] Photo Style and LUT Explained [Diagram 3] FIG. 1 is a diagram showing an example of a data structure stored in a flash memory of a digital camera. [Figure 4] A flowchart for explaining an example of a method for setting image processing setting information in a digital camera. [Diagram 5] FIG. 1 is a diagram showing an example of a setting menu screen of a digital camera. [Figure 6] FIG. 13 is a diagram showing an example of an LUT setting screen in a digital camera. [Figure 7A] FIG. 13 is a diagram showing an example of a LUT overlay setting screen in a digital camera. [Figure 7B] FIG. 13 is a diagram showing an example of a LUT selection screen in a digital camera. [Figure 7C] FIG. 13 is a diagram showing an example of a LUT overlay setting screen in a digital camera. [Figure 7D] FIG. 13 is a diagram showing an example of a LUT overlay setting screen in a digital camera. [Figure 7E] FIG. 13 is a diagram showing an example of a LUT overlay setting screen in a digital camera. [Figure 7F] FIG. 13 is a diagram showing an example of a LUT overlay setting screen in a digital camera. [Figure 7G] FIG. 13 is a diagram showing an example of a LUT overlay setting screen in a digital camera. [Figure 8]FIG. 1 is a diagram showing an example of a preview screen of a digital camera. [Figure 9] A flowchart for explaining an example of a display operation of a live view image in a digital camera. [Figure 10] FIG. 13 is a diagram showing a modified example of a preview screen in a digital camera. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] Hereinafter, the embodiments will be described with reference to the drawings as appropriate. However, the description may be omitted in more detail than necessary. Note that the accompanying drawings and the following description are provided to enable a person skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.
[0009] (Embodiment 1) 1. Configuration 1-1.Hardware configuration 1 is a block diagram showing an example of the configuration of a digital camera 100 according to a first embodiment of the present disclosure. The digital camera 100 captures an image of a subject and generates image data. The image data generated by the digital camera 100 includes moving image data and still image data.
[0010] Digital camera 100 captures an image of a subject formed via optical system 110 with image sensor 115 to generate original image data (RAW data). Image processing unit 120 generates image data by performing various processes on the RAW data generated by image sensor 115. Controller 135 records the image data generated by image processing unit 120 in flash memory 145 or memory card 142 inserted in card slot 141. Controller 135 can also display (play) the image data recorded in flash memory 145 or memory card 142 on display 130 in accordance with a user's operation of operation unit 150.
[0011] The optical system 110 includes a focus lens, a zoom lens, an optical image stabilization lens (OIS), an aperture, a shutter, etc. The various lenses included in the optical system 110 may be configured with any number of lenses or any number of groups.
[0012] The image sensor 115 captures an image of a subject formed via the optical system 110 to generate RAW data. The image sensor 115 generates image data of a new frame at a predetermined frame rate (e.g., 30 frames / second). The timing of generating RAW data and the electronic shutter operation in the image sensor 115 are controlled by the controller 135. Note that the image sensor 115 may be one of various image sensors, such as a CMOS image sensor, a CCD image sensor, or an NMOS image sensor. The image sensor 115 is an example of an imaging unit in this embodiment.
[0013] The image processing unit 120 performs various processes on the RAW data output from the image sensor 115 to generate image data. The image processing unit 120 also performs various processes on the image data read from the memory card 142 to generate an image to be displayed on the display 130. Such an image may be output to an external monitor 160 via a video output terminal 155. Examples of various processes include, but are not limited to, white balance correction, gamma correction, YC conversion processing, electronic zoom processing, compression processing, decompression processing, image processing using a look-up table (LUT), and the like. The image processing unit 120 may be configured with a hardwired electronic circuit, or may be configured with a microcomputer using a program, etc.
[0014] Display 130 is a display device capable of displaying information, such as a liquid crystal display, an organic EL display, etc. For example, display 130 displays an image based on image data processed by image processing unit 120. Display 130 also displays a menu screen that allows the user to check the settings of digital camera 100.
[0015] The external monitor 160 is a display device such as a liquid crystal display or an organic EL display, and can display an image based on the image data processed by the image processing unit 120. The video output terminal 155 includes an interface circuit that enables connection between the digital camera 100 and an external device such as the monitor 160. The video output terminal 155 performs communication in accordance with standards such as USB (Universal Serial Bus), HDMI (registered trademark), and Bluetooth (registered trademark).
[0016] The controller 135 centrally controls the operation of the entire digital camera 100. The controller 135 may include a processor configured to execute a program to realize a predetermined function. For example, the controller 135 can be realized by various processors such as a CPU, an MPU, a GPU, a DSU, an FPGA, an ASIC, etc. The controller 135 may be configured by one or more processors. The controller 135 may also be configured by one semiconductor chip together with the image processing unit 120, etc. Although not shown, the controller 135 has a built-in ROM. The ROM stores various programs such as autofocus control (AF control) executed by the controller 135. The controller 135 also has a built-in RAM (not shown) that functions as a work area for the CPU.
[0017] The buffer memory 125 is a recording medium that functions as a work memory for the image processing unit 120 and the controller 135. The buffer memory 125 is realized by a dynamic random access memory (DRAM) or the like.
[0018] A memory card 142 is removably inserted into the card slot 141. The card slot 141 can electrically and mechanically connect the memory card 142. The memory card 142 is an external memory equipped with a recording element such as a flash memory inside. The memory card 142 can store data such as the LUT and image data generated by the image processing unit 120.
[0019] The communication module 143 performs data communication according to an existing wired communication standard or wireless communication standard. For example, the digital camera 100 can communicate with a communication network such as the Internet and / or other devices equipped with a Wi-Fi module via the communication module 143. The digital camera 100 may communicate with other devices directly via the communication module 143, or may communicate with other devices via an access point. The card slot 141 and the communication module 143 are an example of an output unit in the present disclosure that outputs data.
[0020] The flash memory 145 is a non-volatile recording medium and can store various data such as an LUT, photo style setting information 10, LUT setting information 11, image processing setting information 12, and image data, which will be described later.
[0021] Operation unit 150 is a general term for user interfaces such as hard keys and software keys of digital camera 100, and accepts operations by a user. Operation unit 150 includes, for example, buttons, a mode dial, a touch panel, and switches. When operation unit 150 accepts an operation by a user, it transmits an operation signal corresponding to the user operation to controller 135.
[0022] The operation unit 150 includes various buttons such as an information display switching (DISPLAY) button, a menu / setting (MENU / SET) button, a back button, a decision button, a cursor button, and a Q button described later. The cursor buttons include push-type buttons corresponding to the top, bottom, left, and right, respectively, and when pressed by the user, can move a selection area, a cursor, etc. displayed on the display 130. Operations using these various buttons may be configured to be executable not only by physical buttons, but also by a touch panel.
[0023] 1-2. Photo Style and LUT The digital camera 100 has a number of pre-prepared shooting modes so that the user can easily shoot images with the color tone and image quality of their choice. Hereinafter, these shooting modes are referred to as "photo styles." Furthermore, the digital camera 100 of this embodiment is capable of applying, for example, a LUT for color grading imported from an external source according to the user's preference to each photo style.
[0024] 1-2-1. Photo Style When a certain photo style is selected in the digital camera 100, various parameters are set so that an image having the effect indicated by that photo style is generated. Specifically, for each photo style, the values of each parameter such as contrast, highlight, shadow, saturation, color tone, hue, filter effect, graininess, sharpness, noise reduction, and density are set so that the effect indicated by that photo style is obtained. In this way, each photo style is configured as an image adjustment parameter set that adjusts an image indicated by the RAW data.
[0025] As shown in Fig. 2, the digital camera 100 is provided with photo styles such as "Standard", "Vivid", "Natural", "Flat", "Monochrome", and "Log". "Standard" is the standard setting, and "Vivid" is a mode that produces a vivid effect with high saturation and contrast. "Natural" is a mode that produces a soft effect with low contrast. "Monochrome" is a mode that produces a monochromatic effect without any hue.
[0026] "Log" is a mode that takes images using a logarithmic gamma curve (hereinafter referred to as "Log image") to make full use of the dynamic range of the image sensor, and is also called Log gamma. "Flat" is a mode that uses a flat gamma curve instead of Log gamma, and produces an effect that is less exaggerated than other photo styles.
[0027] 1-2-2.LUT The LUT is stored in, for example, an external server so as to be downloadable. The LUT is downloaded from the server by the information processing device and stored in advance in the flash memory 145 of the digital camera 100.
[0028] The LUT is an array (parameter set) that specifies the correspondence before and after converting the color information for each pixel in the input image. The LUT is, for example, a three-dimensional lookup table that indicates the relationship between input and output color data consisting of a combination of three colors of RGB. The image processing unit 120 performs image processing to convert the colors of the input image data into the colors of the output image data by referring to the LUT.
[0029] In the digital camera 100, for example, as shown in FIG. 2, names such as "vintage," "rose," and "fashion" can be set for the LUT depending on the color tone, theme, and creator's intention of the output image data.
[0030] When a user attempts to create an original LUT, the effect of color correction is easier to understand if the user attempts color correction from a standard color tone that is closer to the color perceived by humans when viewing a subject with the naked eye, rather than from a Log image with low saturation and contrast. Therefore, by allowing the use of original LUTs in digital camera 100, the user can easily create and use an LUT that suits their preferences.
[0031] 1-2-3.Selecting the photo style to which the LUT will be applied LUTs currently available are generally created with the assumption that they will be applied to Log images. A user can obtain an LUT for Log images for example free of charge on the Internet or purchase it from a seller such as an image processing expert, and import it into the digital camera 100.
[0032] In order to avoid being trapped by the fixed idea that a LUT that can be applied to image data must be for a Log image, the digital camera 100 of this embodiment provides the user with the option to combine an LUT with a preferred photo style, as shown in FIG. 2.
[0033] For example, the user can create an LUT on the premise of a desired photo style from among "Standard", "Vivid", "Natural", "Flat", "Monochrome", etc., and store it in the flash memory 145 via the memory card 142, etc. In this way, for example, an LUT for a standard image can be applied to an image having an effect indicated by the photo style "Standard", instead of an LUT for a Log image.
[0034] 1-2-4.Selecting multiple LUTs to be applied to image data and setting the density of each LUT Furthermore, the digital camera 100 of this embodiment provides the user with the option of applying (superimposing) multiple LUTs to image data.
[0035] Being able to overlap multiple LUTs is advantageous in the following respects, for example. That is, LUTs currently available are generally created assuming application to Log images, but since Log images have low saturation and contrast, it may be difficult for users to imagine the effect of color conversion when an LUT is applied to a Log image. Therefore, a user can easily perform the desired color conversion by applying a first LUT to a Log image to generate an intermediate image with colors close to those perceived by humans when viewing a subject with the naked eye, and then applying a second LUT to the generated intermediate image.
[0036] Alternatively, or in addition, a user may have fun combining any number of LUTs to see what the image will look like, for example, a user may combine multiple LUTs to create an image that has unintended positive effects.
[0037] Alternatively, or in addition, a user can easily perform color conversion according to the user's preferences by overlapping an LUT for increasing saturation with an LUT that can emphasize a specific color, for example, red.
[0038] Furthermore, in the digital camera 100 according to this embodiment, when multiple LUTs are applied to image data, the user can set the density of each LUT. The digital camera 100 can display a setting screen for density setting on the display 130 so that the user can easily set the density of each of the multiple LUTs.
[0039] In this embodiment, the density of the LUT is an index representing the degree of application of the LUT to image data, and is expressed as a value between 0 and 1 (0% to 100%), for example. Applying an LUT with a density set to 0% to input image data is substantially the same as not applying the LUT to the input image data.
[0040] 1-2-5. Data Structure 3 is a diagram showing an example of a data structure stored in the flash memory 145 of the digital camera 100 according to this embodiment. In the flash memory 145, setting information regarding the photo style and the LUT is managed as photo style setting information 10 and LUT setting information 11, respectively.
[0041] 3, the photo style setting information 10 includes setting information on one or more (n) photo styles, and the LUT setting information 11 includes setting information on two or more (m) LUTs.
[0042] 3, the flash memory 145 further stores image processing setting information 12. The image processing setting information 12 includes photo style selection information 13 indicating a photo style selected by the user, and LUT selection information 14 indicating a plurality of LUTs selected by the user and the density of each LUT. The photo style indicated by the photo style selection information 13 and the plurality of LUTs indicated by the LUT selection information 14 are sequentially applied to the RAW data output from the image sensor 115, and image data resulting from the application is displayed on the display 130.
[0043] 2. Operation 2-1. Photo style and LUT setting operations 2-1-1. Operation flow Digital camera 100 is configured so that the user can easily set and select the above-mentioned photo style and LUT, that is, set image processing setting information 12, using display 130 and operation unit 150. An example of a method for setting image processing setting information 12 in digital camera 100 will be described with reference to Figures 4 to 7.
[0044] 4 is a flowchart for explaining an example of a method for setting the image processing setting information 12 in the digital camera 100 according to this embodiment. Each process shown in the flowchart in FIG.
[0045] The user can set the photo style selection information 13 by selecting a photo style using the operation unit 150. The controller 135 acquires the photo style selection information 13 set by a user operation (S1).
[0046] A user can set the LUT selection information 14 by selecting multiple LUTs using the operation unit 150 and adjusting the density of each LUT. The controller 135 acquires, as the LUT selection information 14, the multiple LUTs selected by the user operation and the density of each LUT specified by the user operation (S2).
[0047] Next, the controller 135 associates the photo style selection information 13 and the LUT selection information 14 and registers them in the flash memory 145 as image processing setting information 12 (S3). The image processing setting information 12 may be stored in a storage device of an external information processing device via the memory card 142 or via the communication module 143 together with image data before application of the LUT, such as RAW data.
[0048] The image processing setting information 12 is used for post-processing such as post-editing and post-production in which an LUT is applied to image data to which no LUT has been applied using such an information processing device. In general, when an LUT is applied to image data using an information processing device external to a digital camera, the photographer needs to record the LUT applied at the time of shooting in order to reproduce the image after the LUT application that the photographer saw at the time of shooting in the information processing device. Also, when a digital camera capable of setting the density of the LUT, such as the digital camera 100 according to this embodiment, is used for shooting, the photographer needs to record the density of the LUT applied at the time of shooting in order to reproduce the image after the LUT application in the information processing device.
[0049] The digital camera 100 according to this embodiment can reduce the photographer's effort in recording as described above by storing image processing setting information 12 in flash memory 145 or in a storage device of an external information processing device together with image data before application of the LUT, such as RAW data.
[0050] 2-1-2. Menu settings for multiple LUTs and the density of each LUT In this embodiment, the digital camera 100 can apply multiple LUTs to a captured image in real time that is displayed on the display 130. Menu settings for multiple LUTs and the density of each LUT in the digital camera 100 will be described with reference to Figures 5 to 8. Figures 5 to 8 show an example of a display screen that is displayed in a series of steps on the display 130 of the digital camera 100 in the process shown in Figure 4.
[0051] Fig. 5 shows an example of a setting menu screen in the digital camera 100. The digital camera 100 displays various setting items such as "photo style" on the display 130, and accepts user operations by the operation unit 150 for setting the various setting items. For example, when the user selects the setting item "photo style" on the setting menu screen in Fig. 5, the controller 135 transitions the display screen to a photo style and LUT setting screen (hereinafter, sometimes simply referred to as "LUT setting screen") shown in Fig. 6.
[0052] 6 shows a live view image 20 for live view. Live view is a function for displaying images captured by digital camera 100 as real-time moving images or the like. The user can visually check the effect of the LUT, etc., on the live view image 20.
[0053] 6 displays a menu display 21, a photo style display 22, a LUT mode display 23, a parameter display 24, a superimposition button 25, etc. In the LUT setting screen of this embodiment, a LUT for which an application mode described below is set to ON is applied to a live view image 20.
[0054] The menu display 21 displays text or a figure to inform the user that the current display screen is a setting screen for photo style and LUT. In the example of Fig. 6, the menu display 21 displays "real-time LUT." "Real-time LUT" is an image processing mode that can provide the user with a mode for applying an LUT to image data (LUT application mode).
[0055] The photo style display 22 displays text, figures, symbols, etc., indicating the photo style applied to the captured image. In Fig. 6, an icon indicating the photo style "Log" is displayed in the photo style display 22. The user can select the photo style display 22 by pressing the cursor button, and then change the photo style applied in the "real-time LUT" by pressing, for example, the left or right cursor button.
[0056] Alternatively, when the user presses the left / right cursor button on the LUT setting screen in Fig. 6, the controller 135 may transition the display screen from the LUT setting screen to a photo style selection screen. On the photo style selection screen, the menu display 21 displays text or figures corresponding to the photo styles that are selection candidates. For example, on the photo style selection screen, the menu display 21 displays text indicating the photo styles that are selection candidates, such as "Standard" and "Vivid". The user can change the photo style that is the selection candidate by pressing the left / right cursor button, and the photo style to be applied is determined by pressing the determination button.
[0057] 6 displays a comprehensive LUT mode display 23 indicating whether the LUT application mode is currently ON or OFF. When at least one LUT application mode is set to ON in the overlay setting screens of FIGS. 7A to 7F described below, the controller 135 displays the text "ON" in the LUT mode display 23. When two or more LUT application modes are set to ON in the overlay setting screens described below, the controller 135 displays a symbol such as an asterisk "*" to the right of the text "ON" displayed in the LUT mode display 23.
[0058] The parameter display 24 includes, for example, the values of various parameters of the photo style described above. For example, the user can input an operation to change the values of parameters such as contrast, highlight, shadow, saturation, graininess, sharpness, noise reduction, and density by selecting a desired adjustable parameter and pressing the left or right cursor button. The user can adjust the value of each parameter even when the photo style is "Log" in addition to "Standard", "Vivid", "Natural", "Flat", or "Monochrome". The changed parameters are reflected in the image displayed on the display screen in real time, so the user can change the parameters while checking the effect. In response to such user operations, the controller 135 acquires parameter change information indicating the parameters changed by the user operation.
[0059] When the user presses the overlay button 25 on the LUT setting screen in Fig. 6, the controller 135 transitions the display screen to a LUT overlay setting screen exemplified in Fig. 7A. The function of the overlay button 25 is assigned to, for example, the Q button of the operation unit 150. In this case, the user can also transition the display screen to the overlay setting screen by pressing the Q button on the LUT setting screen.
[0060] The overlay setting screen in Fig. 7A displays individual LUT mode displays indicating whether the application mode of each of the multiple LUTs is ON or OFF. In the example of Fig. 7A, LUT mode displays 31a, 31b, 31c, and 31d for four LUTs, LUT1 to 4, are displayed. For example, in the initial state, as shown in Fig. 7A, LUT1 is ON and the other LUTs 2 to 4 are OFF.
[0061] A user can select a LUT mode display corresponding to a desired LUT by pressing a cursor button. In the example of Fig. 7A, the first LUT mode display 31a is selected. The dashed line shown on the first LUT mode display 31a in Fig. 7A indicates that the first LUT mode display 31a is selected.
[0062] When the first LUT mode display 31a is selected, as shown in FIG. 7A, a LUT switching menu 33 for switching the application mode of the LUT1 corresponding to the selected first LUT mode display 31a between ON and OFF is displayed. The LUT switching menu 33 displays a LUT file name ("VLog_709" in FIG. 7A) that specifies the LUT corresponding to the selected LUT mode display, and a status display indicating whether the LUT is currently ON or OFF. "VLog_709" is an example of an LUT for a Log image that returns the color of a Log image with low saturation and contrast to a standard color close to the color that a person feels when viewing a subject with the naked eye. In the initial state, for example, LUT1 is set to the LUT "VLog_709". In the example of FIG. 7A, the user can switch between ON and OFF of the LUT "VLog_709" set to LUT1 by, for example, pressing the left and right cursor buttons.
[0063] The overlay setting screen in FIG. 7A displays a LUT selection button 34. When the user presses the LUT selection button 34, the controller 135 transitions the display screen to a LUT selection screen shown in FIG. 7B. The LUT selection screen in FIG. 7B displays a LUT selection menu 35. In the example of FIG. 7B, the user can select a LUT corresponding to the first LUT mode display 31a by, for example, pressing the left or right cursor button. When the user presses the enter button or the return button on the LUT selection screen shown in FIG. 7B, the controller 135 transitions the display screen to a overlay setting screen shown in FIG. 7A.
[0064] Furthermore, the overlay setting screen in Fig. 7A displays density displays 32a, 32b, 32c, and 32d that indicate the respective densities of the multiple LUTs. The user can select the density display corresponding to the desired LUT by pressing the cursor button. For example, in the initial state, the density of LUT1 is set to 100%, as shown in density display 32a in Fig. 7A. Also, in the initial state illustrated in Fig. 7A, density displays 32b, 32c, and 32d that respectively correspond to LUTs 2 to 4 that are OFF display "100%," and are grayed out to indicate that the LUTs are OFF.
[0065] Fig. 7C shows an example in which the second LUT mode display 31b is selected on the overlay setting screen. In the initial state, LUTs 2 to 4 other than LUT 1 are set to OFF as described above, and for example, no LUT file is assigned to LUTs 2 to 4 that are OFF. The LUT switching menu 33 in Fig. 7C displays "No LUT" to indicate that no LUT file is assigned to LUT 2.
[0066] When the user presses the LUT selection button 34 on the overlay setting screen of FIG. 7C, the controller 135 transitions the display screen to a LUT selection screen similar to that of FIG. 7B. On the LUT selection screen, the user can select a LUT file to be assigned to LUT2. When the user selects a LUT file to be assigned to LUT2 and presses the decision button, the controller 135 transitions the display screen to a overlay setting screen shown in FIG. 7D. When a LUT file to be assigned to LUT2 is selected, the second LUT mode display 31b and the LUT status display of the LUT switching menu 33 in FIG. 7D are automatically changed to "ON", and the grayed-out density display 32b is released. FIG. 7D shows an example in which "LUT_RD" is assigned to LUT2. "LUT_RD" is an example of a LUT that emphasizes red.
[0067] In the same way as the setting of LUT2 described with reference to Figures 7C and 7D, the user can set the LUTs to be assigned to LUT3 and LUT4. Figure 7E shows an example in which "LUT_BL" is assigned to LUT3. "LUT_BL" is an example of a LUT that emphasizes blue. Figure 7F shows an example in which "LUT_GR" is assigned to LUT4. "LUT_GR" is an example of a LUT that emphasizes green.
[0068] 7F shows an example in which LUTs 1 to 4 are all set to ON, but in the digital camera 100 according to this embodiment, it is not necessary that all settable LUTs are set to ON. For example, one or more of LUTs 1 to 4 may be set to ON. LUT 1, which is ON in the initial state, may be changed to OFF. Also, all LUTs may be set to OFF.
[0069] As shown in Fig. 7G, when any one of the density displays 32a, 32b, 32c, and 32d is selected, a density adjustment menu 36 is displayed on the overlay setting screen. In the example of Fig. 7G, the density display 32d is selected, and a slide bar for adjusting the density is displayed on the density adjustment menu 36. The user can adjust the density of the LUT4 by, for example, pressing the left or right cursor button.
[0070] The user can also adjust the densities of LUT1 to 3 corresponding to the first to third LUT mode displays 31a, 31b, and 31c in a similar manner.
[0071] When the user presses the enter button or the return button on the overlay setting screen of FIG. 7A or FIGS. 7C to 7G, the controller 135 transitions the display screen to the LUT setting screen of FIG.
[0072] 2-1-3.Preview screen of density changes for multiple LUTs Even if the density of each of the multiple LUTs can be changed, in a configuration in which the density of each LUT is changed serially, the user cannot grasp in detail the color tone, image quality, etc. of the image after applying the LUTs when the densities of the multiple LUTs are changed simultaneously, during the density change setting. Therefore, it is difficult to achieve the user's preferred color tone, image quality, etc. by changing the densities of the multiple LUTs, or even if it can be achieved, it may take time to change the density. For example, if the user changes the density of LUT2 after changing the density of LUT1, and the result of the density change is different from what was intended, the user may have to readjust the density of LUT1.
[0073] The digital camera 100 according to this embodiment provides a preview screen on which the results of density changes to a plurality of LUTs can be confirmed before the density changes are finalized.
[0074] A concentration check button 37 is displayed on the overlay setting screen of Fig. 7G. When the user presses the concentration check button 37, the controller 135 transitions the display screen to a preview screen exemplified in Fig. 8(A). The function of the concentration check button 37 is assigned to, for example, the Q button of the operation unit 150. In this case, the user can also transition the display screen to the preview screen by pressing the Q button on the overlay setting screen of Fig. 7G.
[0075] In the preview screen of Fig. 8(A), nine images are arranged in a 3 x 3 matrix. In the illustrated example, image 43 arranged in the center of the matrix shows an image to which multiple LUTs have been applied at the currently set density. Eight images arranged around the central image show preview images that show the application results of multiple LUTs when the density of at least one of the LUT corresponding to the horizontal axis (hereinafter referred to as "horizontal axis LUT") and the LUT corresponding to the vertical axis (hereinafter referred to as "vertical axis LUT") is changed. The preview image is generated by, for example, image processing unit 120.
[0076] In the example of FIG. 8(A), the horizontal axis LUT can be selected by the user using the horizontal axis selection button 41. For example, when the user selects "1" of the horizontal axis selection button 41 using a cursor button, a touch panel, or the like, the controller 135 sets LUT1 as the horizontal axis LUT. In the example of FIG. 8(A), LUT1 is selected as the horizontal axis LUT, and to indicate this, "1" of the horizontal axis selection button 41 is highlighted on the preview screen. Similarly, the vertical axis LUT can be selected by the user using the vertical axis selection button 42, and in the example of FIG. 8(A), LUT2 is selected as the vertical axis LUT. For example, the buttons of the horizontal axis selection button 41 and the vertical axis selection button 42 corresponding to the LUT set to OFF on the overlay setting screen may be displayed grayed out.
[0077] A density display 44 showing the density of the horizontal axis LUT and vertical axis LUT corresponding to image 43 is superimposed on image 43. The text above density display 44 shows the density of the horizontal axis LUT, and the text below shows the density of the vertical axis LUT. In the example of Fig. 8(A), the density of LUT1, which is the horizontal axis LUT corresponding to image 43, is 50%, and the density of LUT2, which is the vertical axis LUT, is 50%.
[0078] Similar density indications are superimposed on the eight preview images arranged around image 43. Fig. 8(A) shows an example in which, in nine images arranged in a matrix, the density of the horizontal axis LUT increases toward the right (positive direction of the horizontal axis) and the density of the vertical axis LUT increases toward the bottom (positive direction of the vertical axis). In the example of Fig. 8(A), the difference in horizontal axis LUT density between adjacent images in the left-right direction is 10%, and the difference in vertical axis LUT density between adjacent images in the top-bottom direction is 10%, but the density difference is not limited to 10%.
[0079] When one of the preview images is selected in Fig. 8(A), the preview screen changes to the screen shown in Fig. 8(B). Fig. 8(A) shows an example in which the preview image located in the upper right has been selected, and the selected preview image is highlighted by being surrounded by a frame. The preview image selected in Fig. 8(A) is placed in the center of the nine images arranged in a matrix in Fig. 8(B). In this way, digital camera 100 can display preview images in a density range that is not displayed on the preview screen of Fig. 8(A) on the preview screen of Fig. 8(B).
[0080] By accepting a user operation to change at least one of the horizontal axis selection button 41 and the vertical axis selection button 42, the digital camera 100 can also display preview images of the density change results of other LUTs (LUT3 and LUT4 in the example of FIG. 8).
[0081] When the enter button or the back button is pressed on the preview screen of FIG. 8(A) or FIG. 8(B), the controller 135 transitions the display screen to the overlapping setting screen of FIG. 7G.
[0082] By checking the preview image displayed on display 130 of digital camera 100 in the manner described above, the user can learn the density settings of multiple LUTs that will achieve the user's preferred color tone, image quality, etc. Therefore, the user can set the density settings of multiple LUTs on the overlay setting screen in Fig. 7G so as to achieve the user's preferred color tone, image quality, etc.
[0083] 2-2. Live View image display operation An example of the operation of displaying a live view image 20 to which the LUT and photo style set as described above have been applied on the display 130 in the digital camera 100 of this embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart for explaining an example of the display operation of the live view image 20 in the digital camera 100.
[0084] 9, first, the controller 135 controls the image sensor 115 based on a user operation received from the operation unit 150, for example, a shutter button (S11). The image sensor 115 captures a subject image formed via the optical system 110 under the control of the controller 135, generates RAW data, and outputs the RAW data to the image processing unit 120.
[0085] Next, under the control of the controller 135, the image processing unit 120 performs image processing to adjust the image indicated by the RAW data based on the photo style selection information 13 registered in step S3 of Fig. 4 (S12). As a result of the image processing, image data to which the photo style has been applied is generated as intermediate data (sometimes referred to as "first processed image data" in this specification).
[0086] Next, under the control of the controller 135, the image processing unit 120 applies the multiple LUTs indicated by the LUT selection information 14 registered in step S3 of Fig. 4 to the first processed image data after reflecting the density of each LUT (S13). As a result of the application, image data to which the multiple LUTs have been applied (sometimes referred to as "second processed image data" in this specification) is generated. For example, the image processing unit 120 converts the color of the first processed image data as input into the color of the output image for each pixel by referring to the multiple LUTs indicated by the LUT selection information 14 and the density of each LUT, thereby generating the second processed image data.
[0087] As an example of applying (superimposing) a plurality of LUTs to the first processed image data, the image processing unit 120 sequentially applies a plurality of LUTs to the first processed image data after reflecting the density of each LUT. Alternatively, the image processing unit 120 may generate a composite LUT by combining a plurality of LUTs indicated by the LUT selection information 14 after reflecting the density of each LUT, and apply the composite LUT to the first processed image data.
[0088] Next, under the control of the controller 135, the image processing unit 120 outputs the second processed image data generated in step S13 to the display 130 as a live view image 20 (S14). The controller 135 may record the second processed image data output from the image processing unit 120 on the memory card 142 via the card slot 141.
[0089] The process of Fig. 9 may be executed in parallel with the process of Fig. 4. For example, when the image processing setting information 12 is changed in step S3 of Fig. 4, the change is reflected in the photo style applied in step S12 of Fig. 9 or the LUT and its density applied in step S13.
[0090] As described above, the digital camera 100 according to this embodiment can output image data to which multiple LUTs have been applied while reflecting the density of each LUT, and can output image data to which the LUTs have been applied in real time.
[0091] 3. Effects etc. As described above, the digital camera 100, which is an example of an imaging device according to the present embodiment, includes the image sensor 115, which is an example of an imaging section, the flash memory 145, which is an example of a storage section, the display 130, which is an example of an output section, the operation section 150, and the controller 135, which is an example of a control section. The image sensor 115 captures an image of a subject to generate image data. The flash memory 145 stores a plurality of LUTs (an example of color conversion data) each of which defines a correspondence relationship before and after converting color information in an image. The display 130 displays a live view screen based on the image data. The operation section 150 accepts a user operation. The controller 135 specifies a first LUT and a second LUT from the plurality of LUTs in response to the user operation. The live view screen displays a live view image in which image processing using the first LUT and the second LUT has been performed on the image data.
[0092] According to the above digital camera 100, the user can apply multiple LUTs to image data, making it easier for the user to apply LUTs to images according to their preferences.
[0093] In the digital camera 100 according to this embodiment, the controller 135 may accept a user operation to specify a first density of the first LUT and a second density of the second LUT. The image processing may include a process of applying the first LUT to the image data according to the first density and a process of applying the second LUT to the image data according to the second density.
[0094] According to the above digital camera 100, the user can apply a plurality of LUTs to image data after reflecting the density of each LUT, and can obtain an image according to the user's taste.
[0095] In the digital camera 100 according to this embodiment, the controller 135 may, in response to a user operation, cause the display 130 to display a live view image and one or more preview images obtained by changing at least one of the first density and the second density in the live view image, side by side.
[0096] According to the above digital camera 100, the user can know the LUT density setting value that realizes the desired color tone, image quality, etc., by checking the preview image displayed on the display 130. Therefore, the digital camera 100 can easily apply the LUT to the image according to the user's taste.
[0097] In the digital camera 100 according to this embodiment, the controller 135 may store in the flash memory 145 the first LUT, the first density, the second LUT, and the second density in association with each other.
[0098] According to the digital camera 100 described above, the data stored in the flash memory 145 can be used for post-processing such as post-editing and post-production in which an LUT is applied to image data to which no LUT has been applied.
[0099] In the digital camera 100 according to this embodiment, the controller 135 may generate a combined LUT by combining the first LUT and the second LUT in accordance with the first density and the second density, respectively.
[0100] According to the above digital camera 100, a user can use a composite LUT that provides an image according to the user's taste in the digital camera 100, an external information processing device, or the like.
[0101] The digital camera 100 according to this embodiment may further include an output unit that outputs data. The controller 135 may output, via the output unit, output image data that has been subjected to image processing that applies the first LUT and the second LUT to the image data.
[0102] According to the above digital camera 100, it is possible to output output image data to which multiple LUTs have been applied. The digital camera 100 can also execute the output of the above-mentioned output image data in real time. Unlike RAW data, the output image data can be easily viewed and used on general-purpose devices such as PCs and smartphones.
[0103] (Other embodiments) As described above, the embodiment has been described as an example of the technology in the present disclosure. However, the technology in the present disclosure is not limited to this, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are appropriately performed. In addition, it is also possible to combine the components described in the above embodiment to create a new embodiment. Therefore, other embodiments are exemplified below.
[0104] In the above embodiment, the step S1 was described in which the user sets the photo style selection information 13 by selecting a photo style using the operation unit 150, and the controller 135 acquires the photo style selection information 13 set by the user operation. In the digital camera 100 of this embodiment, the photo style is not selectable by the user, but may be set in advance as a default photo style and may be set to be unchangeable by the user. Such a default photo style is, for example, "Log", but is not limited to this, and may be set to any photo style.
[0105] In the above embodiment, as shown in FIG. 8, a preview screen showing a so-called relative density distribution in which the density of the LUT corresponding to the image arranged in the center of the matrix is used as a reference and the density of the surrounding eight images is increased or decreased. However, the digital camera 100 of the present embodiment only needs to provide a preview screen that serves as a reference for the user to obtain the setting values of the density of multiple LUTs that realize the desired color tone, image quality, etc. For example, the digital camera 100 may display a preview screen as shown in FIG. 10 on the display 130. In FIG. 10, preview images are arranged at a predetermined density interval with the densities at both ends of the horizontal and vertical axes set to 0% and 100%, respectively. In FIG. 8, the image 43 arranged in the center of the matrix shows an image to which multiple LUTs are applied at the currently set density, whereas FIG. 10 shows a preview screen showing a so-called absolute density distribution regardless of the currently set density.
[0106] In the above embodiment, the digital camera 100 is exemplified in which the user can set the density of each of the multiple LUTs on the overlay setting screen shown in FIG. 7G. However, at least one of the densities of the multiple LUTs may be set by the user using the preview screen exemplified in FIG. 8. For example, when the controller 135 receives an input of a user operation by the operation unit 150 to select one of nine images displayed on the preview screen, the controller 135 determines the density of the LUT to the density corresponding to the selected image. In the example of FIG. 8(A), when the user selects a preview image arranged in the upper right of the preview screen of FIG. 8(A) using a cursor button, a touch panel, or the like, and presses the decision button, the controller 135 sets the density of LUT1 to 60% and the density of LUT2 to 40%. With this configuration, the user can easily change the density of the multiple LUTs after checking the effect of the density change on the preview screen.
[0107] In the above embodiment, an example has been described in which images such as a live view image and a preview image are output to the display 130, which is an example of an output unit, but such images may be output to the external monitor 160 via the video output terminal 155, which is another example of an output unit. As described above, the output unit of the present disclosure includes at least one of the display 130 and the video output terminal 155 that is communicatively connected to the monitor 160.
[0108] In the above embodiment, a digital camera has been described as an example of an imaging device, but the imaging device is not limited to this. The imaging device of the present disclosure may be any electronic device having an image capturing function (e.g., a video camera, a smartphone, a tablet terminal, etc.).
[0109] (Example) The following provides examples of aspects of the present disclosure.
[0110] <Aspect 1> an imaging unit that captures an image of a subject and generates image data; a storage unit that stores a plurality of color conversion data that respectively define correspondences before and after conversion of color information in an image; an output unit that outputs a live view screen based on the image data; an operation unit that accepts user operations; a control unit that designates first color conversion data and second color conversion data from the plurality of color conversion data in response to the user operation; the live view screen displays a live view image in which image processing has been performed on the image data by applying the first color conversion data and the second color conversion data. Imaging device.
[0111] <Aspect 2> the control unit accepts the user operation specifying a first density of the first color conversion data and a second density of the second color conversion data; the image processing includes a process of applying the first color conversion data to the image data in accordance with the first density, and a process of applying the second color conversion data to the image data in accordance with the second density; 2. The imaging device according to embodiment 1.
[0112] <Aspect 3> The imaging device of aspect 2, wherein the control unit, in response to the user operation, causes the output unit to output a screen that displays side by side the live view image and one or more preview images obtained by changing at least one of the first density and the second density in the live view image.
[0113] <Aspect 4> The imaging device according to aspect 2 or 3, wherein the control unit links the first color conversion data, the first density, the second color conversion data, and the second density and stores them in the memory unit.
[0114] <Aspect 5> The imaging device according to any one of aspects 2 to 4, wherein the control unit synthesizes the first color conversion data and the second color conversion data in accordance with the first density and the second density, respectively, to generate synthetic color conversion data.
[0115] <Aspect 6> An output unit that outputs data is further provided, the control unit outputs, via the output unit, output image data in which image processing has been performed on the image data by applying the first color conversion data and the second color conversion data. The imaging device according to any one of aspects 1 to 5.
[0116] <Aspect 7> The imaging device according to any one of aspects 1 to 6, further comprising an image processing unit that performs the image processing on the image data. [Industrial Applicability]
[0117] The present disclosure is applicable to imaging devices. [Explanation of symbols]
[0118] 10 Photo Style Setting Information 11 LUT setting information 12 Image processing settings information 13 Photo style selection information 14 LUT Selection Information 100 Digital Camera 110 Optical system 115 Image Sensor 120 Image Processing Unit 125 Buffer Memory 130 Display 135 Controller 141 Card Slots 142 Memory Card 143 Communication Module 145 Flash Memory 150 Operation section
Claims
1. an imaging unit that captures an image of a subject and generates image data; a storage unit that stores a plurality of color conversion data that respectively define correspondence relationships before and after conversion of color information in an image; an output unit that outputs a live view screen based on the image data; an operation unit that accepts user operations; a control unit that designates first color conversion data and second color conversion data from the plurality of color conversion data in response to the user operation, the live view screen displays a live view image in which image processing has been performed on the image data by applying the first color conversion data and the second color conversion data. Imaging device.
2. the control unit accepts the user operation specifying a first density of the first color conversion data and a second density of the second color conversion data; the image processing includes a process of applying the first color conversion data to the image data in accordance with the first density, and a process of applying the second color conversion data to the image data in accordance with the second density. The imaging device according to claim 1 .
3. 3. The imaging device according to claim 2, wherein the control unit, in response to the user operation, causes the output unit to output a screen that displays side by side the live view image and one or more preview images obtained by changing at least one of the first density and the second density in the live view image.
4. The imaging device according to claim 2 , wherein the control unit causes the first color conversion data, the first density, the second color conversion data, and the second density to be stored in the storage unit in a linked manner.
5. The imaging device according to claim 2 , wherein the control unit generates composite color conversion data by combining the first color conversion data and the second color conversion data in accordance with the first density and the second density, respectively.
6. An output unit that outputs data is further provided, the control unit outputs, via the output unit, output image data in which image processing has been performed on the image data by applying the first color conversion data and the second color conversion data. The imaging device according to claim 1 .
7. The imaging device according to claim 1 , further comprising an image processing unit that performs the image processing on the image data.
Citation Information
Patent Citations
Imaging apparatus, control method for the same, and program
JP2023121532A
