Imaging apparatus and information processing method
By automatically selecting base photo styles based on user-selected LUTs, the imaging device ensures images are processed according to user preferences, addressing the complexity of applying image processing parameters and enhancing user satisfaction.
Patent Information
- Application Number
- JP2023135696
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-08-23
- Publication Date
- 2024-11-20
AI Technical Summary
Existing imaging devices and methods struggle to easily obtain images that align with user preferences due to the complexity of applying image processing parameters such as LUTs, requiring users to manually select and remember base photo styles, which can lead to unintended results.
The imaging device automatically selects a base photo style based on user-selected LUTs, incorporating specification information to ensure that the LUT is applied correctly, thereby simplifying the process and ensuring images are processed according to user preferences.
This approach allows users to easily obtain images with intended effects by automating the selection of base photo styles, reducing the risk of incorrect application and enhancing user satisfaction with the output images.
Smart Images

Figure 2024161870000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an imaging device and an information processing method. [Background technology]
[0002] Patent Document 1 discloses an imaging device including an operation unit that accepts a user operation to specify a combination of one of a plurality of first parameter sets and at least one of a plurality of second parameter sets, and an image processing unit. The image processing unit of Patent Document 1 adjusts an image indicated by original image data using the first parameter set included in the combination specified by the user operation, and converts color information included in the image adjusted by the first parameter set using the second parameter set included in the specified combination to generate image data. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 7129678 Summary of the Invention [Problem to be solved by the invention]
[0004] The present disclosure provides an imaging device and an information processing method that can easily obtain an image that has been subjected to image processing according to a user's preferences. [Means for solving the problem]
[0005] An imaging device according to one aspect of the present disclosure includes: an imaging unit that captures an image of a subject and generates original image data; an image processing unit that performs image processing to impart a predetermined effect to original image data to generate image data; a storage unit that stores a plurality of first parameter sets each defining an effect in image processing, at least one second parameter set defining a correspondence relationship before and after conversion of color information in an image, and designation information that designates one of the plurality of first parameter sets to be combined with each of the at least one second parameter set; The device is equipped with a control unit that, when reading a specific second parameter set from the memory unit, sets a specific first parameter set to be combined with the specific second parameter set to one of a plurality of first parameter sets specified in the specification information.
[0006] An information processing method according to one aspect of the present disclosure is an information processing method performed by a processor, comprising: acquiring image data that is generated by applying a predetermined effect to original image data generated by capturing an image of a subject through image processing, the image data including information indicating a first parameter set that defines the effect; receiving a user operation for converting color information of image data; generating a second parameter set that defines a correspondence relationship before and after conversion of color information of image data by a user operation; generating data including the generated second parameter set and information indicative of the first parameter set.
[0007] An information processing method according to one aspect of the present disclosure is an information processing method performed by a processor, and includes a step of acquiring a second parameter set to be applied to original image data generated by capturing an image of a subject in image processing together with designation information designating a first parameter set that defines a predetermined effect to be imparted by image processing to the original image data, thereby generating data including the second parameter set and the designation information. Effect of the Invention
[0008] According to the imaging device and information processing method according to the present disclosure, it is possible to easily obtain an image that has been subjected to image processing according to the user's preferences. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the arrangement of a digital camera according to a first embodiment. [Diagram 2] Photo Style and LUT Explained [Diagram 3] FIG. 13 is a diagram showing an example of LUT setting information. [Figure 4] FIG. 1 is a diagram showing an example of a data structure stored in a flash memory of a digital camera according to a first embodiment; [Diagram 5] A flowchart for explaining an example of a method for setting a base photo style in the digital camera according to the first embodiment. [Figure 6] FIG. 1 is a schematic diagram showing an example of a photo style and LUT setting screen displayed on a display of a digital camera according to a first embodiment; [Figure 7] FIG. 1 is a schematic diagram showing an example of an LUT selection screen displayed on a display of a digital camera according to a first embodiment; [Figure 8] 4 is a flowchart for explaining an example of a photographing operation in the digital camera according to the first embodiment. [Figure 9] FIG. 11 is a block diagram showing an example of the configuration of an information processing device according to a second embodiment. [Figure 10] 11 is a flowchart for explaining an example of a method for generating LUT setting information including base photostyle information according to a second embodiment. [Figure 11] FIG. 11 is a block diagram showing a configuration example of an information processing device according to a third embodiment. [Figure 12] 11 is a flowchart illustrating an information processing method according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, the embodiments will be described with reference to the drawings as appropriate. However, the description may be omitted in more detail than necessary. Note that the accompanying drawings and the following description are provided to enable a person skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.
[0011] 1. Embodiment 1 1-1.Configuration 1-1-1.Hardware configuration 1 is a block diagram showing an example of the configuration of a digital camera 100 according to a first embodiment of the present disclosure. The digital camera 100 captures an image of a subject and generates image data. The image data generated by the digital camera 100 includes moving image data and still image data.
[0012] Digital camera 100 captures an image of a subject formed via optical system 110 with image sensor 115 to generate original image data (RAW data). Image processing unit 120 generates image data by performing various processes on the RAW data generated by image sensor 115. Controller 135 records the image data generated by image processing unit 120 in flash memory 145 or memory card 142 inserted in card slot 141. Controller 135 can also display (play) the image data recorded in flash memory 145 or memory card 142 on display 130 in accordance with a user's operation of operation unit 150.
[0013] The optical system 110 includes a focus lens, a zoom lens, an optical image stabilization lens (OIS), an aperture, a shutter, etc. The various lenses included in the optical system 110 may be configured with any number of lenses or any number of groups.
[0014] The image sensor 115 captures an image of a subject formed via the optical system 110 to generate RAW data. The image sensor 115 generates image data of a new frame at a predetermined frame rate (e.g., 30 frames / second). The timing of generating RAW data and the electronic shutter operation in the image sensor 115 are controlled by the controller 135. Note that the image sensor 115 may be one of various image sensors, such as a CMOS image sensor, a CCD image sensor, or an NMOS image sensor. The image sensor 115 is an example of an imaging unit in this embodiment.
[0015] The image processing unit 120 performs various processes on the RAW data output from the image sensor 115 to generate image data. The image processing unit 120 also performs various processes on the image data read from the memory card 142 to generate an image to be displayed on the display 130. The various processes include, but are not limited to, white balance correction, gamma correction, YC conversion processing, electronic zoom processing, compression processing, decompression processing, image processing using a look-up table (LUT), and the like. The image processing unit 120 may be configured with a hardwired electronic circuit, or may be configured with a microcomputer using a program, etc.
[0016] Display 130 is a display device capable of displaying information, such as a liquid crystal display, an organic EL display, etc. For example, display 130 displays an image based on image data processed by image processing unit 120. Display 130 also displays a menu screen that allows the user to check the settings of digital camera 100.
[0017] The controller 135 centrally controls the operation of the entire digital camera 100. The controller 135 may include a processor configured to execute a program to realize a predetermined function. For example, the controller 135 can be realized by various processors such as a CPU, an MPU, a GPU, a DSU, an FPGA, an ASIC, etc. The controller 135 may be configured by one or more processors. The controller 135 may also be configured by one semiconductor chip together with the image processing unit 120, etc. Although not shown, the controller 135 has a built-in ROM. The ROM stores various programs such as autofocus control (AF control) executed by the controller 135. The controller 135 also has a built-in RAM (not shown) that functions as a work area for the CPU.
[0018] The buffer memory 125 is a recording medium that functions as a work memory for the image processing unit 120 and the controller 135. The buffer memory 125 is realized by a dynamic random access memory (DRAM) or the like.
[0019] A memory card 142 is removably inserted into the card slot 141. The card slot 141 can electrically and mechanically connect the memory card 142. The memory card 142 is an external memory equipped with a recording element such as a flash memory inside. The memory card 142 can store data such as the LUT and image data generated by the image processing unit 120.
[0020] The communication module 143 performs data communication in accordance with an existing wired communication standard or wireless communication standard. For example, the digital camera 100 can communicate with a communication network such as the Internet and / or other devices equipped with a Wi-Fi module via the communication module 143. The digital camera 100 may communicate with other devices directly via the communication module 143, or may communicate via an access point.
[0021] The flash memory 145 is a non-volatile recording medium and can store various data such as an LUT, photo style setting information 10, LUT setting information 11, image data, etc., which will be described later.
[0022] Operation unit 150 is a general term for user interfaces such as hard keys and software keys of digital camera 100, and accepts operations by a user. Operation unit 150 includes, for example, buttons, a mode dial, a touch panel, and switches. When operation unit 150 accepts an operation by a user, it transmits an operation signal corresponding to the user operation to controller 135.
[0023] The operation unit 150 includes various buttons such as an information display switching (DISPLAY) button, a menu / setting (MENU / SET) button, a back button, a decision button, and a cursor button. The cursor buttons include push-type buttons corresponding to the top, bottom, left, and right, respectively, and when pressed by the user, can move a selection area, a cursor, etc. displayed on the display 130. Operations using these various buttons may be configured to be executable not only by physical buttons, but also by a touch panel.
[0024] 1-1-2. Photo Style and LUT The digital camera 100 has a number of pre-prepared shooting modes so that the user can easily shoot images with the color tone and image quality of their choice. Hereinafter, these shooting modes are referred to as "photo styles." Furthermore, the digital camera 100 of this embodiment is capable of applying, for example, a LUT for color grading imported from an external source according to the user's preference to each photo style.
[0025] 1-1-2-1. Photo Style When a certain photo style is selected in the digital camera 100, various parameters are set so that an image having the effect indicated by that photo style is generated. Specifically, for each photo style, the values of each parameter such as contrast, highlight, shadow, saturation, color tone, hue, filter effect, graininess, sharpness, noise reduction, and density are set so that the effect indicated by that photo style is obtained. In this way, each photo style is configured as an image adjustment parameter set that adjusts an image indicated by the RAW data.
[0026] As shown in Fig. 2, the digital camera 100 is provided with photo styles such as "Standard", "Vivid", "Natural", "Flat", "Monochrome", and "Log". "Standard" is the standard setting, and "Vivid" is a mode that produces a vivid effect with high saturation and contrast. "Natural" is a mode that produces a soft effect with low contrast. "Monochrome" is a mode that produces a monochromatic effect without any hue.
[0027] "Log" is a mode that takes images using a logarithmic gamma curve (hereinafter referred to as "Log image") to make full use of the dynamic range of the image sensor, and is also called Log gamma. "Flat" is a mode that uses a flat gamma curve instead of Log gamma, and produces an effect that is less exaggerated than other photo styles.
[0028] 1-1-2-2.LUT
[0029] The LUT is stored in, for example, an external server so as to be downloadable. The LUT is downloaded from the server by the information processing device and stored in advance in the flash memory 145 of the digital camera 100.
[0030] The LUT is an array (parameter set) that specifies the correspondence before and after converting the color information for each pixel in the input image. The LUT is, for example, a three-dimensional lookup table that indicates the relationship between input and output color data consisting of a combination of three colors of RGB. The image processing unit 120 performs image processing to convert the colors of the input image data into the colors of the output image data by referring to the LUT.
[0031] In the digital camera 100, for example, as shown in FIG. 2, names such as "vintage," "rose," and "fashion" can be set for the LUT depending on the color tone, theme, and creator's intention of the output image data.
[0032] When a user attempts to create an original LUT, the effect of color correction is easier to understand if the user attempts color correction from a standard color tone that is closer to the color perceived by humans when viewing a subject with the naked eye, rather than from a Log image with low saturation and contrast. Therefore, by allowing the use of original LUTs in digital camera 100, the user can easily create and use an LUT that suits their preferences.
[0033] 1-1-2-3.Selecting the photo style to which the LUT will be applied LUTs currently available are generally created with the assumption that they will be applied to Log images. A user can obtain an LUT for Log images for example free of charge on the Internet or purchase it from a seller such as an image processing expert, and import it into the digital camera 100.
[0034] In order to avoid being trapped by the fixed idea that a LUT that can be applied to image data must be for a Log image, the digital camera 100 of this embodiment provides the user with the option to combine an LUT with a preferred photo style, as shown in FIG. 2.
[0035] For example, the user can create an LUT on the premise of a desired photo style from among "Standard", "Vivid", "Natural", "Flat", "Monochrome", etc., and store it in the flash memory 145 via the memory card 142, etc. In this way, for example, an LUT for a standard image can be applied to an image having an effect indicated by the photo style "Standard", instead of an LUT for a Log image.
[0036] In order to apply an intended LUT to an image of intended image quality, the base image to which the LUT is applied must be set to an image having the image quality intended by the user when the LUT is applied. For example, if a user wants to apply an LUT for a standard image to an image having the effect indicated by the photo style "standard", "standard" must be selected in advance as the photo style that is the base for applying the LUT (hereinafter referred to as "base photo style") when the LUT is applied.
[0037] As a means for selecting a base photo style before applying a LUT, it is conceivable that the user manually selects an appropriate base photo style corresponding to the LUT to be applied. However, to realize such a means, the user needs to memorize the base photo style of each LUT and perform a setting operation of the base photo style before applying the LUT. If the user does not memorize the base photo style or neglects to set the base photo style, the image intended by the user may not be obtained.
[0038] The digital camera 100 of this embodiment automatically selects a base photo style according to the LUT selected by the user operation, and applies the selected LUT and the base photo style to the image data. This allows the digital camera 100 to make it easier for the user to obtain an intended image even if the user has not memorized the base photo style or has neglected to set the base photo style.
[0039] In order to enable such a selection of the base photostyle, in this embodiment, the LUT setting information 11, which is an LUT file such as a cube file that describes an LUT, includes designation information that designates the base photostyle. Fig. 3 is a diagram showing an example of the LUT setting information 11. In the LUT setting information 11 of Fig. 3, a tag T is described as an example of designation information that designates the base photostyle. The tag T will be described in detail later.
[0040] 1-1-2-4. Data structure 4 is a diagram showing an example of a data structure stored in the flash memory 145 of the digital camera 100 according to this embodiment. In the flash memory 145, setting information regarding the photo style and the LUT is managed as photo style setting information 10 and LUT setting information 11, respectively.
[0041] 4, the photo style setting information 10 includes setting information on one or more (n pieces) photo styles, and the LUT setting information 11 includes setting information on one or more (m pieces) LUTs.
[0042] 4, the setting information for each LUT in the LUT setting information 11 includes base photostyle information, which is an example of designation information for designating a base photostyle. The base photostyle information is described as a tag T, as exemplified in FIG. 3, in a text file describing the LUT setting information 11.
[0043] "#PHOTOSTYLE STD" shown as tag T in Fig. 3 corresponds to the photo style "standard." When "#PHOTOSTYLE STD" is described as tag T as in Fig. 3 in a text file describing the LUT setting information 11, the base photo style information specifies "standard" as the base photo style.
[0044] As other tags T, for example, "#PHOTOSTYLE VIVD" corresponds to the photo style "vivid", "#PHOTOSTYLE NAT" corresponds to the photo style "natural", "#PHOTOSTYLE FLAT" corresponds to the photo style "flat", and "#PHOTOSTYLE MONO" corresponds to the photo style "monochrome".
[0045] 1-2.Operation 1-2-1. Setting LUT and Base Photo Style In the digital camera 100, the user can easily set and select the LUT as described above using the display 130 and the operation unit 150. In the digital camera 100, the base photo style that is the base of the selected LUT is automatically selected by the controller 135. An example of a method for setting the LUT and the base photo style in the digital camera 100 will be described with reference to Figs. 5 to 7.
[0046] 5 is a flowchart for explaining an example of a method for setting a base photostyle in the digital camera 100 according to this embodiment. Each process shown in the flowchart in FIG.
[0047] A user can set the LUT setting information 11 by selecting a desired LUT using the operation unit 150. The controller 135 acquires the LUT setting information 11 set by a user operation (S1).
[0048] The controller 135 determines whether or not the acquired LUT setting information 11 includes base photostyle information (S2).
[0049] If the LUT setting information 11 includes the base photo style information (Yes in S2), the controller 135 sets the photo style to the photo style corresponding to the base photo style information (S3). For example, as shown in FIG. 3, if the LUT setting information 11 includes "#PHOTOSTYLE STD" as the tag T, the controller 135 sets the photo style to "standard."
[0050] If the LUT setting information 11 does not include the base photo style information (No in S2), the controller 135 sets the photo style to a default photo style (S4). The default photo style is, for example, "Log", but is not limited to this and may be set to any photo style.
[0051] 6 and 7 are schematic diagrams showing examples of display screens that are displayed on the display 130 of the digital camera 100 when the LUT setting information 11 is set in step S1 of FIG.
[0052] Fig. 6 shows an example of a setting screen for photo style and LUT. The setting screen in Fig. 6 displays a photo style selection menu 21 for selecting a photo style, a LUT switching menu 22, a photo style display 23, a parameter display 24, an LUT selection button 25, and the like.
[0053] The photo style selection menu 21 displays text or images corresponding to the photo styles that are selection candidates. For example, the photo style selection menu 21 displays text indicating the photo styles that are selection candidates, such as "Standard" and "Vivid." The user can change the selection candidate photo style by pressing the left or right cursor button, and the photo style to be applied is determined by pressing the determination button.
[0054] In the example of FIG. 6, the photo style selection menu 21 displays "real-time LUT." "Real-time LUT" is a mode in which an LUT can be applied to a photo style (LUT application mode). In the LUT application mode, as shown in FIG. 6, a LUT switching menu 22 for switching the application of the LUT between ON and OFF is displayed. The LUT switching menu 22 displays a LUT file name that specifies the LUT ("LUT1" in FIG. 6) and a status display indicating whether the LUT is currently ON or OFF. The user can switch the LUT between ON and OFF by, for example, pressing the left and right cursor buttons.
[0055] The photo style display 23 displays text or a figure indicating the photo style ("Standard" in FIG. 6) to be applied to the captured image. In this embodiment, when the LUT is applied ("ON" in the LUT switching menu 22), the selection of the base photo style is automatically performed by the controller 135.
[0056] In this case, since the base photo style is automatically selected, the digital camera 100 may not allow the user to change the photo style. In this case, the controller 135 may gray out the photo style display 23 to indicate that the user cannot change the photo style. In Fig. 6, the photo style display 23 is grayed out.
[0057] The parameter display 24 includes, for example, the values of various parameters of the photo style described above. For example, the user can input an operation to change the values of parameters such as contrast, highlight, shadow, saturation, graininess, sharpness, noise reduction, and density by selecting a desired adjustable parameter and pressing the left or right cursor button. The user can adjust the value of each parameter even when the base photo style is "Standard", "Vivid", "Natural", "Flat", "Monochrome", or "Log". The changed parameters are reflected in the image displayed on the display screen in real time, so the user can change the parameters while checking the effect. In response to such user operations, the controller 135 acquires parameter change information indicating the parameters changed by the user operation.
[0058] When the user presses the LUT selection button 25, the controller 135 transitions the display screen to the LUT selection screen shown in FIG.
[0059] 7 displays an LUT selection menu 26. The user can select an LUT by, for example, pressing the left or right cursor button.
[0060] 1-2-2. Shooting operation An example of the operation of capturing an image by applying the LUT and photo style set as described above in the digital camera 100 of this embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart for explaining an example of the capturing operation in the digital camera 100.
[0061] 8, first, the controller 135 controls the image sensor 115 based on a user operation received from the operation unit 150, for example, a shutter button (S11). The image sensor 115 captures a subject image formed via the optical system 110 under the control of the controller 135, generates RAW data, and outputs the RAW data to the image processing unit 120.
[0062] Next, the image processing unit 120 performs image processing to adjust the image indicated by the RAW data using the photo style selected in step S3 or S4 of FIG. 5, and generates image data to which the photo style has been applied as intermediate data (hereinafter referred to as "first processed image data") (S12).
[0063] Next, the image processing unit 120 applies the LUT selected in step S1 of Fig. 5 to the first processed image data to generate image data to which the LUT has been applied (hereinafter referred to as "second processed image data") (S13). For example, the image processing unit 120 refers to the selected LUT to convert the color of the first processed image data as input into the color of the output image for each pixel to generate the second processed image data.
[0064] Next, the controller 135 records the second processed image data generated in step S13 as output image data on the memory card 142 via the card slot 141 (S14).
[0065] As described above, the digital camera 100 according to this embodiment can output image data to which a photo style and an LUT have been applied, and can execute the output of image data to which the LUT has been applied in real time as described above.
[0066] Unlike RAW data, image data to which a LUT has been applied and output by digital camera 100 can be easily viewed and used on general-purpose devices such as a PC, a smartphone, etc. In this way, according to digital camera 100, an external device such as a PC is not required to apply an LUT, and therefore the workflow for generating image data to which a LUT has been applied can be made more efficient.
[0067] In addition, since the selected LUT and the base photo style automatically selected according to the LUT are applied to the RAW data obtained in the shooting operation, the digital camera 100 can prevent the LUT from being applied to a photo style not intended by the user.
[0068] 1-3. Effects etc. As described above, the digital camera 100, which is an example of an imaging device according to this embodiment, includes the image sensor 115, which is an example of an imaging section, the image processing section 120, the flash memory 145, which is an example of a storage section, and the controller 135, which is an example of a control section. The image sensor 115 captures an image of a subject to generate RAW data, which is an example of original image data. The image processing section 120 performs image processing to impart a predetermined effect to the RAW data to generate image data. The flash memory 145 stores a plurality of photo styles (an example of a first parameter set) and at least one LUT (an example of a second parameter set). The flash memory 145 further stores base photo style information, which is an example of designation information that designates a photo style to be combined with each of the at least one LUT. Each photo style defines the above-mentioned predetermined effect in image processing. Each LUT defines the correspondence before and after converting color information in an image. When the controller 135 reads a specific LUT from the at least one LUT from the flash memory 145, the controller 135 sets a specific photo style to be combined with the specific LUT to one of the multiple photo styles specified in the base photo style information.
[0069] The digital camera 100 can easily obtain an image that has been subjected to image processing according to the user's taste by setting an appropriate base photo style when reading the LUT. For example, the digital camera 100 can easily obtain an image that the user intends even if the user does not remember the base photo style or neglects to set the base photo style.
[0070] The flash memory 145 may store data including the specific LUT and base photostyle information. In this case, the controller 135 reads the base photostyle information when reading the specific LUT, and sets the specific photostyle to be combined with the specific LUT to one of the multiple photostyles specified in the base photostyle information. The digital camera 100 can set an appropriate base photostyle when reading the LUT by reading the base photostyle information when reading the LUT.
[0071] The image processing unit 120 may adjust the image represented by the RAW data using the specific photo style, and may generate image data by converting color information included in the image adjusted in the specific photo style using the specific LUT. This configuration makes it easier for the user to obtain image data representing the image he or she intends.
[0072] The digital camera 100 may further include an operation unit 150 that accepts user operations, and a display 130 that is an example of a display unit that displays information. When the specific photo style is set, the controller 135 may cause the display 130 to display information indicating that the user cannot change the specific photo style to another photo style using the operation unit 150. This configuration makes it possible to inform the user that the photo style cannot be changed.
[0073] When the specific photo style is set, the controller 135 may cause information indicating at least one parameter included in the specific photo style and adjustable by a user operation to be displayed on the display 130. This configuration makes it easier for the user to input an operation to change the parameter value of the photo style.
[0074] 2. Embodiment 2 3 is embedded in the LUT setting information 11 when the creator of the LUT creates the LUT setting information 11 using an information processing device (terminal), for example. Such embedding may be performed manually by the creator, but the base photostyle information may also be automatically embedded in the LUT setting information 11. An example of an information processing device and an information processing method for automatically embedding the base photostyle information in the LUT setting information 11 will be described below.
[0075] 2-1.Configuration 9 is a block diagram showing an example of the configuration of an information processing device 200 according to embodiment 2. The information processing device 200 is, for example, an electronic device such as a personal computer, a smartphone, a tablet terminal, etc. The information processing device 200 may be a digital camera 100 or a smartphone with a camera function.
[0076] The information processing device 200 includes a processor 201, a storage device 202, an input interface (IF) 203, and an output interface 204.
[0077] The processor 201 performs information processing to realize the functions of the information processing device 200. For example, such information processing is realized by the processor 201 operating in accordance with a program stored in the storage device 202. The processor 201 includes an arithmetic circuit that performs calculations for the information processing. For example, the processor 201 is configured with circuits such as a CPU, an MPU, and an FPGA.
[0078] The storage device 202 is a recording medium for recording various information including programs necessary for implementing the functions of the information processing device 200. The storage device 202 is implemented, for example, by a semiconductor storage device such as a flash memory or a solid state drive (SSD), a magnetic storage device such as a hard disk drive (HDD), or other recording media, either alone or in combination. The storage device 202 may include a volatile memory such as an SRAM or a DRAM.
[0079] Although an example in which the program is stored in the storage device 202 has been described above, the storage location of the program is not limited to the storage device 202. For example, the program may be recorded in a non-transitory computer-readable recording medium. Also, the program may be stored in a storage device in one or more external information processing devices that the information processing device 200 can access via a network. In this case, the information processing device 200 can also realize the functions of the information processing device 200 by cloud computing.
[0080] The input interface 203 is an interface circuit that connects the information processing device 200 to an external device in order to input information such as image data to the information processing device 200. The input interface 203 may be a communication circuit that performs data communication in accordance with an existing wired communication standard or wireless communication standard.
[0081] The output interface 204 is an interface circuit that connects the information processing device 200 to an output device in order to output information from the information processing device 200. The output interface 204 may be a communication circuit that performs data communication according to an existing wired communication standard or wireless communication standard. The input interface 203 and the output interface 204 may be realized by similar hardware.
[0082] 2-2.Operation 10 is a flowchart for explaining an example of a method for generating LUT setting information 11 including base photostyle information in the information processing device 200 according to this embodiment. Each process shown in the flowchart in FIG.
[0083] 10, first, the processor 201 acquires image data (S21). The image data is, for example, image data captured by the digital camera 100, and the processor 201 acquires the image data from the digital camera 100 or an external storage device via the network and the input interface 203. Alternatively, the information processing device 200 may have a card slot as the input interface 203, and the processor 201 may acquire the image data from the memory card 142 inserted into the card slot.
[0084] The processor 201 extracts the photo style information of the acquired image data from the acquired image data (S22). The photo style information is included in the image data as metadata such as exif information. For example, the digital camera 100 can embed information indicating the photo style applied at the time of shooting into the image data as metadata.
[0085] The processor 201 accepts a user operation for editing the color of the image data acquired in step S21 (S23). Such a user operation is input to the input interface 203 by an input device such as a keyboard, a mouse, or a touch pad, and then input to the processor 201.
[0086] The processor 201 generates LUT setting information 11 including an LUT according to the result of the color editing in step S23 (S24). In this manner, the user can use the information processing device 200 to generate and edit an LUT.
[0087] The processor 201 embeds the photostyle information extracted in step S22 as base photostyle information in the LUT setting information 11 generated in step S24 (S25). For example, the processor 201 writes the base photostyle information as a tag T exemplified in Fig. 3 in a text file that describes the LUT setting information 11. As a result, the LUT setting information 11 as exemplified in Fig. 3 is obtained.
[0088] The LUT setting information 11 including the base photostyle information thus obtained may be stored in the storage device 202, or may be stored in a storage device in one or more information processing devices such as an external server. The LUT setting information 11 may be transmitted to the imaging device via a network. For example, the controller 135 of the digital camera 100, which is an example of an imaging device, acquires the LUT setting information 11 via the communication module 143, and stores the acquired LUT setting information 11 in the flash memory 145. This allows the controller 135 to refer to the LUT setting information 11 and apply the base photostyle automatically selected according to the LUT to the RAW data.
[0089] As described above, the information processing device 200 may be a smartphone with a camera function. In this case, the information processing device 200 captures an image to generate RAW data, and then refers to the LUT setting information 11 stored in the storage device 202 to apply a base photo style automatically selected according to the LUT to the RAW data.
[0090] 2-3. Effects etc. As described above, the method of generating the LUT setting information 11, which is an example of the information processing method according to the present embodiment, is performed by a processor (for example, the processor 201). This generating method includes a step (S21) of acquiring image data, and a step (S23) of accepting a user operation for converting color information of the image data. The image data is generated by applying a predetermined effect to RAW data generated by capturing an image of a subject through image processing. The image data includes base photostyle information as an example of information indicating a photostyle that defines the effect. This generating method further includes a step (S24) of generating an LUT that defines the correspondence before and after conversion of color information of the image data by a user operation, and a step (S25) of generating data including the generated LUT and the base photostyle information.
[0091] With this configuration, the generation method can generate data including the generated LUT and the corresponding base photostyle information.
[0092] 3. Embodiment 3 The LUT setting information 11 including the base photostyle information obtained in step S25 of the second embodiment may be posted on a website that publishes various LUT setting information 11. A user can view the LUT setting information 11 posted on such a website and download desired LUT setting information 11 with or without payment.
[0093] For example, on such a website, the LUT setting information 11 is posted so that the user can know what the corresponding base photo style is. For example, an LUT corresponding to the photo style "standard" is placed in a "standard" column on the website, and an LUT corresponding to the photo style "vivid" is placed in a "vivid" column. However, the present embodiment is not limited to this, and the base photo style corresponding to the LUT setting information 11 does not have to be clearly stated on the website.
[0094] 11 is a block diagram showing an example of the configuration of an information processing device 300 according to the third embodiment that manages the above-mentioned website. The information processing device 300 includes a processor 301, a storage device 302, and an input / output interface 303. The processor 301 and the storage device 302 have the same configurations as the processor 201 and the storage device 202 in FIG. 9, respectively. For example, the storage device 302 is a recording medium that records various information including programs necessary to realize the functions of the information processing device 300.
[0095] The input / output interface 303 is an interface circuit that connects the information processing device 300 to an external device in order to input and output information such as the LUT setting information 11. The input / output interface 303 may be a communication circuit that performs data communication in accordance with an existing wired communication standard or wireless communication standard.
[0096] Fig. 12 is a flowchart illustrating an information processing method performed by the processor 301 of the information processing device 300 of Fig. 11. The processor 301 acquires LUT setting information 11 including base photostyle information (an example of designation information) from an external device such as the information processing device 200 via the input interface 303 and the network 50 (S31). By acquiring the LUT setting information 11, the processor 301 can generate the LUT setting information 11 including the base photostyle information.
[0097] 11, the processor 301 stores the acquired LUT setting information 11 in the storage device 302. This allows the user to view and download various pieces of LUT setting information 11 from a website that publishes the LUT setting information 11 via the information processing device 300.
[0098] 11, the LUT setting information 11 in the information processing device 300 is downloaded by the digital camera 100. Alternatively, the LUT setting information 11 may be downloaded by another information processing device and then stored in the memory card 142. The digital camera 100 obtains the LUT setting information 11 from the memory card 142 via a card slot.
[0099] As described above, the information processing method according to the present embodiment includes step S31 of acquiring the LUT and base photostyle information, which is an example of designation information for designating a photostyle, to generate LUT setting information 11 including the LUT and the base photostyle information. The photostyle is an example of a first parameter set that specifies a predetermined effect that is applied by image processing to RAW data, which is an example of original image data generated by capturing an image of a subject. The LUT is an example of a second parameter set to be applied to the RAW data together with the photostyle in image processing. With this configuration, the user can acquire preferred LUT setting information 11 from the information processing device 300 and use it in the digital camera 100.
[0100] 4. Other embodiments As described above, the embodiment has been described as an example of the technology in the present disclosure. However, the technology in the present disclosure is not limited to this, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are appropriately performed. In addition, it is also possible to combine the components described in the above embodiment to create a new embodiment. Therefore, the following describes modified examples as other embodiments.
[0101] 4-1.First modified example In the first embodiment, an example has been described in which the controller 135 of the digital camera 100 performs an operation (S2 to S4) depending on whether or not the LUT setting information 11 acquired in step S1 of Fig. 5 includes base photostyle information. In other words, in the first embodiment, whether or not the LUT setting information 11 includes base photostyle information is determined before step S1. For example, when creating an LUT, the base photostyle information is embedded in the LUT setting information 11 by a processor of an information processing device used for creation.
[0102] However, the timing at which the base photostyle information is embedded in the LUT setting information 11 is not limited to this. For example, the controller 135 of the digital camera 100 may embed the base photostyle information in the LUT setting information 11 based on a user operation. Alternatively, the controller 135 may modify the base photostyle information already included in the LUT setting information 11 based on a user operation.
[0103] 4-2. Second modified example In the first embodiment, an example of an imaging operation is described in which the photo style and the LUT are applied (S12, S13) to the RAW data (S11 in FIG. 8) obtained by capturing an image of a subject, and the image data after the application is recorded (S14). However, the method of generating image data in the present disclosure is not limited to this.
[0104] For example, the controller 135 of the digital camera 100 can record RAW data obtained by capturing an image of a subject in the flash memory 145. The digital camera 100 can apply a photo style and an LUT to existing RAW data obtained as described above, and record the image data after application in the memory card 142. In this way, the digital camera 100 allows the user to try applying various photo styles and LUTs to RAW data after shooting, and can obtain image data that better suits the user's preferences.
[0105] 4-3.Third modified example In the first embodiment, an example has been described in which the image data generated in step S13 in Fig. 8 is recorded on the memory card 142, but the recording destination of the image data is not limited to this. For example, the controller 135 may transmit the image data generated in step S13 to an external device such as a server device via the communication module 143, which is an example of a communication unit. Since the image data may be video image data, the user can perform live video distribution, web conferences, etc. using original video to which, for example, a photo style and an LUT are applied.
[0106] Also, for example, the digital camera 100 may be equipped with a USB interface, and image data may be recorded on a recording medium such as an SSD, HDD, or flash memory connected to the digital camera 100 via the USB interface.
[0107] 4-4.Fourth modified example In the first embodiment, a three-dimensional lookup table indicating the relationship between input and output color data consisting of a combination of three colors of RGB has been described as an example of the LUT. However, the LUT is not limited to a table having output color data that corresponds one-to-one to all input color data, as long as it is an array (parameter set) that specifies the correspondence before and after converting the color information for each pixel in the input image.
[0108] For example, if the input color data is not registered in the LUT as an input value, the image processing unit 120 may estimate the output color data by a known estimation method such as tetrahedral interpolation. In this way, the LUT may include a formula that defines how to adjust the color information of each pixel of the input image data to obtain the color information of the pixel in the output image data. Alternatively, the LUT may not include a table as described above, and may be expressed only by the formula as described above. In addition, the LUT is not limited to a three-dimensional lookup table, and may be a lookup table having one or more dimensions.
[0109] 4-5. Fifth Modification In the first embodiment, a digital camera has been described as an example of an imaging device, but the imaging device is not limited to this. The imaging device of the present disclosure may be any electronic device having an image capturing function (for example, a video camera, a smartphone, a tablet terminal, etc.).
[0110] 5.Examples The following provides examples of aspects of the present disclosure.
[0111] <Aspect 1> an imaging unit that captures an image of a subject and generates original image data; an image processing unit that performs image processing to impart a predetermined effect to the original image data to generate image data; a storage unit that stores a plurality of first parameter sets each defining the effect in the image processing, at least one second parameter set defining a correspondence relationship before and after converting color information in an image, and designation information that designates one of the plurality of first parameter sets to be combined with each of the at least one second parameter set; a control unit that, when reading a specific second parameter set from the storage unit, sets a specific first parameter set to be combined with the specific second parameter set to one of the plurality of first parameter sets specified in the specification information; An imaging device comprising:
[0112] <Aspect 2> The storage unit stores data including the specific second parameter set and the designation information, The imaging device of aspect 1, wherein when loading the specific second parameter set, the control unit loads the designation information and sets the specific first parameter set to be combined with the specific second parameter set to one of the multiple first parameter sets designated in the designation information.
[0113] <Aspect 3> The imaging device described in aspect 1 or 2, wherein the image processing unit adjusts an image indicated by the original image data using the specific first parameter set, and uses the specific second parameter set to convert color information contained in the image adjusted with the specific first parameter set to generate image data.
[0114] <Aspect 4> an operation unit that accepts user operations; A display unit that displays information, the control unit causes the display unit to display information indicating that, when the specific first parameter set is set, the user cannot change the specific first parameter set to another first parameter set using the operation unit. The imaging device according to any one of aspects 1 to 3.
[0115] <Aspect 5> an operation unit that accepts user operations; A display unit that displays information, When the specific first parameter set is set, the control unit causes the display unit to display information indicating at least one parameter that is included in the specific first parameter set and that is adjustable by the user operation. The imaging device according to any one of aspects 1 to 4.
[0116] <Aspect 6> An information processing method performed by a processor, comprising: acquiring image data that is generated by applying a predetermined effect to original image data generated by capturing an image of a subject through image processing, the image data including information indicating a first parameter set that defines the effect; receiving a user operation for converting color information of the image data; generating a second parameter set that defines a correspondence relationship before and after the conversion of color information of the image data by the user operation; generating data including the generated second parameter set and information indicative of the first parameter set; An information processing method comprising:
[0117] <Aspect 7> An information processing method performed by a processor, the information processing method including a step of acquiring a second parameter set to be applied to original image data generated by capturing an image of a subject in the image processing together with designation information designating a first parameter set that defines a predetermined effect to be applied by image processing to the original image data, thereby generating data including the second parameter set and the designation information. [Industrial Applicability]
[0118] The present disclosure is applicable to imaging devices and information processing devices. [Explanation of symbols]
[0119] 10 Photo Style Setting Information 11 LUT setting information 100 Digital Camera 110 Optical system 115 Image Sensor 120 Image Processing Unit 125 Buffer Memory 130 Display 135 Controller 141 Card Slots 142 Memory Card 143 Communication Module 145 Flash Memory 150 Operation section
Claims
1. an imaging unit that captures an image of a subject and generates original image data; an image processing unit that performs image processing to impart a predetermined effect to the original image data to generate image data; a storage unit that stores a plurality of first parameter sets each defining the effect in the image processing, at least one second parameter set defining a correspondence relationship before and after converting color information in an image, and designation information that designates one of the plurality of first parameter sets to be combined with each of the at least one second parameter set; a control unit that, when reading a specific second parameter set from the storage unit, sets a specific first parameter set to be combined with the specific second parameter set to one of the plurality of first parameter sets specified in the specification information; and An imaging device comprising:
2. The storage unit stores data including the specific second parameter set and the designation information, 2. The imaging device of claim 1, wherein when the control unit reads the specific second parameter set, the control unit reads the designation information and sets the specific first parameter set to be combined with the specific second parameter set to one of the multiple first parameter sets designated in the designation information.
3. 2. The imaging device of claim 1, wherein the image processing unit adjusts an image indicated by the original image data using the specific first parameter set, and converts color information contained in the image adjusted with the specific first parameter set using the specific second parameter set to generate image data.
4. an operation unit that accepts user operations; A display unit that displays information, the control unit causes the display unit to display information indicating that, when the specific first parameter set is set, the user cannot change the specific first parameter set to another first parameter set using the operation unit. The imaging device according to claim 1 .
5. an operation unit that accepts user operations; A display unit that displays information, When the specific first parameter set is set, the control unit causes the display unit to display information indicating at least one parameter that is included in the specific first parameter set and that is adjustable by the user operation.
5. The imaging device according to claim 1.
6. An information processing method performed by a processor, comprising: acquiring image data that is generated by applying a predetermined effect to original image data generated by capturing an image of a subject through image processing, the image data including information indicating a first parameter set that defines the effect; receiving a user operation for converting color information of the image data; generating a second parameter set that defines a correspondence relationship before and after the conversion of color information of the image data by the user operation; generating data including the generated second parameter set and information indicative of the first parameter set; An information processing method comprising:
7. An information processing method performed by a processor, the information processing method including a step of acquiring a second parameter set to be applied to original image data generated by capturing an image of a subject in the image processing together with designation information designating a first parameter set that defines a predetermined effect to be applied by image processing to the original image data, thereby generating data including the second parameter set and the designation information.
Citation Information
Patent Citations
Imaging device
JP7129678B1
