Imaging device, information processing device, control method, and program
The imaging apparatus addresses inefficiencies in user-selected image corrections by prioritizing and associating correction methods with subject types, streamlining the selection process and ensuring appropriate image adjustments.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- CANON KK
- Filing Date
- 2024-11-19
- Publication Date
- 2026-05-29
AI Technical Summary
Existing image correction methods do not account for user sensibility, requiring users to manually select correction methods from multiple options, which is inefficient.
An imaging apparatus that acquires and displays correction methods with associated subject types and priorities, allowing users to select preferred methods, thereby reducing the effort required for image correction.
The system reduces user effort in selecting correction methods by presenting them in order of priority and associating with subject types, ensuring efficient and suitable image corrections.
Smart Images

Figure 2026088721000001_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to processing of captured images.
Background Art
[0002] A method is known in which a captured image is analyzed to identify a subject, and the captured image is corrected by a correction method suitable for the identified subject, thereby performing correction suitable for the captured image.
[0003] Patent Document 1 describes extracting scene classification of an image, reading correction conditions corresponding to the extraction result from a database, and performing correction processing.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] The correction method of a captured image may vary depending on the user's sensibility. For example, even in the case of a captured image whose subject is a landscape, depending on the user's sensibility, there may be a case where the user wants to correct it to a vivid color view or a case where the user wants to correct it to a monochrome dark color view. However, in the method of Patent Document 1, since it is determined to one correction method corresponding to the subject included in the captured image, the user's sensibility cannot be reflected in the captured image.
[0006] On the other hand, if we allow users to choose the image correction method so that their sensibilities are reflected, it is likely that users will have to find a correction method that corresponds to the subject being photographed from among multiple correction methods and then select the desired correction method from among them. In this case, the user will have to go through the trouble of choosing a correction method, so if we allow users to choose a correction method, it is necessary to reduce the effort required for the user to choose a correction method. [Means for solving the problem]
[0007] The imaging apparatus of this disclosure is characterized by comprising: an acquisition means for acquiring information on a plurality of correction methods for correcting an image, information indicating the type of subject corresponding to each of the plurality of correction methods, and a priority associated with each of the plurality of correction methods; a display control means for displaying the plurality of correction methods, together with the corresponding subject type information, in an order based on the priority, in response to user operation; and a reception means for receiving a correction method selected by the user from the displayed plurality of correction methods. [Effects of the Invention]
[0008] According to this disclosure, even when a user selects a method for correcting captured images, the effort required of the user can be reduced. [Brief explanation of the drawing]
[0009] [Figure 1] A diagram showing an example of the system configuration. [Figure 2] A diagram showing an example of the hardware configuration of the imaging device and server device. [Figure 3] A diagram showing an example of the functional configuration of an imaging device and a server device. [Figure 4] A diagram showing an example of a correction parameter management table. [Figure 5] A sequence diagram illustrating an example of the process for correcting captured images. [Figure 6] A diagram showing an example of the correction method list screen. [Figure 7]A diagram showing an example of a correction explanation screen. [Figure 8] A sequence diagram for explaining an example of a process for correcting a captured image. [Figure 9] A diagram showing an example of an attribute management table and a correction parameter management table. [Figure 10] A diagram showing an example of an attribute list screen. [Figure 11] A diagram showing an example of a correction explanation screen. [Figure 12] A diagram showing an example of the functional configuration of an imaging device and a server device. [Figure 13] A sequence diagram for explaining an example of a process for correcting a captured image.
Mode for Carrying Out the Invention
[0010] Hereinafter, based on the attached drawings, the technology of the present disclosure will be described in detail based on embodiments. Note that the configurations shown in the following embodiments are merely examples, and the technology of the present disclosure is not limited to the illustrated configurations.
[0011] <Embodiment 1> In the present embodiment, a method for obtaining a plurality of correction parameters from a server device, allowing a user to select correction parameters that the user wants to use in advance, determining appropriate correction parameters from among the correction parameters selected by the user, and correcting a captured image will be described.
[0012] [System Configuration] FIG. 1 is a diagram showing an example of the system configuration of an imaging system, which is an information processing system according to the present embodiment. The imaging system includes an imaging device 101, a server device 102, and a setting device 103.
[0013] The imaging device 101 is a device such as a digital camera, a smartphone, or a tablet having a function of capturing an image.
[0014] The server device 102 is an information processing device that manages correction parameters. The server device 102 can communicate with the imaging device 101 via a network, and transmits information on the correction parameters described later to the imaging device 101.
[0015] The setting device 103 can communicate with the server device 102 via a network, and is a device that adds, edits, or deletes information on the correction parameters managed by the server device 102. The setting device 103 may set the type of the imaging device 101 (such as the model name of the camera) when the imaging device 101 acquires information on the correction parameters, and change the information on the correction parameters acquired according to the type of the imaging device 101.
[0016] Note that the imaging system illustrated in FIG. 1 may not include the setting device 103. In that case, information on correction parameters that have been generated in advance may be registered in the server device 102, and the server device 102 may manage the correction parameters.
[0017] [Hardware Configuration of Imaging Device] FIG. 2 is a diagram showing an example of the hardware configuration of each device included in the imaging system of the present embodiment.
[0018] The imaging device 101 includes a CPU 201, a ROM 202, a RAM 203, an auxiliary storage device 204, an input device 206, a display device 205, a communication device 207, and an imaging device 209, and each component is connected by a system bus 208.
[0019] The CPU 201 is a central processing unit, performs operations such as calculations and logical judgments for various processes, and controls each component connected to the system bus 208.
[0020] ROM (Read-Only Memory) 202 is a program memory that stores a program for control by the CPU 201, including various processing procedures described later. RAM (Random Access Memory) 203 is a memory used as a temporary storage area such as the CPU 201's main memory or work area. The CPU 201 reads and executes the program stored in ROM 202 to perform the processing according to the sequence diagrams described later. ROM 202 may also be implemented as program memory by loading the program stored in ROM 202 into RAM 203. The CPU 201 writes the execution results of each process to RAM 203.
[0021] The auxiliary storage device 204 is a storage device in which data is not erased even when the power is turned off, and stores electronic data and programs according to this embodiment. The auxiliary storage device 204 can be implemented, for example, by a media (storage medium) and an external storage drive for accessing the media. Examples of such media include flash memory, USB memory, SSD (Solid State Drive) memory, HDD (Hard Disk Drive), flexible disk (FD), CD-ROM, DVD, SD card, etc.
[0022] The auxiliary storage device 204 may be an external device to the imaging device 101, for example, a server connected to the imaging device 101 via a network. The auxiliary storage device 204 may be implemented as program memory by loading the program stored in the auxiliary storage device 204 into the RAM 203. The CPU 201 stores the execution results of each process in the auxiliary storage device 204.
[0023] The display device 205 is, for example, a display unit such as a liquid crystal display or an organic EL display. The CPU 201 functions as a display control unit, and the CPU 201 causes the display device 205 to display images, characters, graphics, and other screen elements.
[0024] The input device 206 is, for example, an operating unit such as a touch panel, button, or mouse, which accepts various operations from the user. The input device 206 may be attached to the display device 205 and integrated with the display device 205 so as to sense the user's movements. For example, the input device 206 may be a pressure touch panel, a electrostatic touch panel, a light pen, etc.
[0025] The communication device 207 performs wired or wireless bidirectional communication with other information processing devices, server devices 102, communication equipment, external storage devices, etc., using known communication technologies.
[0026] The imaging device 209 is a device that converts ambient light into electronic image data and electronic video data using known optical techniques. The CPU 201 converts the ambient scenery obtained from the imaging device 209 into image data and video data.
[0027] Figure 2(b) is a block diagram illustrating the hardware configuration of the server device 102. The server device 102 includes a CPU 211, ROM 212, RAM 213, auxiliary storage device 214, communication device 217, and system bus 218.
[0028] The CPU 211 is the same as the CPU 201 of the imaging device 101, so its description is omitted. Similarly, the ROM 212 is the same as the ROM 202, the RAM 213 is the same as the RAM 203, the auxiliary storage device 214 is the same as the auxiliary storage device 204, the communication device 217 is the same as the communication device 207, and the system bus 218 is the same as the system bus 208, so their descriptions are omitted. Note that at least one of the display device 215 and the input device 216 may exist as an external device connected to the server device 102 by wired or wireless connection.
[0029] In this embodiment, the server device 102 is described as a device for the sake of explanation, but the server device 102 may be a system in which multiple information processing devices (servers) behave as a single server device 102. The hardware configuration of the setting device 103 is the same as that of the server device 102, so its description is omitted.
[0030] [Functional Configuration] Figure 3 is a block diagram showing an example of the functional configuration of the imaging device 101 and the server device 102. The imaging device 101 includes an imaging control unit 301, an acquisition unit 302, a display control unit 303, a reception unit 304, a identification unit 305, a determination unit 306, a correction unit 307, and a management unit 308.
[0031] The imaging control unit 301 generates an image based on the results of imaging performed by the imaging device 209. The acquisition unit 302 receives correction parameters and other information from the server device 102 as information about the correction method described later. The display control unit 303 displays the UI screen and the like on the display device 205. The reception unit 304 receives the correction method selected by the user. The correction method selected by the user becomes a candidate correction method when the correction unit 307 corrects the captured image. The management unit 308 manages information on the correction method in the correction parameter management table 400 (see Figure 4). The identification unit 305 identifies the type of subject included in the captured image. The determination unit 306 determines the correction method used by the correction unit 307 when correcting the captured image. The correction unit 307 corrects the captured image based on the correction parameters associated with the determined correction method. The server device 102 has a transmitting unit 311. The transmitting unit 311 transmits information about the correction method managed by the server device 102 to the imaging device 101.
[0032] The functional units in Figure 3 are implemented by the CPU of each device reading a predetermined program stored in ROM or the like into RAM and executing it, but are not limited to this. For example, when configuring hardware as an alternative to CPU-based processing, one can configure arithmetic units and circuits that correspond to the processing of each functional unit described here. At least a part of the functional units in Figure 3 may be implemented through the cooperation of software and hardware such as dedicated ICs, or some or all of the functions may be implemented by hardware alone.
[0033] [Regarding correction parameters] Figure 4 shows an example of a correction parameter management table for managing correction method information in the imaging device 101. Each row of the correction parameter management table 400 holds information such as correction parameters for each correction method.
[0034] Column 401 holds an identifier (correction ID) that uniquely identifies the correction method in question.
[0035] Column 402 holds the name of the correction method (correction name) indicated by the correction ID held in column 401. In other words, column 402 holds the name of the correction performed by applying the correction parameters held in column 406 to the captured image.
[0036] Column 403 holds the priority of the correction method indicated by the correction ID held in column 401. In other words, column 403 holds the priority of correction by applying the correction parameters held in column 406 to the captured image. Priority is a value used to narrow down the correction method (correction parameter) used when correcting the captured image to one. In this embodiment, a smaller priority value indicates that the correction method (correction parameter) is determined with higher priority. That is, a smaller priority value indicates a higher priority.
[0037] Priority may be determined, for example, by the administrator of server device 102 or configuration device 103, or it may be determined automatically by a predetermined rule or AI, etc. Alternatively, it may be determined by a user via a browser on a PC or similar device. If a user generates a list of candidate correction methods via a browser on a PC or similar device, priority may be determined based on the order of the items in that list.
[0038] Column 404 stores information indicating whether the correction method indicated by the correction ID held in column 401 is the correction method selected by the user. The presence of "Selected" indicates that the correction method was selected by the user.
[0039] Column 405 stores the characteristics of the captured image that are suitable for the correction method indicated by the correction ID stored in column 401. In this embodiment, the characteristics of the captured image are described as the type of subject included in the captured image. The type of subject stored in column 405 does not have to be just one. For example, a correction method that stores "person" means that it is a correction method suitable for correcting captured images that include people. Also, as shown in row 411 where the correction ID is "10", it may include multiple types of subjects such as "person" and "landscape". Furthermore, the term "type of subject" is broad and includes scenes such as nightscapes. For example, a nightscape will be recognized as a different type of subject than a daytime landscape. Other information may also be used as it is an image characteristic that you want to associate with a correction method.
[0040] Column 406 stores correction parameters, which are parameters used to adjust the brightness and color of the captured image, and are used in the correction method indicated by the correction ID stored in column 401. In this embodiment, as an example, adjustment values may be registered as correction parameters, or the adjustment values of the correction parameters may be saved in an external file, and the name and path of that file may be stored in column 406.
[0041] [Process flow] Figure 5 is a sequence diagram showing the processing flow for correcting captured images. In Figure 5, the processing of each step S501 to S508 executed by the imaging device 101 is performed by the CPU 201 after the program code stored in ROM 202 or auxiliary storage device 204 is loaded into RAM 203. The processing of step S511 executed by the server device 102 is performed by the CPU 211 after the program code stored in ROM 212 or auxiliary storage device 214 is loaded into RAM 213. In addition, some or all of the functions of the steps in Figure 5 may be implemented by hardware such as ASICs or electronic circuits. The symbol "S" in the description of each process means that it is a step in the flowchart, and the same applies to subsequent flowcharts.
[0042] In S511, the transmission unit 311 of the server device 102 transmits information about one or more correction methods to the imaging device 101. The information transmitted in S511 includes a correction ID, a correction name, a priority, and correction parameters.
[0043] The server device 102 is a server that stores various correction parameters for correcting captured images. In S511, for example, all correction parameters stored in the server device 102, along with the correction ID, correction name, and priority associated with those correction parameters, may be transmitted as information about the correction method. Alternatively, the system may be configured so that the user can specify correction parameters or correction names to the server device 102 from a browser on a PC or from the imaging device 101. In this case, the imaging device 101 transmits an identifier to identify the user or the imaging device 101 before S511. Then, in S511, the correction parameters associated with the received identifier, along with the correction ID, correction name, and priority associated with those correction parameters, may be transmitted as information about the correction method.
[0044] In S501, the acquisition unit 302 of the imaging device 101 receives information on one or more correction methods transmitted from the server device 102. The management unit 308 of the imaging device 101 manages the acquired correction method information in the correction parameter management table 400 shown in Figure 4 above.
[0045] In S502, the display control unit 303 of the imaging device 101 displays a correction method list screen 601 (see Figure 6) on the display device 205. This screen displays the correction names from the information received in S501 in an order based on priority.
[0046] Figure 6 shows an example of the correction method list screen 601. The correction name display area 602 included in the correction method list screen 601 displays the correction names held in column 402 of the correction parameter management table 400 in Figure 4, in order of priority. From the correction method list screen 601, the user can select one or more candidates for correction methods to be applied to the captured image.
[0047] The subject type display area 603 displays the types of subjects whose image features are suitable for the correction method indicated by the correction name displayed on the left. In other words, it displays the types of subjects suitable for the correction method that applies the correction parameters associated with the correction name. Therefore, the user can check which subjects are suitable for each correction method (correction parameter) indicated by each correction name from the correction method list screen 601. There is not a requirement that each correction name corresponds to only one type of subject; the subject type display area 603 may display multiple types of subjects side by side for a single correction name.
[0048] The scroll bar 604 is provided so that if not all correction names can be displayed on the correction method list screen 601, the displayed correction names can be switched by scrolling.
[0049] In S503, the reception unit 304 receives the correction name selected by the user from among the correction names displayed on the correction method list screen 601. One way to receive the correction name selected by the user is, for example, when the user presses the area of the row where a correction name is displayed on the correction method list screen 601 in Figure 6, the reception unit 304 may receive the correction name corresponding to the pressed row as the correction name selected by the user. Alternatively, for example, when the user presses a correction name from among the correction names displayed on the correction method list screen 601 in Figure 6, the system may transition to a screen where the user can choose whether or not to accept the correction name they pressed. If the user then presses a button indicating their selection on that screen, the reception unit 304 may receive the pressed correction name as the correction name selected by the user.
[0050] Figure 7 shows an example of a correction explanation screen, which is a screen used to explain to the user what kind of correction method is performed by the correction name (correction parameter) that the user has pressed. The correction explanation screen 701 in Figure 7 is a screen used to explain the correction method indicated by the correction name that the user pressed from among the correction names displayed in the correction name display area 602 of the correction method list screen 601 in Figure 6. Figure 7 is an example of the screen that is displayed when the user presses the correction name "Whitening" on the correction method list screen 601.
[0051] The sample image 702 included in the correction explanation screen 701 is an example of an image corrected using the correction method indicated by the correction name selected by the user. The explanatory text 703 is a text that explains to the user what kind of correction method is indicated by the correction name selected by the user.
[0052] If the user decides not to apply the correction indicated by the correction name pressed in the correction name display area 602 to the captured image, they press the deselect button 705. When the deselect button 705 is pressed, the system returns to the correction method list screen 601 shown in Figure 6.
[0053] If the user decides that the correction method indicated by the correction name pressed in the correction name display area 602 is a candidate for correction to the captured image, they press the select button 704. In this way, a screen explaining the correction method (correction parameters) may be displayed.
[0054] When a user selects a correction name displayed in the correction name display area 602 of the correction method list screen 601, such as by pressing the select button 704, the reception unit 304 in S503 sets the correction name selected by the user to a selected state. For example, the reception unit 304 sets the "Selected" column 404 of the row in the correction parameter management table 400 that holds the correction name selected by the user to "Selected" so that the selected state is maintained. The display control unit 303 also displays a selection mark 605 on the correction method list screen 601 corresponding to the correction name selected by the user to indicate that the correction name is selected.
[0055] In S504, the imaging control unit 301 causes the imaging device 209 to perform imaging based on the user's imaging instruction, and acquires the resulting image.
[0056] In S505, the identification unit 305 identifies the type of subject included in the captured image acquired in S504. The identification unit 305 may, for example, identify the subject by analyzing the captured image, or it may identify the subject from the information of the imaging mode set by the imaging device 101 at the time of imaging.
[0057] In S506, the decision unit 306 determines a correction method from among the correction methods selected by the user that corresponds to the type of subject identified in S505. If there are multiple correction methods that have been determined, the decision unit 306 then determines the correction method with the highest priority (the lowest priority value).
[0058] In S507, the determination unit 306 acquires correction parameters as information for correcting the captured image using the correction method determined in S506.
[0059] For example, suppose the type of subject included in the captured image acquired in S504 is identified as "person". In the correction parameter management table 400 in Figure 4, the correction methods that have "person" as the type of subject in column 405 and "selected" indicating that the user has selected them in column 404 are the correction methods with correction IDs "3" and "10". Of these, the correction method with correction ID "3" has a lower priority value than the correction method with correction ID "10", and therefore has a higher priority. For this reason, in S506, the determination unit 306 determines the correction method with correction ID "3", and in S507, it obtains the correction parameters associated with correction ID "3" from column 406 as information about the determined correction method.
[0060] In S508, the correction unit 307 corrects the image to be corrected, which was acquired in S504, using the correction parameters acquired in S507. If, in S506, it is determined that there is no user-selected correction method corresponding to the type of subject, the correction unit 307 may correct using default correction parameters or may choose not to perform any correction.
[0061] Note that the imaging device 101 does not need to receive correction method information from the server device 102 for each image. For example, if a user operates the imaging device 101 to display the settings screen on the display device 205, steps S501 to S503 may be executed in response to that operation. In Figure 5, the system is shown receiving correction method information from the server device 102, but if the correction parameter management table 400 shown in Figure 4 is pre-stored in the imaging device 101, steps S511 and S501 in Figure 4 do not need to be performed.
[0062] As described above, according to this embodiment, the user can pre-select candidates for correction methods according to the type of correction they want to apply to the subject. At this time, the selectable correction methods are displayed in order of priority, and the types of subjects suitable for each correction method are also displayed, thus reducing the effort required for the user to select a candidate correction method. Furthermore, even if the user selects multiple correction methods as candidates, the correction method actually used for correction is determined to correspond to the type of subject included in the captured image. Therefore, corrections suitable for the subject included in the captured image can be performed.
[0063] For example, there may be multiple correction methods available for correcting a single type of subject. In such cases, even if the type of subject is identified from the captured image, a single correction method cannot be determined without user selection. However, according to this embodiment, the correction methods are displayed in order of priority, and the screen is displayed in a way that allows the user to identify the type of subject corresponding to each correction method, thus reducing the effort required for the user to select a correction method. Furthermore, in this embodiment, the correction names indicating the correction methods (correction parameters) are displayed in order of priority. Therefore, even when displaying a list of correction methods on a compact display unit, such as the display device 205 of the imaging device 101, the hassle of the user searching for a correction method can be reduced.
[0064] For example, suppose the user selects a correction method with correction ID "1" and a correction method with correction ID "2" via the correction method list screen 601 in Figure 6. In this case, since the correction method with correction ID "1" has a higher priority, the correction parameters of the correction method with correction ID "1" will always be used for captured images that include buildings, and the correction method with correction ID "2" will never be used. Thus, if a user selects multiple correction methods corresponding to the same type of subject, only the correction method with the higher priority may be used. For this reason, if the user selects multiple correction names corresponding to the same subject in S503, the display control unit 303 may display a message such as a warning or error. Alternatively, the more preferable correction method may be displayed higher to make it easier for the user to select. Furthermore, the priority may be changed by the imaging device 101 or the setting device 103 so that one correction method is not always used.
[0065] <Embodiment 2> In Embodiment 1, the user selected a correction method, and a correction method corresponding to the type of subject in the captured image was determined from the user's selected correction methods, and the captured image was corrected using the determined correction method. In this embodiment, a method is described in which the correction methods are pre-grouped, and the user selects a group, thereby reducing the effort required for the user to select each correction method individually. This embodiment will be described mainly in terms of the differences from Embodiment 1. Unless otherwise specified, the configuration and processing are the same as in Embodiment 1.
[0066] [Process flow] Figure 8 is a sequence diagram illustrating the process flow in which the imaging device 101 obtains information on the attributes of the correction method (correction parameters) from the server device 102, and the user selects the attributes in advance to determine the correction method for the captured image.
[0067] The sequence diagram in Figure 8 corresponds to the sequence diagram in Figure 5 of Embodiment 1. Therefore, in the sequence diagram in Figure 8, the same steps as in the sequence diagram in Figure 5 are numbered the same way in Figure 8. For this reason, the explanation of the sequence diagram in Figure 8 will focus on steps that differ from those in the sequence diagram in Figure 5.
[0068] In S811, the transmitting unit 311 of the server device 102 transmits information about one or more correction methods to the imaging device 101, similar to S511. Furthermore, in S811, the transmitting unit 311 of the server device 102 transmits attribute information such as the attribute management table 900 (see Figure 9) as attribute information of the correction method.
[0069] In this embodiment, the correction methods are grouped together. The group to which the correction methods belong is called an attribute. By grouping the correction methods by attribute, users can easily select from multiple correction methods.
[0070] Figure 9(a) shows an example of an attribute management table for managing the attributes of correction methods. Column 901 in the attribute management table 900 holds an identifier (attribute ID) for uniquely identifying an attribute. Column 902 holds the attribute name, which is the name of the attribute indicated by the attribute ID held in column 901. In this embodiment, as an example, correction methods of the same type are grouped together under the same attribute. Column 903 holds information indicating whether the attribute has been selected by the user. The presence of "Selected" in column 903 indicates that the attribute has been selected by the user. Column 904 holds the correction ID value, which indicates the correction method (correction parameter) included in the attribute indicated by the attribute name displayed in column 902. The information in the attribute management table 900 may be pre-stored in the server device 102, or it may be generated and edited by the setting device 103.
[0071] Returning to Figure 8, let's continue the explanation of the sequence diagram. In S801, the acquisition unit 302 of the imaging device 101 receives information on one or more correction methods from the server device 102. Furthermore, the acquisition unit 302 acquires the attribute management table 900 from the server device 102.
[0072] In S802, the display control unit 303 displays a list of attributes for the correction method.
[0073] Figure 10 shows an example of an attribute list screen 1001 for displaying a list of attributes of correction methods. The attribute name display area 1002 included in the attribute list screen 1001 displays the attribute names held in column 902 of the attribute management table 900 in Figure 9(a).
[0074] Figure 11 shows an example of a correction explanation screen, which is a screen used to explain to the user what kind of correction the correction method included in the attribute specified by the user performs. Figure 11 shows an example of a correction explanation screen that explains the correction method included in the attribute indicated by "Dark Correction" when the attribute name "Dark Correction" is pressed from the attribute name display area 1002 in the attribute list screen 1001 of Figure 10.
[0075] The subject type display area 1102 displays the subject types corresponding to each correction method included in the attribute specified by the user from the attribute list screen 1001 in Figure 10. If any of the correction methods included in the attribute specified by the user correspond to a subject type, that subject type is displayed in the subject type display area 1102. The cursor 1103 indicates the subject type selected from the subject types included in the subject type display area 1102. The sample image 1104 included in the correction explanation screen 1101 is an example of an image corrected using the correction method corresponding to the subject type indicated by the cursor 1103. The explanatory text 1105 is text to explain to the user the correction shown by the correction method corresponding to the subject type indicated by the cursor 1103.
[0076] In S803, the reception unit 304 obtains the attribute name selected by the user from among the attribute names displayed on the attribute list screen 1001. One way the user can select an attribute name is, for example, if the user presses the area of the row containing the attribute name on the attribute list screen 1001 in Figure 10, the reception unit 304 may accept the pressed attribute name as the attribute name selected by the user. Alternatively, for example, if the user presses an attribute name from among the attribute names displayed on the attribute list screen 1001 in Figure 10, the system may transition to a correction explanation screen 1101 where the user can choose whether or not to select the pressed attribute name. If the user then presses the selection button 1106 on the correction explanation screen 1101 to indicate that they are selecting an attribute, the reception unit 304 may accept the pressed attribute name as the attribute name selected by the user.
[0077] When a user selects an attribute name, such as by pressing the select button 1106, the reception unit 304 sets the selected attribute name to the selected state. For example, the reception unit 304 stores "Selected" in column 903 of the row in the attribute management table 900 where the user's selected attribute name is stored. The display control unit 303 also displays a selection mark 1003 on the attribute list screen 1001 corresponding to the attribute name selected by the user to indicate that the attribute name is selected.
[0078] In S804, the reception unit 304 selects the correction method included in the attribute selected by the user. Specifically, the reception unit 304 stores "Selected" in column 404 of the row where the correction ID included in the attribute selected by the user is stored in the correction parameter management table 400, so that the information that it is selected is maintained.
[0079] For example, suppose the user selects the attribute with attribute ID "2" and attribute name "Sharp Correction". In this case, as shown in Figure 9(a), the reception unit 304 retrieves "2", "8", and "13" as correction IDs held in column 904 of the row where attribute ID "2" is held in the attribute management table 900. The reception unit 304 then sets column 404 of rows 911, 912, and 913 in the correction parameter management table 400, where correction IDs "2", "8", and "13" are held, to "Selected", and sets the correction method included in the attribute to the selected state, as shown in Figure 9(b). Furthermore, if the user switches the attribute selection state to the attribute name "Dark Correction", the selection states of correction IDs "2", "8", and "13" in the correction parameter management table 400 are deselected, and correction ID "10" becomes the selected state.
[0080] Steps S504 to S507 are the same as in Embodiment 1 described above, but in S506, the correction method included in the attribute selected by the user is processed as the correction method selected by the user. Correction is performed using the correction parameters associated with the correction method with the highest priority among the correction methods corresponding to the type of subject included in the captured image.
[0081] As described above, according to this embodiment, the user can select multiple correction methods included in the selected attribute simply by selecting the attribute. This reduces the effort required for the user to select each correction method individually. Furthermore, there are cases where the user wants to select correction methods (correction parameters) for each correction characteristic, such as vivid correction or sharp correction. Even in such cases, according to this embodiment, the user only needs to select one attribute, and does not need to select each correction method for the same characteristic individually. Therefore, the desired correction method can be selected with fewer operations, reducing the effort required from the user.
[0082] Furthermore, the correction attributes may include correction methods corresponding to each type of subject. In this case, when the user selects an attribute, the correction method corresponding to each type of subject will automatically be marked as "selected," thus automatically determining the correction method for each type of subject.
[0083] Furthermore, the user may be limited to selecting only one attribute. Alternatively, the user may be allowed to select multiple attributes. If multiple attributes are selectable, S506 should obtain the correction IDs included in all selected attributes and determine the correction method that corresponds to the subject and has the highest priority among the correction methods indicated by the obtained correction IDs. Additionally, attributes may also be associated with priority and displayed in order of priority on the attribute list screen 1001. Furthermore, as a method for grouping correction methods (correction parameters) by attribute, for example, they may be grouped by user.
[0084] <Embodiment 3> In Embodiment 1, the imaging device 101 was described as identifying the subject of the captured image and correcting the captured image. In this embodiment, a method is described in which the server device 102 identifies the subject and corrects the captured image. This embodiment will be described mainly in terms of the differences from Embodiment 1. Unless otherwise specified, the configuration and processing are the same as in Embodiment 1.
[0085] [Functional Configuration] Figure 12 is a block diagram showing an example of the functional configuration of the imaging device 101 and the server device 102 in this embodiment. The server device 102 in this embodiment has a transmitting unit 311, a management unit 1201, a receiving unit 1204, a specific unit 1205, a determination unit 1206, and a correction unit 1207. Functional units similar to those shown in Figure 3 are denoted by the same reference numerals and their descriptions are omitted.
[0086] The management unit 1201 manages information on the correction method using the correction parameter management table 400. The receiving unit 1204 receives the image to be corrected from the imaging device 101. The identification unit 1205 identifies the type of subject included in the image as a characteristic of the image. The determination unit 1206 determines the correction method to be used when correcting the image to be corrected based on the information attached to the metadata of the image to be corrected. The correction unit 1207 corrects the image to be corrected based on the correction method determined by the determination unit 1206.
[0087] The imaging device 101 of this embodiment includes an acquisition unit 302, a display control unit 303, a reception unit 304, a correction application unit 1211, an imaging control unit 301, and a transmission unit 1212. Functional units similar to those shown in Figure 3 are denoted by the same reference numerals and their descriptions are omitted.
[0088] The correction application unit 1211 adds information to the metadata of the captured image generated by the imaging control unit 301 to identify the correction method selected by the user, as received by the reception unit 304. For example, the correction application unit 1211 adds a correction ID value indicating the correction method selected by the user to the area that holds the metadata of the image file representing the captured image. The transmission unit 1212 transmits the captured image, with the metadata containing information indicating the correction method selected by the user, to the server device 102.
[0089] [Process flow] Figure 13 is a sequence diagram showing the processing flow of this embodiment for correcting captured images. Figure 13 is a sequence diagram for explaining the processing flow when the imaging device 101 transmits captured images to the server device 102, and the server device 102 corrects the captured images.
[0090] The sequence diagram in Figure 13 corresponds to the sequence diagram in Figure 5 of Embodiment 1. Therefore, in the sequence diagram in Figure 13, the same steps as in the sequence diagram in Figure 5 are numbered the same way in Figure 13.
[0091] In Figure 13, steps S501 to S504 are the same as in Embodiment 1. The imaging device 101 displays a list of correction names obtained from the server device 102, and the user selects a correction name that indicates the correction parameter (correction method) they want to use for correction. Once the image is acquired in S504, the process proceeds to S1301 in this embodiment.
[0092] In S1301, the correction application unit 1211 of the imaging device 101 adds information indicating the correction method selected by the user in S503 to the metadata of the captured image acquired in S504. The information added to the metadata of the captured image in S1301 can be anything that can identify the correction name or correction parameters, such as a correction ID.
[0093] In S1302, the transmitting unit 1212 of the imaging device 101 transmits the captured image, to the server device 102, to which metadata information indicating the correction method selected by the user has been added.
[0094] In S1311, the receiving unit 1204 of the server device 102 receives the captured image transmitted from the imaging device 101 in S1302.
[0095] In S1312, the same processing as in S505 is performed in the server device 102. That is, the identification unit 1205 of the server device 102 analyzes the received captured image and identifies the type of subject included in the captured image as a feature of the captured image.
[0096] In S1313, the same processing as in S506 is performed in the server device 102. That is, the determination unit 1206 of the server device 102 determines the correction method that corresponds to the type of subject identified in S1312 from among the correction methods selected by the user. Then, the determination unit 306 determines the correction method with the highest priority from among the determined correction methods.
[0097] The difference between S1313 and S506 is that in S1313, the determination unit 1206 obtains information to identify the correction method selected by the user from the metadata of the captured image received in S1311. Also, in S1313, the correction method is determined from the correction parameter management table 400 managed by the server device 102.
[0098] S1314 is a process similar to S507, in which the determination unit 1206 obtains the correction parameters associated with the correction method determined in S1313.
[0099] In S1315, the same processing as in S508 is performed in the server device 102. The correction unit 1207 of the server device 102 corrects the captured image received in S1311 using the correction parameters acquired in S1314.
[0100] In S1316, the transmitting unit 311 of the server device 102 transmits the image captured in S1315 to the imaging device 101.
[0101] In S1303, the acquisition unit 302 of the imaging device 101 receives the corrected image.
[0102] As explained above, according to this embodiment, even if the process of identifying or correcting the subject is complex and cannot be processed on the imaging device 101 side, the server device 102 can perform the process of identifying or correcting the subject. As a comparative example, it is also conceivable that information indicating the correction method selected by the user is sent from the imaging device 101 to the server device 102 separately from the captured image. However, suppose that the transmission of an captured image is canceled and the captured image to be transmitted is switched during the transmission of the captured image, or that a communication error occurs during the transmission of the captured image. In this case, with the comparative example method, there is a risk that the correspondence between the captured image received by the server device 102 and the information indicating the correction method will be different. By adding information indicating the correction method selected by the user to the metadata of the captured image as in this embodiment, the server device 102 can obtain the information indicating the correction method that was selected at the time the received captured image was captured, thereby suppressing the occurrence of the situation described in the comparative example.
[0103] Furthermore, the method of this embodiment may also be applied to the method of Embodiment 2. That is, the user-selected attributes may be added to the metadata of the captured image, and the captured image may be transmitted from the imaging device 101 to the server device 102. The server device 102 may then process the correction method included in the attributes added to the metadata as the correction method selected by the user.
[0104] <Other Embodiments> Although embodiments have been described in detail above, this disclosure can take the form of, for example, a system, apparatus, method, program, or storage medium. Specifically, it may be applied to a system consisting of multiple devices (e.g., a host computer, interface devices, imaging devices, web applications, etc.) or to an apparatus consisting of a single device.
[0105] Furthermore, it goes without saying that the objective of the technology disclosed herein is achieved as follows: a storage medium containing software program code (computer program) that realizes the functions of the embodiments described above is supplied to a system or device. Such storage medium is, of course, a computer-readable storage medium. The computer (or CPU or MPU) of the system or device then reads and executes the program code stored in the storage medium. In this case, the program code read from the storage medium itself realizes the functions of the embodiments described above, and the storage medium containing that program code constitutes the technology disclosed herein.
[0106] This disclosure can also be implemented by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be implemented by a circuit (e.g., an ASIC) that implements one or more functions.
[0107] The above-described embodiments include the following configurations.
[0108] (Composition 1) An acquisition means for acquiring information on multiple correction methods for correcting captured images, information indicating the type of subject corresponding to each of the multiple correction methods, and the priority associated with each of the multiple correction methods. A display control means that, in response to user operation, displays the plurality of correction methods in an order based on priority, along with information on the corresponding subject type. A receiving means for receiving a correction method selected by the user from the displayed plurality of correction methods, An imaging device characterized by having the following features.
[0109] (Configuration 2) A determination means for determining a correction method for correcting the image to be corrected from among the correction methods selected by the user, Correction means for correcting the captured image to be corrected using the determined correction method, The imaging apparatus according to configuration 1, further comprising the above.
[0110] (Composition 3) The system further includes a means for identifying the type of subject included in the image to be corrected. The aforementioned determination means is The correction method corresponding to the type of subject identified among the correction methods selected by the user is determined as the correction method for correcting the captured image to be corrected. The imaging apparatus according to configuration 2, characterized in that...
[0111] (Composition 4) The aforementioned determination means is If there are multiple correction methods corresponding to the identified type of subject, the correction method with the higher priority is determined as the correction method for correcting the captured image to be corrected. The imaging apparatus according to configuration 3, characterized by the above.
[0112] (Composition 5) The display control means is When the user selects a correction method from the aforementioned multiple correction methods, an example of the captured image corrected by the selected correction method will be displayed. An imaging device according to any one of configurations 1 to 4, characterized by the above.
[0113] (Composition 6) A means for adding information indicating the correction method selected by the user to the metadata of the captured image to be corrected, The server device includes means for transmitting the captured image to be corrected, in which metadata is provided with information indicating the correction method selected by the user; The server device further includes receiving means for receiving the image to be corrected, which has been corrected based on the correction method selected by the user. The imaging apparatus according to configuration 1 or 5, characterized by the above.
[0114] (Composition 7) An acquisition means for acquiring multiple attributes that include correction methods corresponding to the type of subject, and information on the correction methods included in each of the multiple attributes, A display control means that displays the multiple attributes in response to user operations, A receiving means for receiving an attribute selected by the user from among the aforementioned multiple attributes, An imaging device characterized by having the following features.
[0115] (Composition 8) A determination means for determining a correction method for correcting the image to be corrected from the correction methods included in the attributes selected by the user, Correction means for correcting the captured image to be corrected using the determined correction method, The imaging apparatus according to configuration 7, further comprising:
[0116] (Composition 9) The system further includes a means for identifying the type of subject included in the image to be corrected. The determination means determines, as a correction method for correcting the captured image to be corrected, the correction method corresponding to the type of subject identified among the correction methods included in the attribute selected by the user. The imaging apparatus according to configuration 8, characterized by the above.
[0117] (Composition 10) The information regarding the correction method includes information on parameters for correcting the captured image. An imaging apparatus according to any one of configurations 1 to 9, characterized in that
[0118] (Composition 11) It further has a display unit, The display control means displays the plurality of correction methods on the display unit in an order based on priority, along with information on the corresponding subject types. An imaging apparatus according to any one of configurations 1 to 6, characterized by the above.
[0119] (Composition 12) A receiving means that receives an image to be corrected from the imaging device described in configuration 6, the image having metadata that includes information indicating the correction method selected by the user, A determination means for determining a correction method for correcting the captured image to be corrected from the correction method selected by the user, Correction means for correcting the captured image to be corrected using the determined correction method, A transmission means for transmitting the corrected image to be corrected to the imaging device, An information processing device characterized by having the following features.
[0120] (Composition 13) The system further includes a means for identifying the type of subject included in the image to be corrected. The aforementioned determination means is The correction method corresponding to the type of subject identified among the correction methods selected by the user is determined as the correction method for correcting the captured image to be corrected. The information processing device according to configuration 12, characterized by the features described herein.
[0121] (Composition 14) A step of obtaining information on multiple correction methods for correcting an captured image, information indicating the type of subject corresponding to each of the multiple correction methods, and the priority associated with each of the multiple correction methods. The steps include: displaying the multiple correction methods in order based on priority, along with information on the corresponding subject type, in response to user operation; A step of accepting the correction method selected by the user from the displayed plurality of correction methods, A control method for an imaging device, characterized by having the following features.
[0122] (Composition 15) A step of obtaining multiple attributes that include correction methods corresponding to the type of subject, and information on the correction methods included in each of the multiple attributes, The steps include displaying the multiple attributes in response to user actions, A step of receiving an attribute selected by the user from among the aforementioned multiple attributes, A control method for an imaging device, characterized by having the following features.
[0123] (Composition 16) A program for causing a computer to perform each of the means of the imaging apparatus described in any one of configurations 1 to 11. [Explanation of symbols]
[0124] 101 Imaging device 302 Acquisition Department 303 Display Control Unit 304 Reception Department
Claims
1. An acquisition means for acquiring information on multiple correction methods for correcting captured images, information indicating the type of subject corresponding to each of the multiple correction methods, and the priority associated with each of the multiple correction methods. A display control means that, in response to user operation, displays the plurality of correction methods in an order based on priority, along with information on the corresponding subject type. A receiving means for receiving a correction method selected by the user from the displayed plurality of correction methods, An imaging device characterized by having the following features.
2. A determination means for determining a correction method for correcting the image to be corrected from among the correction methods selected by the user, Correction means for correcting the captured image to be corrected using the determined correction method, The imaging apparatus according to claim 1, further comprising the following:
3. The system further includes a means for identifying the type of subject included in the image to be corrected. The aforementioned determination means is The correction method corresponding to the type of subject identified among the correction methods selected by the user is determined as the correction method for correcting the captured image to be corrected. The imaging device according to feature 2.
4. The aforementioned determination means is If there are multiple correction methods corresponding to the identified type of subject, the correction method with the higher priority is determined as the correction method for correcting the captured image to be corrected. The imaging device according to feature 3.
5. The display control means is When the user selects a correction method from the aforementioned multiple correction methods, an example of the captured image corrected by the selected correction method will be displayed. The imaging apparatus according to feature 1.
6. A means for adding information indicating the correction method selected by the user to the metadata of the captured image to be corrected, The server device includes means for transmitting the captured image to be corrected, in which metadata is provided with information indicating the correction method selected by the user; The server device further includes receiving means for receiving the image to be corrected, which has been corrected based on the correction method selected by the user. The imaging apparatus according to feature 1.
7. An acquisition means for acquiring multiple attributes that include correction methods corresponding to the type of subject, and information on the correction methods included in each of the multiple attributes, A display control means that displays the multiple attributes in response to user operations, A receiving means for receiving an attribute selected by the user from among the aforementioned multiple attributes, An imaging device characterized by having the following features.
8. A determination means for determining a correction method for correcting the image to be corrected from the correction methods included in the attributes selected by the user, Correction means for correcting the captured image to be corrected using the determined correction method, The imaging apparatus according to claim 7, further comprising the above.
9. The system further includes a means for identifying the type of subject included in the image to be corrected. The determination means determines, as a correction method for correcting the captured image to be corrected, the correction method corresponding to the type of subject identified among the correction methods included in the attribute selected by the user. The imaging apparatus according to feature 8.
10. The information regarding the correction method includes information on parameters for correcting the captured image. The imaging apparatus according to feature 1.
11. It further has a display unit, The display control means displays the plurality of correction methods on the display unit in an order based on priority, along with information on the corresponding subject types. The imaging apparatus according to feature 1.
12. Receiving means for receiving an image to be corrected from the imaging device described in claim 6, the image having metadata that includes information indicating a correction method selected by the user, A determination means for determining a correction method for correcting the captured image to be corrected from the correction method selected by the user, Correction means for correcting the captured image to be corrected using the determined correction method, A transmission means for transmitting the corrected image to be corrected to the imaging device, An information processing device characterized by having the following features.
13. The system further includes a means for identifying the type of subject included in the image to be corrected. The aforementioned determination means is The correction method corresponding to the type of subject identified among the correction methods selected by the user is determined as the correction method for correcting the captured image to be corrected. The information processing apparatus according to feature 12.
14. A step of obtaining information on multiple correction methods for correcting an captured image, information indicating the type of subject corresponding to each of the multiple correction methods, and the priority associated with each of the multiple correction methods. The steps include: displaying the multiple correction methods in order based on priority, along with information on the corresponding subject type, in response to user operation; A step of accepting the correction method selected by the user from the displayed plurality of correction methods, A control method for an imaging device, characterized by having the following features.
15. A step of obtaining multiple attributes that include correction methods corresponding to the type of subject, and information on the correction methods included in each of the multiple attributes, The steps include displaying the multiple attributes in response to user actions, A step of receiving an attribute selected by the user from among the aforementioned multiple attributes, A control method for an imaging device, characterized by having the following features.
16. A program for causing a computer to execute each means of the imaging apparatus described in any one of claims 1 to 11.