Information processing device and method, and program

Abstract

The present disclosure relates to an information processing device and method and a program that make it possible to suppress a reduction in convenience. Some or all of captured image meta information is inherited as is or with an update, depending on the status of trimming on a captured image, to generate trimmed image meta information which is meta information of a trimmed image generated through the trimming. The present disclosure can be applied to, for example, an information processing device, an image processing device, an imaging device, an electronic apparatus, an information processing method, an image processing method, or a program.

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, method, and program, and more particularly to an information processing device, method, and program that can suppress a decrease in convenience. [Background technology]

[0002] In the past, it has been considered to add various meta information to captured images. It has also been considered to perform image editing such as trimming on captured images. For example, a process of extracting still image data from video data has been considered (see, for example, Patent Document 1). Patent Document 1 discloses adding meta information such as the file name of the original video and the position of the extracted frame to the extracted still image data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-105933 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the method described in Patent Document 1 does not allow the inheritance of meta information of the original video data, which is the content to be edited, nor does it allow the inheritance of updated meta information. As a result, the information before the image editing is lost in the meta information added to the edited image, which may reduce convenience.

[0005] The present disclosure has been made in view of such circumstances, and aims to make it possible to suppress a decrease in convenience. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present technology isof Captured image meta information, which is meta information updating AF frame information during playback, which is an image indicating an area including a focus position of the captured image, to a value according to an aspect ratio of a trimmed image generated by trimming the captured image, and including the updated AF frame information during playback; The information processing device includes a meta information generating unit that generates trimmed image meta information that is meta information of a trimmed image.

[0007] According to one aspect of the present technology, an information processing method includes: of Captured image meta information, which is meta information updating AF frame information during playback, which is an image indicating an area including a focus position of the captured image, to a value according to an aspect ratio of a trimmed image generated by trimming the captured image, and including the updated AF frame information during playback; The present invention relates to an information processing method for generating trimmed image meta information, which is meta information of a trimmed image.

[0008] A program according to one aspect of the present technology includes: of Captured image meta information, which is meta information updating AF frame information during playback, which is an image indicating an area including a focus position of the captured image, to a value according to an aspect ratio of a trimmed image generated by trimming the captured image, and including the updated AF frame information during playback; This is a program that functions as a meta information generating unit that generates trimmed image meta information, which is meta information of a trimmed image.

[0009] In one aspect of the present technology, an information processing device, a method, and a program include: Captured image of Captured image meta information, which is meta information AF frame information during playback, which is an image indicating an area including a focus position of the captured image, is updated to a value according to the aspect ratio of a trimmed image generated by trimming the captured image, and the updated AF frame information during playback is included. Trimmed image meta information, which is meta information of the trimmed image, is generated. [Brief explanation of the drawings]

[0010] [Figure 1] 10A and 10B are diagrams illustrating an example of a method for generating meta information in trimming. [Figure 2] FIG. 10 is a diagram illustrating an example of a method for generating meta information. [Figure 3] FIG. 10 is a diagram illustrating an example of a method for generating meta information. [Figure 4] FIG. 10 is a diagram illustrating an example of a method for updating a database. [Figure 5] FIG. 1 is a block diagram illustrating an example of the main configuration of an imaging device. [Figure 6] FIG. 10 is a diagram illustrating an example of a database. [Figure 7] 10 is a flowchart illustrating an example of the flow of an image editing process. [Figure 8] 10 is a flowchart illustrating an example of the flow of a meta information generation process. [Figure 9] FIG. 10 is a diagram illustrating an example of meta information. [Figure 10] FIG. 10 is a diagram illustrating an example of meta information. [Figure 11] FIG. 10 is a diagram illustrating an example of meta information. [Figure 12] FIG. 10 is a diagram illustrating an example of meta information. [Figure 13] FIG. 10 is a diagram illustrating an example of meta information. [Figure 14] FIG. 1 is a block diagram illustrating an example of the main configuration of a computer. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, modes for carrying out the present disclosure (hereinafter referred to as embodiments) will be described in the following order. 1.Generating Meta Information 2. First embodiment (imaging device) 3. Notes

[0012] <1. Meta information generation> <Image editing and meta information> In the past, it has been considered to add various meta information to a captured image. It has also been considered to perform image editing such as trimming on a captured image. In trimming, a partial area of ​​the image to be trimmed is extracted. The image of this extracted partial area is also called a trimmed image. For example, as shown in A of FIG. 1, a partial area 11A of a captured image 11, which is the image to be trimmed, is extracted to generate a trimmed image 12.

[0013] As described above, meta information may be added to the captured image 11, which is the image to be trimmed. Similarly, meta information may be added to the trimmed image 12 generated by trimming. For example, as shown in B of FIG. 1, a file 20 storing the captured image 11 also stores meta information 21 of the captured image. Similarly, when a trimmed image 12 is generated by the above-described trimming, its meta information 31 is generated, and a file 30 storing the trimmed image 12 and the meta information 31 is generated.

[0014] However, in the conventional method, the meta information 31 of the trimmed image is generated independently of the meta information 21 of the captured image 11. Therefore, there is no correlation between the meta information 31 and the meta information 21, and there is a risk that the information of the meta information 21 will be lost in the meta information 31. Therefore, it is difficult to transfer information included in the meta information 21 that is applicable to the captured image 11 and is also applicable to the trimmed image to the meta information 31. It is also difficult to update that information and transfer it to the meta information 31. For example, even if the focus position of the captured image 11 is included in the trimmed image 12, it is difficult to transfer information about that focus position included in the meta information 21 to the meta information 31 or to update and transfer it.

[0015] For example, Patent Document 1 discloses adding meta information, such as the file name of the original video and the position of the extracted frame, to extracted still image data. However, this information is related to the extraction process and only indicates how the still image data was generated. In other words, it does not disclose inheriting or updating the meta information of a video. While it is conceivable to refer to the meta information of a video from its file name, this is merely meta information for the video and there is no guarantee that it can be applied to still image data. Images change due to image editing. For example, the captured image 11 and the trimmed image 12 are not identical images. Therefore, it is not necessarily the case that all of the meta information of an image before image editing can be applied to an image after image editing without changing its values.

[0016] As described above, since it is difficult to take over meta information or to update and take over the meta information, it is not possible to refer to meta information that is useful for verifying the edited image (cropped image 12), which may reduce convenience. For example, since it is difficult to take over information about the focus position or to update and take over the meta information as described above, it is difficult to use information about the focus position when displaying the edited image (cropped image 12).

[0017] <Transfer of meta information according to image editing, etc.> Therefore, depending on the status of image editing (trimming), control is performed to take over meta information or update and take over meta information.

[0018] For example, an information processing device may be provided with a meta information generation unit that generates trimmed image meta information, which is meta information of a trimmed image generated by trimming, by inheriting or updating and inheriting part or all of the captured image meta information, which is meta information of the captured image, depending on the trimming status of the captured image.

[0019] For example, in an information processing method, depending on the trimming status of a captured image, part or all of the captured image meta information, which is meta information of the captured image, is inherited or updated and inherited, thereby generating trimmed image meta information, which is meta information of the trimmed image generated by the trimming.

[0020] For example, the program causes the computer to function as a meta information generation unit that generates cropped image meta information, which is meta information of the cropped image generated by the cropping, by inheriting or updating and inheriting part or all of the captured image meta information, which is meta information of the captured image, depending on the cropping status of the captured image.

[0021] <Handover> For example, as shown in A of Fig. 1, assume that a partial area 11A of a captured image 11 is cropped to generate a cropped image 12. In this case, depending on the cropping situation, meta information 41 included in the meta information 21 of the captured image 11 is inherited as meta information 31 of the cropped image 12, as shown in A of Fig. 2.

[0022] The "trimming status" may include not only whether or not to perform trimming, but also the trimming mode (how the trimming is performed). Furthermore, "inheriting" refers to adding to the trimmed image meta information with the same item name (tag name) and value as that added to the image to be trimmed. In other words, it refers to adding meta information with a certain item name (tag name) added to the image to be trimmed with the same value as that added to the trimmed image. The method of "inheriting" this meta information is arbitrary, as long as the result is meta information with the same item name (tag name) and value as that added to the image to be trimmed. For example, the meta information added to the image to be trimmed may be duplicated and added to the trimmed image. Furthermore, meta information with the same item name and value as the meta information added to the image to be trimmed may be duplicated from information other than the meta information added to the image to be trimmed, such as a database that manages meta information, and added to the trimmed image. Furthermore, new meta information with the same item name and value as the meta information added to the image to be trimmed may be generated and added to the trimmed image.

[0023] In the example of A in Fig. 2, meta information 41 is carried over. That is, meta information 31 includes meta information (i.e., meta information 41) having the same item names and values ​​as meta information included in meta information 21. This meta information 41 may be part or all of the meta information 21 of the captured image 11 (all of the meta information added to the captured image 11). Furthermore, this meta information 41 may be part or all of the meta information 31 of the trimmed image 12 (all of the meta information added to the trimmed image 12).

[0024] By inheriting the meta information in this way, it becomes possible to refer to meta information that is useful for verifying the edited image (trimmed image 12), for example. For example, by inheriting information about the image capture settings, it becomes possible to refer to the information about the image capture settings when verifying the edited image (trimmed image 12). Therefore, it is possible to suppress a decrease in convenience when using an image after image editing.

[0025] <Update and take over> Furthermore, depending on the trimming situation, as shown in FIG. 2B, the meta information 42A included in the meta information 21 of the captured image 11 is updated and taken over as the meta information 31 of the trimmed image 12.

[0026] "Updating and inheriting" refers to adding to the trimmed image meta information that has the same item name (tag name) but a different value than that added to the image to be trimmed. In other words, it refers to updating the value of the meta information for a certain item name (tag name) added to the image to be trimmed and adding it to the trimmed image. The method of "updating and inheriting" this meta information is arbitrary, as long as the result is meta information that has the same item name (tag name) but a different value than that added to the image to be trimmed. For example, the value of the meta information added to the image to be trimmed may be updated and added to the trimmed image. Alternatively, the meta information added to the image to be trimmed may be obtained from information other than the meta information added to the image to be trimmed, such as a database that manages meta information, and the value of the updated meta information may be added to the trimmed image. Furthermore, new meta information that has the same item name (tag name) but a different value than that added to the image to be trimmed may be generated and added to the trimmed image.

[0027] In the example of B in Fig. 2, the meta information 42A is updated and carried over as meta information 42B. That is, the meta information 31 includes meta information 42B having the same item name as the meta information 42A included in the meta information 21 but a different value. This meta information 42A may be part or all of the meta information 21 of the captured image 11 (all of the meta information added to the captured image 11). Furthermore, this meta information 42B may be part or all of the meta information 31 of the trimmed image 12 (all of the meta information added to the trimmed image 12).

[0028] By updating and inheriting the meta information in this way, it becomes possible to refer to meta information that is useful for verifying the edited image (trimmed image 12), for example. For example, by updating and inheriting information about the focus position, the information about the focus position can be used when displaying the edited image (trimmed image 12). Therefore, it is possible to suppress a decrease in convenience when using an image after image editing.

[0029] <Combination> Note that the above-mentioned "carrying over" and "updating and carrying over" of meta information can be used together. That is, part of the meta information of the image to be trimmed may be carried over as the meta information of the trimmed image, and other meta information may be updated and carried over. Also, part of the meta information of the image to be trimmed may be carried over as the meta information of the trimmed image, and other part of the meta information may be updated and carried over. That is, part of the meta information of the image to be trimmed may be deleted. This "deletion" means that the meta information is not carried over or updated and carried over, i.e., the meta information is not added to the trimmed image. It does not mean erasing the meta information added to the image to be trimmed. The meta information to be deleted is arbitrary.

[0030] <Addition> Furthermore, depending on the trimming situation, meta information 43 that is not included in the meta information 21 of the captured image 11 may be added as meta information 31 of the trimmed image 12, as shown in FIG. 2C.

[0031] "Adding" refers to adding, to the trimmed image, meta information of an item name (tag name) that is not included in the meta information added to the image to be trimmed. The method of "adding" this meta information is arbitrary, as long as the meta information of an item name (tag name) that is not added to the image to be trimmed is ultimately added to the trimmed image. For example, meta information that is not added to the image to be trimmed may be obtained from information other than the meta information added to the image to be trimmed, such as a database that manages meta information, and added to the trimmed image. Alternatively, new meta information of an item name (tag name) that is not added to the image to be trimmed may be generated and added to the trimmed image.

[0032] In the example of C in Fig. 2, the meta information 31 includes meta information 43 that is not included in the meta information 21. This meta information 43 may be a part or all of the meta information 31 of the trimmed image 12 (all of the meta information added to the trimmed image 12).

[0033] By adding meta information in this way, it becomes possible to refer to meta information that is useful for verifying the edited image (trimmed image 12), for example. For example, by adding information about trimming, when verifying the edited image (trimmed image 12), it becomes possible to use information about the trimming that is not included in the meta information of the image to be trimmed. Therefore, it is possible to suppress a decrease in convenience when using an image after image editing.

[0034] <Add to related content> Furthermore, the meta information added in this manner may be added not only to the trimmed image, but also to other content (also called related content) associated with the image to be trimmed. "Associating" here means making it possible to refer to one from the other. This method is arbitrary. For example, the contents may be associated with each other by adding the identification information of each content as meta information. Furthermore, a third party such as a database may manage the association between contents. This "association" of contents is also called "linking."

[0035] Any content may be associated. For example, multiple image data of the same image but in different formats (e.g., RAW data and JPEG (Joint Photographic Experts Group) data) may be associated with each other. Also, multiple images generated from the same image (e.g., multiple images subjected to different image processing) may be associated with each other. Furthermore, an image after image processing may be associated with an image before image processing. Also, multiple captured images generated in a single capture but with different wavelength ranges or components may be associated with each other. Furthermore, multiple captured images captured using a continuous shooting function may be associated with each other. Also, still images captured during video capture may be associated with the video. Also, the associated content may be any content other than images. For example, audio data, 3D data, etc. may be associated.

[0036] For example, suppose that file 20 and file 50 are associated with each other as indicated by the dotted double-headed arrow in Fig. 3. That is, suppose that captured image 11 and image 51 are associated with each other. Meta information 52 is added to image 51. That is, image 51 and meta information 52 are stored in file 50. Then, suppose that meta information 43 is added to cropped image 12 as in the example of C in Fig. 2.

[0037] In this case, as indicated by the dotted single arrow in Fig. 3, meta information 43 may also be added to image 51. In other words, meta information (i.e., meta information 43) having the same item name and value as that added to cropped image 12 is added to image 51.

[0038] By adding meta information to related content in this way, the added meta information (e.g., information about trimming) can also be confirmed in the related content. This can, for example, reduce the occurrence of duplicate work and improve the efficiency of confirmation work. In other words, it can prevent a decrease in convenience when using related content.

[0039] <Combination> This "addition" of meta information can be used in conjunction with the above-mentioned "takeover" of meta information. This "addition" of meta information can also be used in conjunction with the above-mentioned "update and takeover" of meta information. This "addition" of meta information can also be used in conjunction with the above-mentioned "takeover" and "update and takeover" of meta information.

[0040] That is, for example, part or all of the meta information of the image to be trimmed may be inherited as the meta information of the trimmed image, and new meta information may be added. Also, part or all of the meta information of the image to be trimmed may be updated and inherited as the meta information of the trimmed image, and new meta information may be added. Also, part of the meta information of the image to be trimmed may be inherited as the meta information of the trimmed image, other meta information may be updated and inherited, and new meta information may be added. Also, part of the meta information of the image to be trimmed may be inherited as the meta information of the trimmed image, other meta information may be updated and inherited, and new meta information may be added. That is, part of the meta information of the image to be trimmed may be deleted. These examples may also be combined with the addition of meta information to related content.

[0041] <Database update> Furthermore, if content is managed by a database, the results of image editing (trimming) may be reflected in the database. For example, when a trimmed image is generated as described above, the trimmed image may be newly registered in the database. Furthermore, in the database, the trimmed image may be associated with the image to be trimmed.

[0042] For example, as shown by arrow 61 in Fig. 4, it is assumed that file 20 has already been registered in database 60. Then, it is assumed that file 20 is subjected to image editing (e.g., cropping) to generate file 30. At this time, the generated file 30 may be newly registered in database 60, as shown by arrow 62. Furthermore, file 30 may be linked to file 20 in database 60.

[0043] This eliminates the need to manually update the database, making it easier to update the database. Therefore, content can be managed using the database without the need for complicated work, making content management easier. In other words, it is possible to prevent a decrease in the convenience of content management.

[0044] <Combination> This database update can be used in conjunction with at least one of the above-mentioned meta-information "takeover," "update and takeover," and "addition."

[0045] 2. First Embodiment <Imaging device> Fig. 5 is a block diagram showing an example of the configuration of an imaging device, which is one aspect of an information processing device to which the present technology is applied. The imaging device 100 shown in Fig. 5 is a device that captures an image of a subject, generates a captured image, and records or outputs the captured image. The imaging device 100 can also perform image editing such as trimming on the captured image. The present technology described above in <1. Generation of Meta Information> can be applied to the imaging device 100.

[0046] Note that Fig. 5 shows the main processing units, data flows, etc., and is not limited to all that are shown in Fig. 5. In other words, in the imaging device 100, there may be processing units that are not shown as blocks in Fig. 5, and there may be processing or data flows that are not shown as arrows, etc. in Fig. 5.

[0047] As shown in FIG. 5, the imaging device 100 has an imaging unit 111, an image storage unit 112, an encoding unit 113, a media access unit 114, a trimming processing control unit 115, a decoding unit 116, a display unit 117, a meta information update unit 118, and a set information storage unit 119.

[0048] The imaging device 100 also includes a bus 130 , a control unit 131 , an input unit 132 , and an output unit 133 .

[0049] The imaging unit 111 has, for example, an optical system such as a lens, an image sensor, etc., and captures an image of a subject to generate a captured image. The imaging unit 111 supplies the generated captured image to the image storage unit 112. The imaging unit 111 also generates meta information for the captured image and supplies it to the image storage unit 112.

[0050] The image storage unit 112 acquires the captured image (and its meta information) supplied from the imaging unit 111. The image storage unit 112 also acquires the trimmed image (trimming result) supplied from the trimming process control unit 115.

[0051] The image storage unit 112 also supplies the acquired captured image to the encoding unit 113, causes it to be encoded, and acquires the encoded data. The image storage unit 112 also supplies the acquired trimmed image to the encoding unit 113, causes it to be encoded, and acquires the encoded data.

[0052] Furthermore, the image storage unit 112 may have any storage medium and store content such as images in the storage medium. For example, the image storage unit 112 may generate a file that stores encoded data of a captured image and its meta information, and store the file in the storage medium. The image storage unit 112 may also generate a file that stores encoded data of a trimmed image and its meta information, and store the file in the storage medium.

[0053] The image storage unit 112 can then supply content such as images stored in the storage medium to other processing units. For example, in response to a request from the media access unit 114, the image storage unit 112 supplies encoded data of the stored captured image to the requesting media access unit 114. The image storage unit 112 also supplies the stored captured image and trimmed image together with their meta information (i.e., files storing them) to the output unit 133 via the bus 130.

[0054] Furthermore, for example, the image storage unit 112 supplies meta information of the captured image stored therein to the meta information update unit 118. Furthermore, the image storage unit 112 acquires meta information of the trimmed image generated by the meta information update unit 118.

[0055] The encoding unit 113 acquires an image (a captured image or a trimmed image) supplied from the image storage unit 112. The encoding unit 113 then encodes the acquired image using a predetermined encoding method to generate encoded data. The encoding unit 113 then supplies the generated encoded data to the image storage unit 112.

[0056] The media access unit 114 acquires the encoded data of the captured image stored in the image storage unit 112. Then, the media access unit 114 supplies the acquired encoded data to the trimming process control unit 115.

[0057] The trimming control unit 115 acquires encoded data of the captured image supplied from the media access unit 114. The trimming control unit 115 also supplies the acquired encoded data to the decoding unit 116 to cause it to be decoded. The trimming control unit 115 also acquires the captured image (decoded image) supplied from the decoding unit 116.

[0058] The trimming process control unit 115 performs trimming on the captured image as an image to be trimmed, and generates a trimmed image. At this time, the trimming process control unit 115 can perform trimming in accordance with user instructions or the like.

[0059] At this time, the trimming process control unit 115 can supply the image to be trimmed and the trimmed image to the display unit 117 to display them. The trimming process control unit 115 also supplies the generated trimmed image to the image storage unit 112.

[0060] The decoding unit 116 acquires coded data of an image to be trimmed (e.g., a captured image) supplied from the trimming process control unit 115. The decoding unit 116 decodes the acquired coded data using a decoding method corresponding to the coding method of the coding unit 113, and generates a decoded image (image to be trimmed (e.g., a captured image)). The decoding unit 116 supplies the generated decoded image to the trimming process control unit 115.

[0061] The display unit 117 has a display device (monitor) such as an LCD (Liquid Crystal Display) and can display images, etc. For example, the display unit 117 acquires the captured image and the trimmed image supplied from the trimming process control unit 115 and displays them on the monitor.

[0062] The meta information update unit 118 generates meta information to be added to the trimmed image. At this time, the meta information update unit 118 generates the meta information by applying the present technology described above in <1. Generation of Meta Information>.

[0063] For example, the meta information update unit 118 acquires meta information of the image to be trimmed (captured image) supplied from the image storage unit 112. Then, the meta information update unit 118 generates meta information of the trimmed image by inheriting part or all of the acquired meta information according to the trimming status. Also, for example, the meta information update unit 118 generates meta information of the trimmed image by updating and inheriting part or all of the acquired meta information according to the trimming status. In this case, the meta information update unit 118 can also acquire set information stored in the set information storage unit 119 and update the meta information based on the set information.

[0064] Furthermore, for example, the meta information update unit 118 generates new meta information according to the trimming situation and adds it to the meta information of the trimmed image. At this time, the meta information update unit 118 can also add the generated meta information to the meta information of the related content of the image to be trimmed.

[0065] In this way, by the meta information update unit 118 applying the present technology described above in <1. Generation of meta information> to generate meta information to be added to the cropped image, the imaging device 100 can suppress a decrease in convenience.

[0066] The meta information updating section 118 may combine these methods as appropriate. The meta information updating section 118 supplies the image storage section 112 with the meta information of the trimmed image generated as described above.

[0067] The set information storage unit 119 has any storage medium and stores set information. The content of this set information is arbitrary. For example, it may be the date and time of trimming, the name of the software that performed the trimming, or other information. The set information storage unit 119 supplies the stored set information to the meta information update unit 118 as appropriate.

[0068] The control unit 131 is connected to each processing unit, from the imaging unit 111 to the set information storage unit 119, as well as the input unit 132 and output unit 133, via the bus 130, and controls them.

[0069] The input unit 132 has any input device such as a touch panel or a switch, and receives external instructions from a user, etc. The input unit 132 supplies the received external instructions to the control unit 131. The control unit 131 controls each processing unit in accordance with the external instructions.

[0070] The output unit 133 has at least one of an output device such as an output terminal, a drive for a removable recording medium, a communication unit, etc., and can output content such as images to the outside of the imaging device 100. For example, the output unit 133 obtains content (for example, files of captured images or trimmed images) supplied from the image storage unit 112, and records it on a removable recording medium or transmits it to another device via a communication medium.

[0071] <Database> Furthermore, the image storage unit 112 can construct a database and use the database to manage the stored content. For example, as shown in Fig. 6, the image storage unit 112 constructs and stores an AVIndex 210, which is a database for managing content. Information (content information 211) about each of the content 201 stored in the image storage unit 112 is registered in this AVIndex 210. In other words, the content 201 stored in the image storage unit 112 is managed by this AVIndex 210.

[0072] The content of the content information 211 is arbitrary. For example, as shown in Fig. 6, it may include at least one of the following: number information, file name, content type, file size, shooting time, continuous shooting grouping information, FTP transfer status, and content link information.

[0073] By managing content using such a database (AVIndex 210), the image storage unit 112 can easily manage content without the need for cumbersome tasks such as referencing a large amount of content in the storage medium one by one, thereby reducing the time required for searching and counting.

[0074] The continuous shooting grouping information is an example of grouping information that groups multiple contents. The grouping information indicates identification information of a group to which the content corresponding to the content information 211 belongs. The continuous shooting grouping information is information that groups multiple captured images generated using the continuous shooting function of the imaging device 100 (imaging unit 111). Of course, the content information 211 may include grouping information other than the continuous shooting grouping information.

[0075] The content link information is information for associating content with one another. For example, the database (AVIndex 210) can associate RAW data and JPEG data of the same image using this content link information.

[0076] The database (AVIndex 210) can also manage information that is not contained in a single piece of content, such as grouping information, FTP transfer status, and content link information.

[0077] By expanding such a database (AVIndex 210) on RAM (Random Access Memory), the image storage unit 112 can perform searches and counting at high speed.

[0078] When constructing such a database (AVIndex210), the image storage unit 112 can manage content by applying the present technology described above in <1. Generation of Meta Information>. That is, the image storage unit 112 may update this database (AVIndex210) when trimming, and reflect the results of image editing (trimming) in this database (AVIndex210).

[0079] For example, the image storage unit 112 may newly register the trimmed image in the database (AVIndex210). Also, the trimmed image may be associated with the image to be trimmed (captured image) in the database (AVIndex210). For example, the image storage unit 112 may set information (e.g., grouping information, content link information, etc.) that associates the trimmed image with the captured image in the database (AVIndex210).

[0080] This makes updating the database easier, as it eliminates the need to manually update the database.

[0081] <Image editing process flow> Next, a description will be given of the processing executed by the imaging device 100. The imaging device 100 performs image editing processing to perform, for example, trimming on a captured image. An example of the flow of this image editing processing will be described with reference to the flowchart in FIG.

[0082] When the image editing process is started, in step S101, the media access unit 114 of the imaging device 100 acquires (encoded data of) the captured image stored in the image storage unit 112 as an image to be trimmed. The media access unit 114 supplies the acquired encoded data of the captured image to the trimming process control unit 115.

[0083] In step S102, the decoding unit 116 decodes the encoded data of the captured image (image to be trimmed) to generate a captured image.

[0084] In step S103, the display unit 117 displays the image to be trimmed (captured image) on the monitor as a trimming preview image.

[0085] In step S104, the trimming process control unit 115 receives a user instruction via the input unit 132, for example, to set the position and range of trimming.

[0086] In step S105, the trimming process control unit 115 determines whether or not to perform trimming based on a user instruction or the like received via the input unit 132. If it is determined that trimming is not to be performed, the process returns to step S103, and the subsequent processes are repeated.

[0087] In step S105, if it is determined that trimming is to be performed, for example, because the user has input an instruction to perform trimming, the process proceeds to step S106.

[0088] In step S106, the trimming process control unit 115 extracts the area of ​​the set position and range from the image to be trimmed (i.e., performs trimming on the image to be trimmed) and generates a trimmed image. The trimming process control unit 115 supplies the generated trimmed image to the image storage unit 112.

[0089] In step S107, the encoding unit 113 acquires and encodes the trimmed image to generate encoded data of the trimmed image.

[0090] In step S108, the meta information update unit 118 executes a meta information generation process to generate meta information of the trimmed image according to the status of the trimming process (step S106).

[0091] In step S109, the image storage unit 112 adds the meta information generated in step S108 to the trimmed image generated in step S106 and stores the image. For example, the image storage unit 112 generates a file that stores the trimmed image generated in step S106 and the meta information generated in step S108, and stores the file.

[0092] In step S110, the image storage unit 112 updates a database that manages content according to the status of the trimming process (step S106). For example, the image storage unit 112 newly registers the trimmed image generated by the trimming process (step S106) in the database. The image storage unit 112 may also associate the trimmed image with the image to be trimmed in the database.

[0093] When the process of step S110 is completed, the image editing process ends.

[0094] <Meta information generation process flow> Next, an example of the flow of the meta information generation process executed in step S108 of FIG. 7 will be described with reference to the flowchart of FIG.

[0095] When the meta information generation process is started, in step S151 the meta information update unit 118 generates meta information for the trimmed image by inheriting part or all of the meta information of the image to be trimmed, depending on the status of the trimming process.

[0096] In step S152, the meta information update unit 118 updates and takes over part or all of the meta information of the image to be trimmed according to the state of the trimming process, thereby generating meta information of the trimmed image.

[0097] In step S153, the meta information update unit 118 generates meta information of the trimmed image by adding meta information that is not included in the meta information of the image to be trimmed, depending on the status of the trimming process.

[0098] In step S154, the meta information update unit 118 adds the meta information added in step S153 to the meta information of the related content of the image to be trimmed. Note that if no meta information is added in step S153, this process is omitted. Also, if there is no related content for the image to be trimmed, this process is omitted.

[0099] When the process of step S154 ends, the meta information generation process ends, and the process returns to FIG.

[0100] By performing each process as described above, the imaging device 100 can prevent a decrease in convenience.

[0101] <Meta information details: Transfer> Fig. 9 is a diagram showing an example of meta information of an image to be trimmed that is inherited depending on the status of the trimming process in step S151 in Fig. 8. By inheriting meta information, for example, it is possible to refer to meta information that is useful for verifying the edited image (trimmed image 12), and it is possible to prevent a decrease in convenience when using the trimmed image.

[0102] For example, as shown in the second to fifth rows from the top of the table in Fig. 9, tag name information such as Exif Version, Artist, DateTimeOriginal, DateTimeDigitized, etc. may be carried over. Exif Version is meta information indicating Exif version information. Artist is meta information indicating the creator. DateTimeOriginal is meta information indicating the date and time when the original image data was created. DateTimeDigitized is meta information indicating the date and time when the digital data was created. This information is stored in Exif (Exchangeable Image File Format).

[0103] By inheriting this information, for example, it is possible to refer to this information when verifying the edited image (trimmed image 12), and it is possible to suppress a decrease in convenience when using the trimmed image.

[0104] Also, for example, imaging-related information, which is information related to imaging, may be inherited. That is, the meta information of the captured image (also referred to as captured image meta information) that is the image to be trimmed includes imaging-related information, which is information related to imaging, and the meta information update unit 118 generates meta information of the trimmed image (also referred to as trimmed image meta information) that includes imaging-related information of the same value as that of the captured image meta information.

[0105] By doing so, for example, when verifying the edited image (trimmed image 12), the imaging-related information can be referred to, and a decrease in convenience when using the trimmed image can be suppressed.

[0106] As this imaging-related information, for example, information with tag names such as ExposureTime, FNumber, ShutterSpeedValue, ApertureValue, BrightnessValue, ExposureBiasValue, MeteringMode, LightSource, Flash, and FocalLength may be carried over, as shown in the sixth to fifteenth rows from the top of the table in FIG. 9 . ExposureTime is meta information indicating the exposure time. FNumber is meta information indicating the F-number. ShutterSpeedValue is meta information indicating the shutter speed. ApertureValue is meta information indicating the aperture value. BrightnessValue is meta information indicating the brightness value. ExposureBiasValue is meta information indicating the exposure bias value. MeteringMode is meta information indicating the photometry method. LightSource is meta information indicating the light source. Flash is meta information indicating the flash setting. FocalLength is meta information indicating the lens focal length. This information is stored in Exif.

[0107] By inheriting this information, for example, it is possible to refer to this information when verifying the edited image (trimmed image 12), and it is possible to suppress a decrease in convenience when using the trimmed image.

[0108] In addition, for example, the image processing information may be inherited. That is, the captured image meta information of the image to be trimmed includes image processing information, and the meta information update unit 118 generates trimmed image meta information that includes image processing information of the same value as that of the captured image meta information.

[0109] By doing so, for example, the image processing information can be referenced when verifying the edited image (trimmed image 12), and the reduction in convenience when using the trimmed image can be suppressed.

[0110] As this image processing information, for example, information with tag names such as CustomRendered and Orientation may be carried over, as shown in the 16th and 17th rows from the top of the table in Fig. 9. CustomRendered is meta information indicating individual image processing. Orientation is meta information indicating the image orientation. This information is stored in Exif.

[0111] By inheriting this information, for example, it is possible to refer to this information when verifying the edited image (trimmed image 12), and it is possible to suppress a decrease in convenience when using the trimmed image.

[0112] Furthermore, as this image processing information, for example, information with tag names such as ContrastAdjust, SaturationAdjust, SaturationAdjust, LightnessAdjust, ShadowAdjust, HighlightAdjust, FadeAdjust, and FinenessAdjust may be carried over, as shown in the 18th to 25th rows from the top of the table in FIG. 9. ContrastAdjust is meta information indicating contrast. SaturationAdjust is meta information indicating saturation. SaturationAdjust is meta information indicating sharpness. LightnessAdjust is meta information indicating brightness. ShadowAdjust is meta information indicating a shadow setting. HighlightAdjust is meta information indicating a highlight setting. FadeAdjust is meta information indicating a fade setting. FinenessAdjust is meta information indicating a fineness setting. This information is stored in the Exif maker note (ExifMakerNote).

[0113] By inheriting this information, for example, it is possible to refer to this information when verifying the edited image (trimmed image 12), and it is possible to suppress a decrease in convenience when using the trimmed image.

[0114] Also, for example, as shown in the bottom row of the table in Figure 9, information in the tag name IPTC may be inherited. IPTC is meta information that indicates copyright information. In other words, in this case, the copyright information inherits the information of the source, and information about the person who performed the trimming is not added. This information is stored in XMP.

[0115] By inheriting this information, for example, this information can be referenced when verifying the edited image (trimmed image 12), and the reduction in convenience when using the trimmed image can be suppressed.

[0116] <Meta information details: Update with set information and take over> Fig. 10 is a diagram showing an example of meta information of an image to be trimmed that is updated and inherited using set information according to the status of the trimming process in step S152 of Fig. 8. By updating and inheriting the meta information, for example, useful meta information corresponding to the trimmed image can be referenced when verifying the edited image (trimmed image 12), and a decrease in convenience when using the trimmed image can be suppressed.

[0117] For example, as shown in the second and third rows from the top of the table in Fig. 10, tag name information such as DateTime and Software may be carried over. DateTime is meta information indicating the file update date and time. Software is meta information indicating the software name. This information is stored in Exif.

[0118] For example, the meta information update unit 118 updates the value of DateTime to the time when trimming was performed based on the set information read from the set information storage unit 119. Furthermore, the meta information update unit 118 updates the value of Software to the name of the software that performed trimming based on the set information read from the set information storage unit 119.

[0119] In other words, the captured image meta information includes at least one of the following: update date and time information, which indicates the update date and time of the file and in which the update date and time of the captured image is set; and software name information, which indicates the name of the software that generated the file in which the captured image is stored and in which the name of the software that generated the file in which the captured image is stored is set; and the meta information update unit 118 may generate cropped image meta information that includes at least one of update date and time information, the value of which has been updated to the generation date and time of the cropped image, and software name information, the value of which has been updated to the name of the software that performed the cropping.

[0120] By updating and inheriting this information as described above, for example, when verifying an edited image (cropped image 12), it is possible to refer to this information that has been updated to correspond to the cropped image, thereby preventing a decrease in convenience when using the cropped image.

[0121] <Meta information details: Update and take over> Fig. 11 is a diagram showing an example of meta information of an image to be trimmed that is updated and carried over depending on the status of the trimming process in step S152 of Fig. 8. By updating and carrying over the meta information, for example, when verifying an edited image (trimmed image 12), it is possible to refer to useful meta information corresponding to the trimmed image, and it is possible to prevent a decrease in convenience when using the trimmed image.

[0122] For example, information indicating the size of the image may be inherited. That is, the captured image meta information includes actual image width information, which is information indicating the width of the image and in which the width of the captured image is set, and actual image height information, which is information indicating the height of the image and in which the height of the captured image is set, and the meta information update unit 118 generates trimmed image meta information that includes the actual image width information, the value of which has been updated to the width of the trimmed image, and the actual image height information, the value of which has been updated to the height of the trimmed image.

[0123] For example, as shown in the second and third rows from the top of the table in Fig. 11, tag name information such as Pixel X Dimension and Pixel Y Dimension may be carried over. Pixel X Dimension is effective image width information. Pixel Y Dimension is effective image height information. This information is stored in Exif.

[0124] For example, the meta information update unit 118 updates the value of the Pixel X Dimension to the width of the trimmed image, and updates the value of the Pixel Y Dimension to the height of the trimmed image.

[0125] By updating and inheriting this information as described above, for example, when verifying an edited image (cropped image 12), it is possible to refer to this information that has been updated to correspond to the cropped image, thereby preventing a decrease in convenience when using the cropped image.

[0126] For example, information about the compression rate of image compression may be inherited. That is, the captured image meta information is information about the compression rate of image compression, and includes compression rate information in which the compression rate of the captured image is set, and the meta information update unit 118 generates trimmed image meta information including compression rate information whose value has been updated to the compression rate of the trimmed image.

[0127] For example, as shown in the fourth row of the table in Figure 11, information with the tag name CompressedBitsPerPixel may be inherited. CompressedBitsPerPixel is information that indicates the compression mode set when compressing an image, expressed as file size divided by the number of pixels. This information is stored in Exif.

[0128] For example, the meta information update unit 118 updates the value of CompressedBitsPerPixel to the compression mode of the trimmed image (file size / number of pixels).

[0129] By updating and inheriting this information as described above, for example, when verifying an edited image (cropped image 12), this information updated to correspond to the cropped image can be referenced, thereby preventing a decrease in convenience when using the cropped image.

[0130] For example, information indicating the position of the AF area, which is an area where autofocus has operated, may be inherited. That is, the captured image meta information is information indicating the position of the AF area, which is an area where autofocus has operated, and includes AF area position information in which the position of the AF area in the captured image is set, and when the reference point of the AF area in the captured image is located within the trimmed image, the meta information update unit 118 generates trimmed image meta information including AF area position information whose value has been updated to the position of the AF area in the trimmed image.

[0131] For example, as shown in the fifth row from the top of the table in Figure 11, information with the tag name AF Area Position may be carried over. AF Area Position is AF area position information that indicates the position of the AF area. AF area position is a normalized coordinate regardless of the size of the image. This information is stored in the Exif maker note (ExifMakerNote).

[0132] For example, if the AF Area Position coordinates are located within the cropping range, the meta information update unit 118 updates the value of the AF area position to match the cropping range (i.e., the cropped image). On the other hand, if the AF Area Position coordinates are located outside the cropping range, the meta information update unit 118 deletes the AF area position (does not include the AF area position in the cropped image meta information).

[0133] By updating and inheriting this information as described above, for example, when verifying an edited image (trimmed image 12), the information updated to correspond to the trimmed image can be referenced, and a decrease in convenience when using the trimmed image can be suppressed. For example, even if the original image is lost and only the trimmed image remains, the AF area position of the trimmed image can be used to analyze the position of the AF area.

[0134] For example, information indicating the focus position may be inherited. That is, the captured image meta information is information indicating the focus position and includes focus position information in which the focus position in the captured image is set, and when the focus position in the captured image is located within the trimmed image, the meta information update unit 118 generates trimmed image meta information including focus position information whose value has been updated to the focus position in the trimmed image.

[0135] For example, as shown in the sixth row from the top of the table in Fig. 11, information with the tag name FocusPoint may be carried over. FocusPoint is focus position information that indicates the focus position. FocusPoint changes depending on the size of the image. This information is stored in the Exif maker note (ExifMakerNote).

[0136] For example, if the FocusPoint coordinates are located within the trimming range, the meta information update unit 118 updates the value of the FocusPoint to match the trimming range (i.e., the trimmed image). On the other hand, if the FocusPoint coordinates are located outside the trimming range, the meta information update unit 118 deletes the FocusPoint (does not include the FocusPoint in the trimmed image meta information).

[0137] By updating and inheriting this information as described above, for example, when verifying an edited image (trimmed image 12), the information updated to correspond to the trimmed image can be referenced, and a decrease in convenience when using the trimmed image can be suppressed. For example, even if the original image is lost and only the trimmed image remains, the focus position can be analyzed using the FocusPoint of the trimmed image.

[0138] For example, information indicating the AF frame during playback may be inherited. That is, the captured image meta information is information related to playback of the AF frame, which is an image indicating an area including a focus position, and includes playback AF frame information in which information related to playback of the AF frame for the captured image is set, and the meta information update unit 118 generates trimmed image meta information including playback AF frame information updated to a value according to the aspect ratio of the trimmed image.

[0139] For example, as shown in the seventh row from the top of the table in Fig. 11, information with the tag name AF Area PBInfo may be carried over. AF Area PBInfo is playback AF frame information related to playback of the AF frame, which is an image indicating the area including the in-focus position. This information is stored in the Exif maker note (ExifMakerNote).

[0140] Generally, an imaging device generates a captured image with a landscape aspect ratio. To generate a portrait-oriented captured image, the imaging device is tilted while capturing the image, but even in this case, the captured image actually generated remains landscape. Rotation information at the time of capturing is recorded, and the landscape-oriented captured image is rotated and displayed based on the rotation information, thereby displaying the portrait-oriented captured image.

[0141] For example, when a captured image is cropped, the rotation information is deleted. For example, when cropping is performed with a portrait aspect ratio, a portrait-oriented cropped image is actually generated.

[0142] As described above, since a captured image is horizontally long, an AF frame for the captured image is generally generated horizontally. When a captured image is displayed as a vertically long image as described above, the AF frame is also displayed rotated in the same manner as the captured image. Therefore, an AF frame with an aspect ratio suitable for the aspect ratio of the captured image can be displayed.

[0143] However, as mentioned above, the cropped image is actually a vertically oriented image and is not rotated when displayed. Therefore, if the AF frame of the captured image is displayed as is, a horizontally oriented AF frame will be displayed for the vertically oriented cropped image, which will result in a mismatch with the aspect ratio of the cropped image.

[0144] Therefore, the aspect ratio of the AF frame is updated to match the aspect ratio of the trimmed image. For example, when trimming is performed in a horizontally elongated range, the meta information update unit 118 inherits the AF Area PBInfo of the captured image meta information. On the other hand, when trimming is performed in a vertically elongated range, the meta information update unit 118 swaps the width and height of the AF frame size set in the AF Area PBInfo of the captured image meta information. In this way, it is possible to display an AF frame that corresponds to the aspect ratio of the trimmed image.

[0145] Note that if the reference point (e.g., the center) of the AF frame is located outside the trimming range, the meta information update unit 118 may update and continue the value of AF Area PBInfo so as to omit display of the AF frame. Also, if the entire AF frame is located outside the trimming range, the meta information update unit 118 may update and continue the value of AF Area PBInfo so as to omit display of the AF frame. In other words, if part of the AF frame is located within the trimming range, the value of AF Area PBInfo is updated so that the AF frame is displayed. In that case, the AF frame is displayed extending into the black band outside the image.

[0146] By updating and carrying over this information as described above, for example, when displaying an edited image (trimmed image 12), an AF frame corresponding to the aspect ratio of the trimmed image can be displayed. For example, to check whether the focus was adjusted to the intended position after capturing a still image, the AF frame display is displayed during image playback. The AF frame display at that time can be made to correspond to the aspect ratio of the trimmed image. In other words, it is possible to prevent a decrease in convenience when using trimmed images.

[0147] For example, information indicating a screen nail may be inherited. That is, the captured image meta information is information indicating a screen nail and includes screen nail information in which a value indicating the screen nail of the captured image is set, and when the data size of the trimmed image is equal to or larger than a predetermined threshold, the meta information update unit 118 generates trimmed image meta information including screen nail information updated to the value indicating the screen nail of the trimmed image.

[0148] For example, as shown in the eighth row from the top of the table in Fig. 11, information with the tag name ScreenNailInfo may be inherited. ScreenNailInfo is screen nail information that indicates the screen nail. This information is stored in the Exif maker note (ExifMakerNote).

[0149] For example, if the image size is large, the screennail is displayed first, and then the actual image is displayed. Also, when transferring to a smartphone, the screennail can be sent first. The screennail is included in the JPEG structure. For example, one image contains three images: the actual image, the screennail, and a thumbnail. If a screennail does not exist, the actual image can be resized and output instead of the screennail.

[0150] For example, if the trimmed image is 4 MB or more, the meta information update unit 118 takes over this ScreenNailInfo. On the other hand, if the trimmed image is less than 4 MB, the meta information update unit 118 deletes this ScreenNailInfo.

[0151] By updating and inheriting this information as described above, for example, when displaying the edited image (trimmed image 12), it is possible to use a screennail updated to correspond to the trimmed image. Therefore, it is possible to prevent a decrease in convenience when using the trimmed image.

[0152] For example, information indicating the size (width and height) of the screen nail may be inherited. That is, the captured image meta information is information indicating the size of the screen nail and includes screen nail size information in which the size of the screen nail of the captured image is set, and when the data size of the trimmed image is equal to or larger than a predetermined threshold, the meta information update unit 118 generates trimmed image meta information including screen nail size information whose value has been updated to the size of the screen nail of the trimmed image.

[0153] For example, as shown in the ninth row from the top of the table in Fig. 11, information under the tag name Screennail Width / Height may be carried over. Screennail Width / Height is screennail size information that indicates the size (width and height) of the screennail. This information is stored in the Exif maker note (ExifMakerNote).

[0154] As described above, a screennail is set for the trimmed image only if the trimmed image is 4 MB or larger. Therefore, the screennail size information is also inherited only if the trimmed image is 4 MB or larger. In other words, if the trimmed image is 4 MB or larger, the meta information update unit 118 inherits the Screennail Width / Height. On the other hand, if the trimmed image is less than 4 MB, the meta information update unit 118 deletes the Screennail Width / Height.

[0155] By updating and inheriting this information as described above, for example, when displaying the edited image (trimmed image 12), it is possible to use a screennail updated to correspond to the trimmed image. Therefore, it is possible to prevent a decrease in convenience when using the trimmed image.

[0156] For example, information indicating the size (width and height) of the developed image may be inherited. That is, the captured image meta information is information regarding the size of the developed image and includes developed image size information in which the size of the captured image after development processing is set, and the meta information update unit 118 generates trimmed image meta information including developed image size information whose value has been updated to the size of the trimmed image after development processing.

[0157] For example, as shown in the tenth row from the top of the table in Fig. 11, information under the tag name DevelopedJpegWidth / Height may be carried over. DevelopedJpegWidth / Height is developed image size information that indicates the size (width and height) of the developed image. This information is stored in the Exif maker note (ExifMakerNote).

[0158] The meta information update unit 118 updates the DevelopedJpegWidth / Height to the size of the cropped image after development processing and takes over the updated DevelopedJpegWidth / Height.

[0159] By updating and inheriting this information as described above, for example, when verifying an edited image (cropped image 12), this information updated to correspond to the cropped image can be referenced, thereby preventing a decrease in convenience when using the cropped image.

[0160] For example, information on the image quality mode may be inherited. That is, the captured image meta information is information on the image quality mode and includes image quality mode information in which the captured image mode is set, and the meta information update unit 118 generates trimmed image meta information including image quality mode information whose value has been updated to the trimmed image mode.

[0161] For example, as shown in the 11th row from the top of the table in Fig. 11, information under the tag name Image Quality / Picture Quality may be carried over. Image Quality / Picture Quality is information about the image quality mode. For example, information indicating the compression method, compression rate, etc. may be included. This information is stored in the Exif maker note (ExifMakerNote).

[0162] For example, when the image quality of the trimmed image is changed from that of the image to be trimmed, the meta information update unit 118 updates the values ​​of the Image Quality / Picture Quality to the image quality mode of the trimmed image and inherits them. On the other hand, when the image quality of the trimmed image is to be the same as that of the image to be trimmed (when the image quality cannot be changed before and after trimming), the meta information update unit 118 inherits the Image Quality / Picture Quality included in the captured image meta information.

[0163] By updating and inheriting this information as described above, for example, it is possible to generate a trimmed image with a desired image quality, and it is possible to suppress a decrease in convenience when using the trimmed image.

[0164] <Meta information details: deleted> FIG. 12 is a diagram showing an example of meta information of an image to be trimmed that will be deleted (not carried over). For example, as shown in the second to fourth rows from the top of the table in FIG. 12, tag name information such as Rating, VoiceTag, and UMID may be deleted. Rating is meta information indicating rating information. VoiceTag Rating is meta information indicating a voice memo. UMID Rating is meta information indicating an individual identifier. Rating is stored in XMP. VoiceTag Rating is stored in DCF. UMID is stored in the Exif maker note (ExifMakerNote).

[0165] By deleting this information as described above, it is possible to prevent unnecessary information from being included in the trimmed image meta information, thereby preventing a decrease in convenience when using the trimmed image.

[0166] <Meta information details: added> 13 is a diagram showing an example of meta information added depending on the status of the trimming process in steps S153 and S154 of FIG. 8. By adding meta information, meta information not included in the image to be trimmed can be added to the trimmed image. This makes it possible to refer to useful meta information corresponding to the trimmed image when verifying the edited image (trimmed image 12), for example, and prevents a decrease in convenience when using the trimmed image.

[0167] For example, information relating to trimming may be added. That is, the meta information updating section 118 adds trimming information, which is information relating to trimming and is not included in the captured image meta information, to the trimmed image meta information.

[0168] For example, information with the tag name TrimmingInfo may be added as shown in the second row from the top of the table in Fig. 13. TrimmingInfo is meta information related to trimming. TrimmingInfo is stored in the Exif maker note (ExifMakerNote).

[0169] By adding such information, for example, when verifying an edited image (cropped image 12), it is possible to refer to information not included in the captured image meta information, thereby preventing a decrease in convenience when using cropped images.

[0170] For example, the trimming information may include at least one of information indicating whether trimming has been performed, information regarding the size of the image to be trimmed, information regarding the rotation of the image to be trimmed, information regarding the position of the starting point of the trimming, and information regarding the range of the trimming.

[0171] For example, as shown in the second row from the top of the table in Figure 13, TrimmingInfo may include at least one of information indicating whether trimming is performed, information indicating the size (width and height) of the original image (image to be trimmed), rotation information of the original image, the starting coordinates (X, Y) of the trimming, and information indicating the trimming range for the original image.

[0172] By adding such information, for example, when verifying an edited image (trimmed image 12), various information related to trimming can be referenced, and the reduction in convenience when using the trimmed image can be suppressed.

[0173] <3. Notes> <Application example> Although trimming has been used as an example of editing processing (processing) in the above description, the present technology is not limited to trimming and can be applied to any editing processing (processing).

[0174] The image to which the meta information is added may be a still image or a moving image, and the content to which the meta information is added may be something other than an image, such as audio.

[0175] Furthermore, the image to be trimmed may be something other than a captured image. For example, a trimmed image generated by trimming a captured image in the past may be used as the image to be trimmed. Furthermore, the image to be trimmed is not limited to a captured image, and may be a CG image.

[0176] <Computer> The above-described series of processes can be executed by hardware or software. When the series of processes is executed by software, the programs constituting the software are installed on a computer. Here, the term "computer" includes computers built into dedicated hardware, and general-purpose personal computers, etc., that can execute various functions by installing various programs.

[0177] FIG. 14 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processes by a program.

[0178] In a computer 900 shown in FIG. 14, a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, and a RAM (Random Access Memory) 903 are interconnected via a bus 904.

[0179] An input / output interface 910 is also connected to the bus 904. To the input / output interface 910, an input unit 911, an output unit 912, a storage unit 913, a communication unit 914, and a drive 915 are connected.

[0180] The input unit 911 includes, for example, a keyboard, a mouse, a microphone, a touch panel, an input terminal, etc. The output unit 912 includes, for example, a display, a speaker, an output terminal, etc. The storage unit 913 includes, for example, a hard disk, a RAM disk, a non-volatile memory, etc. The communication unit 914 includes, for example, a network interface. The drive 915 drives a removable recording medium 921 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0181] In a computer configured as above, the CPU 901 performs the above-described series of processes by, for example, loading a program stored in the storage unit 913 into the RAM 903 via the input / output interface 910 and the bus 904 and executing the program. The RAM 903 also stores data necessary for the CPU 901 to execute various processes as appropriate.

[0182] The program executed by the computer can be applied by recording it on a removable recording medium 921 such as a package medium, for example. In this case, the program can be installed in the storage unit 913 via the input / output interface 910 by inserting the removable recording medium 921 into the drive 915.

[0183] This program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, digital satellite broadcasting, etc. In this case, the program can be received by the communication unit 914 and installed in the storage unit 913.

[0184] Alternatively, this program can be installed in advance in the ROM 902 or the storage unit 913 .

[0185] <Applicable targets of this technology> The present technology can be applied to any configuration, for example, any electronic device.

[0186] Furthermore, for example, the present technology can also be implemented as a part of an apparatus, such as a processor (e.g., a video processor) as a system LSI (Large Scale Integration), a module (e.g., a video module) using multiple processors, a unit (e.g., a video unit) using multiple modules, or a set in which other functions are added to a unit (e.g., a video set).

[0187] Furthermore, for example, the present technology can also be applied to a network system configured with multiple devices. For example, the present technology may be implemented as cloud computing in which multiple devices share and collaborate on processing via a network. For example, the present technology may be implemented in a cloud service that provides image (video)-related services to any terminal, such as a computer, AV (Audio Visual) equipment, a portable information processing terminal, or an IoT (Internet of Things) device.

[0188] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.

[0189] <Fields and uses where this technology can be applied> Systems, devices, processing units, etc. to which the present technology is applied can be used in any field, for example, transportation, medical care, crime prevention, agriculture, livestock farming, mining, beauty, factories, home appliances, weather, nature monitoring, etc. In addition, their uses are also arbitrary.

[0190] <Other> The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present technology.

[0191] For example, a configuration described as one device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit). Of course, configurations other than those described above may be added to the configuration of each device (or each processing unit). Furthermore, as long as the configuration and operation of the entire system are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).

[0192] Furthermore, for example, the above-described program may be executed in any device, as long as the device has the necessary functions (functional blocks, etc.) and can obtain the necessary information.

[0193] Also, for example, each step of a single flowchart may be executed by one device, or may be shared and executed by multiple devices. Furthermore, when one step includes multiple processes, the multiple processes may be executed by one device, or may be shared and executed by multiple devices. In other words, multiple processes included in one step can be executed as multiple step processes. Conversely, processes described as multiple steps can be executed collectively as one step.

[0194] For example, the steps of a program executed by a computer may be executed in chronological order in the order described herein, or may be executed in parallel or individually at the required timing, such as when a call is made. In other words, as long as no contradiction occurs, the steps may be executed in an order different from the order described above. Furthermore, the steps of this program may be executed in parallel with the processing of another program, or may be executed in combination with the processing of another program.

[0195] Furthermore, for example, multiple technologies related to the present technology can be implemented independently and independently, as long as no contradiction occurs. Of course, any multiple technologies can also be implemented in combination. For example, part or all of the present technology described in any embodiment can be implemented in combination with part or all of the present technology described in another embodiment. Furthermore, part or all of any of the above-described present technologies can be implemented in combination with other technologies not described above.

[0196] The present technology can also be configured as follows. (1) A meta information generating unit that generates trimmed image meta information, which is meta information of a trimmed image generated by the trimming, by inheriting or updating and inheriting part or all of captured image meta information, which is meta information of the captured image, according to a trimming state of the captured image. An information processing device comprising: (2) The captured image meta information includes information indicating a width of an image, which includes actual image width information in which the width of the captured image is set, and information indicating a height of the image, which includes actual image height information in which the height of the captured image is set, The meta information generation unit the execution image width information whose value has been updated to the width of the trimmed image; the execution image height information whose value has been updated to the height of the trimmed image; and generating the cropped image meta information including An information processing device according to (1). (3) The captured image meta information includes AF area position information indicating the position of an AF area, which is an area where autofocusing has been performed, and in which the position of the AF area in the captured image is set. When the reference point of the AF area in the captured image is located within the trimmed image, the meta information generation unit generates the trimmed image meta information including the AF area position information whose value is updated to the position of the AF area in the trimmed image. An information processing device according to (1) or (2). (4) The captured image meta information is information indicating a focus position, and includes focus position information in which the focus position in the captured image is set, When the focus position in the captured image is located within the trimmed image, the meta information generation unit generates the trimmed image meta information including the focus position information whose value is updated to the focus position in the trimmed image. An information processing device according to any one of (1) to (3). (5) The captured image meta information includes information regarding reproduction of an AF frame, which is an image indicating an area including a focus position, and includes reproduction AF frame information in which information regarding reproduction of the AF frame for the captured image is set. The meta information generating unit generates the trimmed image meta information including the playback AF frame information updated to a value according to the aspect ratio of the trimmed image. An information processing device according to any one of (1) to (4). (6) The captured image meta information includes information indicating a screen nail, and screen nail information in which a value indicating the screen nail of the captured image is set. When the data size of the trimmed image is equal to or larger than a predetermined threshold, the meta information generating unit generates the trimmed image meta information including the screen nail information updated to a value indicating the screen nail of the trimmed image. An information processing device according to any one of (1) to (5). (7) The captured image meta information includes screen nail size information indicating a size of a screen nail, in which the size of the screen nail of the captured image is set. When the data size of the trimmed image is equal to or larger than a predetermined threshold, the meta information generating unit generates the trimmed image meta information including the screen nail size information whose value is updated to the size of the screen nail of the trimmed image. An information processing device according to any one of (1) to (6). (8) The captured image meta information is information about a size of an image after development processing, and includes post-development image size information in which a size of the captured image after the development processing is set, The meta information generating unit generates the trimmed image meta information including the post-development image size information whose value has been updated to the size of the trimmed image after the development processing. An information processing device according to any one of (1) to (7). (9) The captured image meta information is information relating to an image quality mode, and includes image quality mode information in which the mode of the captured image is set, The meta information generating unit generates the trimmed image meta information including the image quality mode information whose value has been updated to the mode of the trimmed image. An information processing device according to any one of (1) to (8). (10) The captured image meta information is information regarding a compression rate of image compression, and includes compression rate information in which the compression rate of the captured image is set. The meta information generating unit generates the trimmed image meta information including the compression rate information whose value has been updated to the compression rate of the trimmed image. An information processing device according to any one of (1) to (9). (11) The captured image meta information includes: update date and time information indicating the update date and time of the file, in which the update date and time of the captured image is set; and software name information indicating the name of the software that generated the file, the software name being set to the name of the software that generated the file that stores the captured image. At least one of the following is included: The meta information generation unit the update date and time information whose value has been updated to the date and time of generation of the trimmed image; The software name information whose value has been updated to the name of the software that performed the trimming, The trimmed image meta information including at least one of the two is generated. An information processing device according to any one of (1) to (10). (12) The meta information generating unit adds, to the trimmed image meta information, trimming information that is information about the trimming and is not included in the captured image meta information. An information processing device according to any one of (1) to (11). (13) The trimming information includes at least one of information indicating whether the trimming has been performed, information regarding the size of the original image that is the image to be trimmed, information regarding the rotation of the original image, information regarding the position of the starting point of the trimming, and information regarding the range of the trimming. (12) An information processing device according to (12). (14) The meta information generating unit adds the trimming information to meta information of other content associated with the captured image. The information processing device according to (12) or (13). (15) The captured image meta information includes imaging-related information that is information related to imaging, The meta information generating unit generates the trimmed image meta information including the imaging-related information having the same value as the captured image meta information. An information processing device according to any one of (1) to (14). (16) The image processing device further includes a storage unit that stores the trimmed image and the trimmed image meta information generated by the meta information generating unit. An information processing device according to any one of (1) to (15). (17) A trimming unit that performs the trimming on the captured image and generates the trimmed image, the meta information generation unit generates the trimmed image meta information for the trimmed image generated by the trimming unit, The storage unit stores the trimmed image generated by the trimming unit and the trimmed image meta information generated by the meta information generation unit. (16) An information processing device according to (16). (18) The image capturing apparatus further includes a database update unit that updates a database for managing images, registers the trimmed image generated by the trimming unit in the database, and sets information relating the trimmed image to the captured image in the database. (17) An information processing device according to (17). (19) Depending on the trimming status of the captured image, a part or all of captured image meta information that is meta information of the captured image is inherited or updated and inherited, thereby generating trimmed image meta information that is meta information of a trimmed image generated by the trimming. Information processing methods. (20) A computer a meta information generating unit that generates trimmed image meta information that is meta information of a trimmed image generated by the trimming by inheriting or updating and inheriting part or all of captured image meta information that is meta information of the captured image according to a trimming state of the captured image; A program that functions as a [Explanation of symbols]

[0197] 11 captured image, 12 trimmed image, 20 file, 21 meta information, 30 file, 31 meta information, 41, 42A, 42B, 43 meta information, 50 file, 51 image, 52 meta information, 60 database, 100 imaging device, 111 imaging unit, 112 image storage unit, 113 encoding unit, 114 media access unit, 115 trimming processing control unit, 116 decoding unit, 117 display unit, 118 meta information update unit, 119 set information storage unit, 130 bus, 131 control unit, 132 input unit, 133 output unit, 201 content, 210 AVIndex, 211 content information, 900 computer

Claims

1. a meta information generating unit that updates AF frame information during playback, which is included in captured image meta information that is meta information of the captured image and is related to playback of an AF frame that is an image indicating an area including a focus position of the captured image, to a value according to an aspect ratio of a trimmed image generated by trimming the captured image, and generates trimmed image meta information that is meta information of the trimmed image and includes the AF frame information during playback after the update; An information processing device comprising:

2. the captured image meta information further includes: actual image width information indicating a width of an image, the width of the captured image being set; and actual image height information indicating a height of an image, the height of the captured image being set; The meta information generation unit the execution image width information whose value has been updated to the width of the trimmed image; the execution image height information whose value has been updated to the height of the trimmed image; and generating the trimmed image meta information further including The information processing device according to claim 1 .

3. the captured image meta information further includes AF area position information, which is information indicating a position of an AF area in which autofocus has been operated and in which the position of the AF area in the captured image is set; When the reference point of the AF area in the captured image is located within the trimmed image, the meta information generation unit generates the trimmed image meta information further including the AF area position information whose value is updated to the position of the AF area in the trimmed image. The information processing device according to claim 1 .

4. the captured image meta information further includes focus position information indicating the focus position, the focus position being set in the captured image; When the focus position in the captured image is located within the trimmed image, the meta information generation unit generates the trimmed image meta information further including the focus position information whose value is updated to the focus position in the trimmed image. The information processing device according to claim 1 .

5. The meta information generation unit updates the AF frame information during playback so as to omit display of the AF frame when a reference point of the AF frame is located outside the trimming range, and generates the trimmed image meta information including the updated AF frame information during playback. The information processing device according to claim 1 .

6. the captured image meta information further includes screen nail information indicating a screen nail, the screen nail information being set with a value indicating the screen nail of the captured image; When the data size of the trimmed image is equal to or larger than a predetermined threshold, the meta information generating unit generates the trimmed image meta information further including the screen nail information updated to a value indicating the screen nail of the trimmed image. The information processing device according to claim 1 .

7. the captured image meta information further includes screen nail size information indicating a size of a screen nail, the screen nail size information being set to the size of the screen nail of the captured image; When the data size of the trimmed image is equal to or larger than a predetermined threshold, the meta information generating unit generates the trimmed image meta information further including the screen nail size information whose value is updated to the size of the screen nail of the trimmed image. The information processing device according to claim 1 .

8. the captured image meta information is information regarding a size of an image after development processing, and further includes post-development image size information in which a size of the captured image after the development processing is set; The meta information generating unit generates the trimmed image meta information further including the post-development image size information whose value is updated to the size of the trimmed image after the development processing. The information processing device according to claim 1 .

9. the captured image meta information is information relating to an image quality mode, and further includes image quality mode information in which the mode of the captured image is set; The meta information generating unit generates the trimmed image meta information further including the image quality mode information whose value has been updated to the mode of the trimmed image. The information processing device according to claim 1 .

10. the captured image meta information further includes compression rate information, which is information regarding a compression rate of image compression, and in which the compression rate of the captured image is set; The meta information generating unit generates the trimmed image meta information further including the compression rate information whose value is updated to the compression rate of the trimmed image. The information processing device according to claim 1 .

11. The captured image meta information includes: update date and time information indicating the update date and time of the file, in which the update date and time of the captured image is set; and software name information indicating the name of the software that generated the file, the software name being set to the name of the software that generated the file that stores the captured image. Further including at least one of The meta information generation unit the update date and time information whose value has been updated to the date and time of generation of the trimmed image; The software name information whose value has been updated to the name of the software that performed the trimming, The trimmed image meta information further includes at least one of the above. The information processing device according to claim 1 .

12. The meta information generation unit adds, to the trimmed image meta information, trimming information that is information related to the trimming and that is not included in the captured image meta information. The information processing device according to claim 1 .

13. The trimming information includes at least one of information indicating whether the trimming has been performed, information regarding the size of an original image that is an image to be trimmed, information regarding the rotation of the original image, information regarding the position of a starting point of the trimming, and information regarding the range of the trimming. The information processing device according to claim 12.

14. The meta information generating section adds the trimming information to meta information of other content associated with the captured image. The information processing device according to claim 12.

15. the captured image meta information further includes imaging-related information that is information related to imaging, The meta information generating section generates the trimmed image meta information further including the imaging-related information having the same value as the captured image meta information. The information processing device according to claim 1 .

16. The image processing device further includes a storage unit that stores the trimmed image and the trimmed image meta information generated by the meta information generating unit. The information processing device according to claim 1 .

17. a trimming unit that performs the trimming on the captured image and generates the trimmed image, the meta information generation unit generates the trimmed image meta information for the trimmed image generated by the trimming unit, The storage unit stores the trimmed image generated by the trimming unit and the trimmed image meta information generated by the meta information generation unit. The information processing device according to claim 16.

18. The image processing device further includes a database update unit that updates a database for managing images, registers the trimmed image generated by the trimming unit in the database, and sets information that associates the trimmed image with the captured image in the database. The information processing device according to claim 17.

19. updating AF frame information during playback, which is included in captured image meta information that is meta information of the captured image and is related to playback of an AF frame that is an image indicating an area including a focus position of the captured image, to a value according to an aspect ratio of a trimmed image generated by trimming the captured image, and generating trimmed image meta information that is meta information of the trimmed image and includes the updated AF frame information during playback; Information processing methods.

20. Computer, a meta information generating unit that updates AF frame information during playback, which is included in captured image meta information that is meta information of the captured image and is related to playback of an AF frame that is an image indicating an area including a focus position of the captured image, to a value according to an aspect ratio of a trimmed image generated by trimming the captured image, and generates trimmed image meta information that is meta information of the trimmed image and includes the AF frame information during playback after the update; A program that functions as a

Images