Image processing device, terminal, editing method, image processing method, and program

Abstract

To provide an image processing device, a terminal, an editing method, an image processing method, and a program capable of obtaining a plurality of images in which a subject in a recommended area is photographed at an appropriate position in a selected layout.SOLUTION: The image processing apparatus includes a processor. The processor displays the live view image on the screen. The processor displays a recommended region indicating a recommended position of the live view image in the live view image. The processor acquires a plurality of captured images each having an outer edge larger than an outer edge of the recommended area in a state where the recommended area is displayed in the live view image. The processor outputs a plurality of adjusted images based on the plurality of captured images in the selected layout.SELECTED DRAWING: Figure 13

Description

[Technical Field]

[0001] The present disclosure relates to an image processing device, a terminal device, an editing method, an image processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses an imaging device that includes a display control unit that causes a display device to display a live view image and a selected trimming frame that is superimposed on the live view image, a reception unit that receives a position change instruction to change the position of the trimming frame, and a recording control unit that associates information about the selected trimming frame and information about the changed position with captured image data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-090240 Summary of the Invention

[0004] One embodiment of the present disclosure provides an image processing device, a terminal device, an editing method, an image processing method, and a program that can obtain multiple images in which a subject within a recommended area is positioned appropriately in a selected layout. [Means for solving the problem]

[0005] A first aspect of the present disclosure is an image processing device that includes a processor, which displays a live view image on a screen, displays a recommended area within the live view image indicating a recommended position for the live view image, and, while the recommended area is displayed within the live view image, acquires a plurality of captured images each having an outer edge larger than an outer edge of the recommended area, and outputs a plurality of adjusted images based on the plurality of captured images in a selected layout.

[0006] A second aspect of the present disclosure is an image processing device according to the first aspect, in which the adjusted image is an image whose size has been adjusted so that an image area at a position corresponding to the position of the recommended area in the captured image fits into a layout frame in the layout.

[0007] A third aspect of the present disclosure is an image processing device according to the second aspect, in which the adjustment of the size of the captured image is achieved by adjusting the width of the captured image according to the width of the layout frame and / or adjusting the height of the captured image according to the height of the layout frame.

[0008] A fourth aspect of the present disclosure is the image processing device according to the second or third aspect, in which the adjustment of the size of the captured image is achieved by trimming and / or reducing the captured image.

[0009] A fifth aspect of the present disclosure is an image processing device according to any one of the second to fourth aspects, in which the adjusted image is an image in which the shape of the captured image has been adjusted to match the shape of the layout frame.

[0010] A sixth aspect of the present disclosure is an image processing device according to any one of the second to fifth aspects, in which the positional relationship between the recommended area and the layout frame is such that the part of the subject that is captured in at least the center of the recommended area is positioned in the center of the layout frame.

[0011] A seventh aspect of the present disclosure is an image processing device according to any one of the second to fifth aspects, in which the adjusted image is an image in which the size of the captured image is adjusted to fit the image area into a layout frame according to position information indicating the position of the recommended area within the captured image.

[0012] An eighth aspect of the present disclosure is an image processing device according to the seventh aspect, in which a captured image and location information are recorded on a recording medium in a corresponding state, the captured image is retrieved from the recording medium in response to a given retrieval instruction, and the location information associated with the captured image retrieved from the recording medium is retrieved from the recording medium, and the adjusted image is an image in which the size of the captured image retrieved from the recording medium is adjusted to a size that fits the image area within the layout frame in accordance with the location information retrieved from the recording medium.

[0013] A ninth aspect of the present disclosure is the image processing device according to any one of the second to eighth aspects, in which the layout frame is a horizontally long frame when viewed from the front or a vertically long frame when viewed from the front with respect to the screen.

[0014] A tenth aspect of the present disclosure is the image processing device according to any one of the first to ninth aspects, in which the recommendation area is a square area.

[0015] An eleventh aspect of the present disclosure is the image processing device according to any one of the first to tenth aspects, in which the captured image is obtained by performing interval imaging or continuous shooting.

[0016] A twelfth aspect of the present disclosure is an image processing device according to the eleventh aspect, in which a plurality of captured images are selected from a plurality of candidate images obtained by interval capturing or continuous capturing in accordance with a given selection instruction.

[0017] A thirteenth aspect of the present disclosure is an image processing device according to the twelfth aspect, in which a plurality of candidate images are displayed on a screen as a plurality of thumbnail images, and each of the plurality of captured images is a candidate image corresponding to a thumbnail image selected from the plurality of thumbnail images.

[0018] A fourteenth aspect of the present disclosure is a terminal device comprising an image processing device according to any one of the first to thirteenth aspects and an image sensor, and wherein a live view image is obtained by capturing an image using the image sensor.

[0019] A fifteenth aspect of the present disclosure is an image processing method that includes displaying a live view image on a screen, displaying a recommended area within the live view image that indicates a recommended position for the live view image, acquiring a plurality of captured images, each having an outer edge larger than an outer edge of the recommended area while the recommended area is displayed within the live view image, and outputting a plurality of adjusted images based on the plurality of captured images in a selected layout, wherein the adjusted images are images whose size has been adjusted to fit an image area at a position corresponding to the position of the recommended area in the captured image into a layout frame in the layout.

[0020] A sixteenth aspect of the present disclosure is a program for causing a computer to execute processing, the processing including displaying a live view image on a screen, displaying a recommended area within the live view image indicating a recommended position for the live view image, acquiring a plurality of captured images each having an outer edge larger than an outer edge of the recommended area while the recommended area is displayed within the live view image, and outputting a plurality of adjusted images based on the plurality of captured images in a selected layout, wherein the adjusted images are images whose size has been adjusted to fit an image area at a position corresponding to the position of the recommended area within the captured image into a layout frame in the layout. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a conceptual diagram illustrating an example of the overall configuration of an image management system. [Figure 2] FIG. 1 is a conceptual diagram showing an example of how a user uses a smart device. [Figure 3] FIG. 2 is a block diagram illustrating an example of a hardware configuration of an electrical system of a smart device. [Figure 4] FIG. 2 is a block diagram showing an example of essential functions of a smart device. [Figure 5] FIG. 10 is a conceptual diagram showing an example of processing contents of a processor when live view imaging is performed. [Figure 6] FIG. 10 is a conceptual diagram illustrating an example of processing performed by a processor when an interval image capture instruction is given to a smart device by a user. [Figure 7] 10A and 10B are conceptual diagrams illustrating an example of processing content of a processor and an example of display content on a screen when an interval image capture instruction is given to a smart device by a user. [Figure 8] FIG. 10 is a conceptual diagram showing an example of a state in which a plurality of data sets generated by interval imaging are recorded on a memory card. [Figure 9] FIG. 10 is a conceptual diagram showing an example of how a plurality of thumbnail images corresponding to a plurality of actual exposure images contained in a plurality of data sets recorded on a memory card are generated and displayed on a screen. [Figure 10] FIG. 10 is a conceptual diagram showing an example of how a thumbnail image is selected from a plurality of thumbnail images in response to a selection instruction from a user. [Figure 11] This is a conceptual diagram showing an example of an embodiment in which a processor acquires a main exposure image corresponding to a thumbnail image selected by a user as a selected image, and a recommended area is reproduced and allocated to the selected image at a position indicated by position information. [Figure 12] FIG. 10 is a conceptual diagram showing an example of how two selected images are allocated to corresponding layout frames within a layout frame image. [Figure 13] FIG. 10 is a conceptual diagram showing an example of how two adjusted images obtained by adjusting the size of each of two selected images to match the size of the layout frame are each allocated to a layout frame. [Figure 14] FIG. 10 is a conceptual diagram showing an example of a manner in which a layout image obtained by allocating two adjusted images to the corresponding layout frames is output to a predetermined output destination. [Figure 15] FIG. 10 is a conceptual diagram showing an example of how each of four selected images is allocated to a corresponding layout frame within a layout frame image. [Figure 16A]FIG. 10 is a conceptual diagram showing an example of an aspect in which the size of each of two selected images out of four selected images is adjusted to match the size of the layout frame. [Figure 16B] FIG. 16B is a conceptual diagram showing an example of an aspect in which the size of each of two selected images, which are different from the two selected images shown in FIG. 16A out of four selected images, is adjusted to match the size of the layout frame. [Figure 17] FIG. 10 is a conceptual diagram showing an example of a manner in which a layout image is generated by allocating each of four adjustment images to a corresponding layout frame. [Figure 18] FIG. 10 is a conceptual diagram showing an example of how each of six selected images is allocated to a corresponding layout frame within a layout frame image. [Figure 19A] FIG. 10 is a conceptual diagram showing an example of an aspect in which the size of each of three selected images out of six selected images is adjusted to match the size of the layout frame. [Figure 19B] A conceptual diagram showing an example of an aspect in which the size of each of three selected images, which are different from the three selected images shown in Figure 19A out of six selected images, is adjusted to match the size of the layout frame. [Figure 20] FIG. 10 is a conceptual diagram showing an example of a manner in which a layout image is generated by allocating each of six adjustment images to a corresponding layout frame. [Figure 21] 10 is a flowchart illustrating an example of the flow of an image management process. [Figure 22] FIG. 10 is a conceptual diagram showing an example in which an image management process is performed by an external device in response to a request from a smart device, and the process result is received by the smart device. DETAILED DESCRIPTION OF THE INVENTION

[0022] Hereinafter, exemplary embodiments of an image processing device, a terminal device, an image processing method, and a program according to the present disclosure will be described with reference to the accompanying drawings. Note that the present disclosure can also be applied to a program and a computer program product.

[0023] First, the terms used in the following description will be explained.

[0024] CPU is an abbreviation for "Central Processing Unit". GPU is an abbreviation for "Graphics Processing Unit". GPGPU is an abbreviation for "General-Purpose computing on Graphics Processing Units". APU is an abbreviation for "Accelerated Processing Unit". TPU is an abbreviation for "Tensor Processing Unit". RAM is an abbreviation for "Random Access Memory". EEPROM is an abbreviation for "Electrically Erasable Programmable Read-Only Memory". ASIC is an abbreviation for "Application Specific Integrated Circuit". PLD is an abbreviation for "Programmable Logic Device". FPGA is an abbreviation for "Field-Programmable Gate Array". SoC is an abbreviation for "System-on-a-chip". SSD is an abbreviation for "Solid State Drive". CMOS is an abbreviation for "Complementary Metal Oxide Semiconductor". CCD is an abbreviation for "Charge Coupled Device." USB is an abbreviation for "Universal Serial Bus." UI is an abbreviation for "User Interface." I / F is an abbreviation for "Interface." LAN is an abbreviation for "Local Area Network." WAN is an abbreviation for "Wide Area Network." 5G is an abbreviation for "5th Generation Mobile Communication System."

[0025] In the following description, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU, a GPU, a GPGPU, an APU, and a TPU.

[0026] In the following description, a signed memory is a memory such as a RAM in which information is temporarily stored, and is used as a work memory by a processor.

[0027] In the following description, the term "storage" refers to one or more nonvolatile storage devices that store various programs, various parameters, etc. Examples of nonvolatile storage devices include flash memory, magnetic disks, and magnetic tapes. Another example of storage is cloud storage.

[0028] In the following embodiments, the external I / F with a symbol controls the exchange of various information between multiple devices connected to each other. An example of the external I / F is a USB interface. A communication I / F including a communication processor, an antenna, etc. may be applied to the external I / F. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G, Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] In the following embodiments, "identical" refers to complete identity as well as identity including tolerances generally accepted in the technical field to which the technology of the present disclosure belongs. Also, in the following embodiments, "matching" refers to complete identity as well as identity including tolerances generally accepted in the technical field to which the technology of the present disclosure belongs.

[0031] 1, an image management system 10 includes a smart device 12 and a server 14. The smart device 12 is an example of a "terminal device" according to the present disclosure.

[0032] In the example shown in FIG. 1, a smartphone is shown as the smart device 12. The smartphone is merely an example, and the smart device 12 may be a smart watch, smart glasses, a tablet terminal, a personal computer, or the like. The smart device 12 is used by a user 13.

[0033] The smart device 12 and the server 14 are communicatively connected via a network 16. Examples of the network 16 include a WAN (Wide Area Network) and a LAN (Local Area Network).

[0034] The server 14 provides the smart device 12 with a service in response to a request from the smart device 12. That is, the server 14 executes a process in response to a request from the smart device 12. The server 14 also provides the result of the executed process to the smart device 12 that originated the request.

[0035] The smart device 12 is communicatively connected to a printing device 18. An example of the printing device 18 is an instant printer that prints on instant film 20. While an instant printer is illustrated here, this is merely an example, and any device having communication and printing functions, such as a multifunction peripheral that can communicate with a terminal device such as the smart device 12, may be used. The present disclosure also applies to a device that combines imaging and printing functions instead of the smart device 12. An example of a device that combines imaging and printing functions is a hybrid instant camera (e.g., a camera equipped with multiple functions, such as displaying captured images on a screen, recording captured images on a recording medium such as a memory card, editing and / or processing the image displayed on the screen in response to a user's instructions, and printing an image specified by the user). The instant film 20 is also merely an example, and may be other types of film or photographic paper, or any medium on which an image can be printed (in other words, a medium on which an image can be recorded). In this embodiment, the concept of printing also includes development.

[0036] 1, the printing device 18 generates a printout 25 (a business card-sized instant photograph in the example shown in FIG. 1) by printing an image 24 (e.g., an image sent from the smart device 12) on the surface 22 of the instant film 20 in accordance with instructions given from the smart device 12. The printing device 18 then ejects the generated printout 25 from the printing device 18.

[0037] As an example, as shown in FIG. 2, the smart device 12 includes an imaging device 26, which captures an image of a subject in response to an instruction given by the user 13.

[0038] The smart device 12 includes a touch panel display 28. The touch panel display 28 has a display 30 (e.g., a liquid crystal display or an electroluminescence display) and a touch panel 32, and is formed, for example, by overlaying the touch panel 32 on a screen 34 of the display 30. The example shown in FIG. 2 illustrates an example in which a live view image 36 obtained by capturing an image of a subject is displayed on the screen 34. The screen 34 is an example of a "screen" according to the present disclosure. The live view image 36 is an example of a "live view image" according to the present disclosure.

[0039] 3, the smart device 12 includes a computer 40, an image sensor 42, a UI (User Interface) device 44, and an external I / F 46. The computer 40 is an example of an "image processing device" and a "computer" according to the present disclosure. The image sensor 42 is an example of an "image sensor" according to the present disclosure.

[0040] The computer 40 includes a processor 48, a storage 50, and a memory 52. ​​The processor 48, the storage 50, and the memory 52 are connected to a bus 54. The processor 48 is an example of a "processor" according to the present disclosure.

[0041] The image sensor 42 is connected to the bus 54. An example of the image sensor 42 is a CMOS image sensor. The image sensor 42 captures an image of a subject under the control of the processor 48, thereby generating an electrical signal 56 indicative of the subject. The processor 48 acquires the electrical signal 56 from the image sensor 42 and performs various signal processing on the electrical signal 56.

[0042] Here, a CMOS image sensor is given as an example of the image sensor 42, but this is merely an example, and the image sensor 42 may be other types of image sensors such as a CCD image sensor.

[0043] The UI device 44 is connected to the bus 54. The UI device 44 includes a touch panel display 28 (see FIG. 2), one or more hard keys (not shown), a microphone (not shown), a speaker (not shown), etc. The UI device 44 receives instructions from the user and outputs a signal indicating the received instruction to the processor 48. The UI device 44 also presents various information to the user under the control of the processor 48. The presentation of various information is realized, for example, by displaying the various information on the display 30 (see FIG. 2) or outputting the various information as sound from a speaker.

[0044] The external I / F 46 is connected to the bus 54. The external I / F 46 controls the exchange of various information between the computer 40 and external devices. In the example shown in FIG. 3, the external devices are a server 14, a printing device 18, and a memory card 58. The server 14 is communicatively connected to the external I / F 46 via the network 16. The printing device 18 is communicatively connected to the external I / F 46 via Bluetooth (registered trademark) or the like. The memory card 58 is connected to the external I / F 46 by being loaded into the smart device 12. The memory card 58 is an example of a "recording medium" according to the present disclosure.

[0045] 4, an image management program 60 is stored in the storage 50. The image management program 60 is an example of a "program" according to the present disclosure.

[0046] Processor 48 performs image management processing 62. Image management processing 62 is realized by processor 48 reading image management program 60 from storage 50 and executing the read image management program 60 in memory 52. ​​Image management processing 62 is an example of "processing" according to the present disclosure.

[0047] 5, when the user 13 gives an instruction to start capturing images (e.g., an instruction to switch the operation mode of the smart device 12 to the capturing mode), the smart device 12 performs live view capturing using the image sensor 42. The live view capturing is performed at a default frame rate. The default frame rate may be, for example, several tens of frames per second (e.g., 30 frames per second or 60 frames per second), but this is merely an example, and the frame rate may be lower than several tens of frames per second or higher than several tens of frames per second.

[0048] When an instruction to start capturing an image is given to the smart device 12, the processor 48 acquires from the image sensor 42 an electrical signal 56 generated by the image sensor 42. The processor 48 performs various signal processing on the electrical signal 56 acquired from the image sensor 42 to generate a live view image 36 (e.g., a chromatic image or an achromatic image) showing the subject. The processor 48 displays the live view image 36 on the screen 34.

[0049] As an example, as shown in FIG. 6 , when an interval imaging instruction is given from the user 13, the smart device 12 performs interval imaging using the image sensor 42. Generally, interval imaging is also called interval time lapsing. Interval imaging is a process in which the image sensor 42 continuously performs main exposure at regular time intervals, and images obtained by the main exposure are continuously output. In this embodiment, main exposure refers to exposure that provides an exposure amount that improves image quality (i.e., an exposure amount that improves the reproducibility of subject details and color) compared to exposure for obtaining a live view image 36. While interval imaging is illustrated here, interval imaging is merely an example, and the present disclosure can be implemented by applying continuous shooting, which is an imaging method that obtains multiple images at shorter time intervals than interval imaging, instead of interval imaging.

[0050] When an interval imaging instruction is given to the smart device 12, the processor 48 acquires from the image sensor 42 an electrical signal 56 generated by the image sensor 42 performing a main exposure at regular time intervals. The processor 48 performs various signal processing on the electrical signal 56 acquired from the image sensor 42 to generate a main exposure image 66 (e.g., a chromatic image or an achromatic image) showing the subject. The main exposure images 66 are generated at regular time intervals and are sequentially recorded on the memory card 58 by the processor 48. The main exposure images 66 are an example of a "candidate image" according to the present disclosure.

[0051] As an example, as shown in FIG. 7, the processor 48 displays a recommended area 68 indicating a recommended position for the live view image 36. The recommended area 68 is displayed within the live view image 36. In the example shown in FIG. 7, the recommended area 68 is superimposed on the live view image 36. The recommended position for the live view image 36 refers to a recommended position within the live view image 36 for a subject that appears in the live view image 36. In this embodiment, the recommended area 68 is the central area of ​​the screen 34. The shape of the recommended area 68 is a square. In other words, the recommended area 68 is an area surrounded by a square frame in the center of the screen 34. The position and size of the recommended area 68 within the live view image 36 (in other words, the position and size of the recommended area 68 within the screen 34) are fixed.

[0052] The processor 48 acquires position information 70 each time the live view image 36 is updated according to the frame rate (i.e., for each frame of the live view image 36). The position information 70 refers to information indicating the position of the recommended region 68 within the live view image 36 (for example, the two-dimensional coordinates of the four corners of the recommended region 68, or the two-dimensional coordinates of the two corners diagonally opposite the recommended region 68).

[0053] When the live view image 36 is displayed on the screen 34, a soft key 71 is displayed at the bottom of the screen 34. An interval image capture instruction is realized by turning on the soft key 71.

[0054] When an interval image capture instruction is given to the smart device 12 while the recommended region 68 is displayed within the live view image 36, the processor 48 acquires a final exposure image 66 through interval image capture. The outer edge (in other words, the outer frame or image frame) of the final exposure image 66 acquired by the processor 48 is larger than the outer edge (in other words, the outer frame) of the recommended region 68. In other words, the visual size of the final exposure image 66 displayed on the screen 34 is larger than the visual size of the recommended region 68 displayed on the screen 34. Therefore, the area in which the final exposure image 66 is displayed encompasses the area in which the recommended region 68 is displayed.

[0055] The processor 48 generates a data set 74 including the acquired main exposure image 66 and records it on the memory card 58. The data set 74 includes the main exposure image 66, position information 70, and an identifier 72, and the position information 70 and the identifier 72 are associated with the main exposure image 66.

[0056] The visual size of the actual exposure image 66 included in the data set 74 (for example, the size displayed on the screen 34) is the same as the visual size of the live view image 36.

[0057] The position information 70 included in the data set 74 is position information 70 related to the recommended area 68 displayed on the screen 34 at the time when the final exposure image 66 included in the data set 74 is obtained. The identifier 72 included in the data set 74 is information that can identify the final exposure image 66 included in the data set 74 (for example, a unique number assigned to each frame). Associating the identifier 72 with the final exposure image 66 makes it possible to manage each final exposure image 66 in a distinguishable manner.

[0058] 8, a data set 74 is generated for each main exposure image 66 obtained by interval imaging and recorded on the memory card 58. For convenience of explanation, the example shown in Fig. 8 illustrates an example in which six data sets 74 corresponding to six main exposure images 66 obtained by interval imaging are recorded on the memory card 58, but this is merely an example, and the number of data sets 74 recorded on the memory card 58 may naturally be less than six or may be seven or more.

[0059] As an example, as shown in FIG. 9 , when a data set 74 is recorded on the memory card 58, the processor 48 acquires the data set 74 from the memory card 58. The processor 48 then allocates, to a final exposure image 66 included in the data set 74, a recommended area 68 based on position information 70 associated with the final exposure image 66. The recommended area 68 based on the position information 70 refers to the recommended area 68 reproduced at the position indicated by the position information 70 within the final exposure image 66. The processor 48 generates a thumbnail image 76 by cropping a portion of the final exposure image 66 using the recommended area 68 and reducing the size of the cropped portion. Here, the portion cropped by the recommended area 68 refers to the area within the final exposure image 66 that is surrounded by the recommended area 68. The thumbnail image 76 is an example of a “thumbnail image” according to the present disclosure.

[0060] The processor 48 associates the generated thumbnail image 76 with the identifier 72 associated with the actual exposure image 66 on which the thumbnail image 76 is based. This makes it possible to manage the thumbnail images 76 so that it is possible to distinguish which actual exposure image 66 each thumbnail image 76 corresponds to.

[0061] In the manner described above, processor 48 displays thumbnail images 76 generated for each data set 74 in a chronological order at the bottom of screen 34. In the example shown in Fig. 8, multiple thumbnail images 76 are arranged in a straight line and superimposed at the bottom of live view image 36.

[0062] As an example, as shown in Fig. 10 , a selection instruction 77 is given to the smart device 12. The selection instruction 77 is an instruction accompanying an operation by the user 13 (for example, a tap on the touch panel 32, etc.). In the example shown in Fig. 10 , a thumbnail image 76 is selected from a plurality of thumbnail images 76 displayed on the screen 34 in accordance with the selection instruction 77 of the user 13. In the example shown in Fig. 10 , two thumbnail images 76 corresponding to the two latest main exposure images 66 obtained by interval imaging are selected in accordance with the selection instruction 77. The selection instruction 77 is an example of a "take-out instruction" and a "selection instruction" according to the present disclosure.

[0063] 11 , the processor 48 identifies a data set 74 that includes the actual exposure image 66 corresponding to the thumbnail image 76 selected in response to a selection instruction 77, and retrieves the identified data set 74 from the memory card 58. The data set 74 is identified by comparing the identifier 72 associated with the thumbnail image 76 with the identifier 72 associated with the actual exposure image 66.

[0064] The processor 48 acquires a selected image 78 from the identified dataset 74. The selected image 78 refers to the main exposure image 66 corresponding to the thumbnail image 76 selected from a plurality of thumbnail images 76 in response to a selection instruction 77. In the example shown in FIG. 11 , the processor 48 acquires the main exposure image 66 included in the identified dataset 74 as the selected image 78 from the dataset 74.

[0065] The processor 48 allocates a recommended area 68 (i.e., the recommended area 68 reproduced at the position indicated by the position information 70) based on the corresponding position information 70 (i.e., the position information 70 associated with the selected image 78) to the selected image 78 acquired from the data set 74. The method of allocating the recommended area 68 to the selected image 78 is similar to the example shown in Fig. 9 (i.e., the method of allocating the recommended area 68 to the actual exposure image 66).

[0066] In the example shown in Fig. 11, a corresponding recommended area 68 is allocated to each of two selected images 78. Therefore, as an example shown in Fig. 12, the processor 48 acquires a layout frame image 80A to be applied to the two selected images 78. The layout frame image 80A is an image including two layout frames 80A1. In the layout frame image 80A, the two layout frames 80A1 are arranged side by side in the left-right direction when viewed from the front of the screen 34. The layout frame 80A1 is a vertically long frame when viewed from the front of the screen 34. The position and size of the layout frame 80A1 within the layout frame image 80A are fixed.

[0067] The processor 48 allocates the two selected images 78 to two layout frames 80A1 in the layout frame image 80A. In this case, the positional relationship between the recommended area 68 allocated to the selected image 78 and the layout frame 80A1 is such that the part of the subject that is visible in at least the center of the recommended area 68 is positioned in the center of the layout frame 80A1. In the example shown in Fig. 12, the selected image 78 is allocated to the layout frame 80A1 so that the center C1 of the recommended area 68 and the center C2 of the layout frame 80A1 coincide with each other.

[0068] However, simply allocating the selected image 78 to the layout frame 80A1 in this way results in the selected image 78 extending beyond the layout frame 80A1.

[0069] 13, the processor 48 generates two adjusted images 78A based on two selected images 78 allocated to the layout frame image 80A. The selected images 78 are an example of a "captured image" according to the present disclosure. The adjusted image 78A is an example of an "adjusted image" according to the present disclosure.

[0070] The adjusted image 78A is an image obtained by adjusting the size of the corresponding selected image 78 to fit an image area at a position corresponding to the position of the recommended area 68 in the selected image 78 (for example, an image area at a position corresponding to at least the central portion (for example, the center) of the recommended area 68 in the selected image 78) into the layout frame 80A1. In this embodiment, the position of the recommended area 68 in the selected image 78 is specified by the position information 70 associated with the selected image 78. Therefore, it can also be said that the adjusted image 78A is an image obtained by adjusting the size of the selected image 78 in accordance with the position information 70 associated with the corresponding selected image 78 to fit an image area at a position corresponding to the position of the recommended area 68 in the selected image 78 into the layout frame 80A1.

[0071] The size of the selected image 78 is adjusted by adjusting the width (i.e., the length in the horizontal direction when viewed from the front relative to the screen 34) of the selected image 78 in accordance with the width (i.e., the length in the horizontal direction when viewed from the front relative to the screen 34) of the layout frame 80A1, and by adjusting the height (i.e., the length in the vertical direction when viewed from the front relative to the screen 34) of the selected image 78 in accordance with the height (i.e., the length in the vertical direction when viewed from the front relative to the screen 34) of the layout frame 80A1.

[0072] In the example shown in Figure 13, an example is given in which both the width and height of the selected image 78 are adjusted, but if adjusting one of the width and height of the selected image 78 causes the image area at a position corresponding to the position of the recommended area 68 in the selected image 78 to fit within the layout frame 80A1, then it is sufficient to adjust one of the width and height of the selected image 78.

[0073] The size of the selected image 78 is adjusted by trimming the selected image 78. In the example shown in Fig. 13, the width and height of the selected image 78 are trimmed to match the width and height of the layout frame 80A1. Note that although trimming is illustrated here, this is merely an example, and as long as the image area in the selected image 78 at a position corresponding to the position of the recommended area 68 fits within the layout frame 80A1, the adjusted image 78A may be obtained by reducing the selected image 78, or the adjusted image 78A may be obtained by both trimming and reducing the selected image 78.

[0074] Furthermore, the adjusted image 78A is also an image in which the shape of the selected image 78 has been adjusted to match the shape of the layout frame 80A1 (in the example shown in FIG. 13, a vertically elongated rectangle when viewed from the front of the screen 34). In the example shown in FIG. 13, the shape of the layout frame 80A1 is a vertically elongated rectangle when viewed from the front of the screen 34, so the shape of the selected image 78 has also been adjusted to a vertically elongated rectangle when viewed from the front of the screen 34. However, if the shape of the layout frame 80A1 is triangular, the shape of the selected image 78 is also adjusted to a triangle having the same shape as the shape of the layout frame 80A1, and if the shape of the layout frame 80A1 is circular, the shape of the selected image 78 is also adjusted to a circle having the same shape as the shape of the layout frame 80A1. In this way, the size and shape of the selected image 78 in the adjusted image 78A are adjusted to match the size and shape of the layout frame 80A1.

[0075] Processor 48 allocates each of two adjusted images 78A to a corresponding layout frame 80A1 to generate layout image 82A. The subject that falls within recommended area 68 is captured in each layout frame 80A1 of layout image 82A thus obtained.

[0076] As an example, as shown in FIG. 14 , the processor 48 outputs two adjusted images 78A in the selected layout. That is, the processor 48 outputs a layout image 82A. Destinations to which the layout image 82A can be output include, for example, the server 14, the printing device 18, the display 30, and the memory card 58. In this case, the processor 48 transmits the layout image 82A to the server 14. The server 14 records the layout image 82A on the recording medium 14A (for example, a flash memory and / or a hard disk). The processor 48 also causes the printing device 18 to print the layout image 82A. The processor 48 also displays the layout image 82A on the screen 34. The processor 48 then records the layout image 82A on the memory card 58.

[0077] 10 to 13 show an example in which two adjusted images 78A are generated based on two selected images 78, and each of the two adjusted images 78A is allocated to a corresponding layout frame 80A1 to generate a layout image 82A, but this is merely an example. For example, as shown in FIGS. 15 to 17, four adjusted images 78B may be generated based on four selected images 78, and each of the four adjusted images 78B may be allocated to a corresponding layout frame 80B1 in a layout frame image 80B to generate a layout image 82B. In this case, too, the layout image 82B is generated in the same manner as in the example shown in FIGS. 10 to 13.

[0078] For example, as shown in FIG. 15, when four thumbnail images 76 are selected in response to a selection instruction 77 (see FIG. 10), the processor 48 acquires four main exposure images 66 corresponding to the four selected thumbnail images 76 as four selected images 78. The processor 48 then acquires a layout frame image 80B to be applied to the four selected images 78. The layout frame image 80B is an image that includes four layout frames 80B1. In the layout frame image 80B, the four layout frames 80B1 are arranged in a 2×2 matrix (vertical×horizontal). The layout frame 80B1 is a horizontally elongated frame when viewed from the front of the screen 34.

[0079] The processor 48 allocates the four selected images 78 to four layout frames 80B1 in the layout frame image 80B. In this case, the positional relationship between the recommended area 68 allocated to the selected image 78 and the layout frame 80B1 is such that the portion of the subject that is captured in at least the center of the recommended area 68 is positioned in the center of the layout frame 80B1. In the example shown in Fig. 15, the selected image 78 is allocated to the layout frame 80B1 so that the center C1 of the recommended area 68 coincides with the center C3 of the layout frame 80B1.

[0080] 16A and 16B, processor 48 generates four adjusted images 78B based on four selected images 78 allocated to layout frame image 80B. Adjusted image 78B is an example of an "adjusted image" according to the present disclosure.

[0081] The adjusted image 78B is an image obtained by adjusting the size of the corresponding selected image 78 so that the image area at a position corresponding to the position of the recommended area 68 in the selected image 78 fits within the layout frame 80B1.

[0082] The size of the selected image 78 is adjusted by adjusting the width of the selected image 78 according to the width of the layout frame 80B1, and by adjusting the height of the selected image 78 according to the height of the layout frame 80B1. Note that, although the examples shown in Figures 16A and 16B show an example in which both the width and height of the selected image 78 are adjusted, as long as adjusting one of the width and height of the selected image 78 enables the image area in the selected image 78 at a position corresponding to the position of the recommended area 68 to fit within the layout frame 80B1, it is sufficient to adjust one of the width and height of the selected image 78.

[0083] 16A and 16B, the width and height of selected image 78 are trimmed to match the width and height of layout frame 80B1. Note that, although trimming is illustrated here, this is merely an example, and as long as the image area in selected image 78 at a position corresponding to the position of recommended area 68 fits within layout frame 80B1, adjusted image 78B may be obtained by reducing selected image 78, or adjusted image 78B may be obtained by performing both trimming and reduction.

[0084] 17, the processor 48 generates a layout image 82B by allocating each of six adjusted images 78B to a corresponding layout frame 80B1. A subject that falls within the recommended area 68 is captured in each layout frame 80B1 of the layout image 82B thus obtained. The layout image 82B is also output by the processor 48 in a manner similar to the example shown in FIG.

[0085] 15 to 17 show an example in which four adjusted images 78B are generated based on four selected images 78, and each of the four adjusted images 78B is allocated to a corresponding layout frame 80B1 to generate a layout image 82B, but this is merely an example. For example, as shown in FIGS. 18 to 20, six adjusted images 78C may be generated based on six selected images 78, and each of the six adjusted images 78C may be allocated to a corresponding layout frame 80C1 in a layout frame image 80C to generate a layout image 82C. In this case, too, the layout image 82C is generated in the same manner as in the example shown in FIGS. 15 to 17.

[0086] For example, as shown in FIG. 18, when six thumbnail images 76 are selected in response to a selection instruction 77 (see FIG. 10), the processor 48 acquires six main exposure images 66 corresponding to the six selected thumbnail images 76 as six selected images 78. The processor 48 then acquires a layout frame image 80C to be applied to the six selected images 78. The layout frame image 80C is an image that includes six layout frames 80C1. In the layout frame image 80C, the six layout frames 80C1 are arranged in a vertical×horizontal=2×3 array. The layout frame 80C1 is a horizontally elongated frame when viewed from the front of the screen 34.

[0087] The processor 48 allocates the six selected images 78 to four layout frames 80C1 within the layout frame image 80C. In this case, the positional relationship between the recommended area 68 allocated to the selected image 78 and the layout frame 80C1 is such that the portion of the subject that is visible in at least the center of the recommended area 68 is positioned in the center of the layout frame 80C1. In the example shown in Fig. 18, the selected images 78 are allocated to the layout frame 80C1 so that the center C1 of the recommended area 68 coincides with the center C4 of the layout frame 80C1.

[0088] 19A and 19B, processor 48 generates six adjusted images 78C based on six selected images 78 allocated to layout frame image 80C. Adjusted image 78C is an example of an "adjusted image" according to the present disclosure.

[0089] The adjusted image 78C is an image obtained by adjusting the size of the corresponding selected image 78 so that the image area at a position corresponding to the position of the recommended area 68 in the selected image 78 fits within the layout frame 80C1.

[0090] The size of the selected image 78 is adjusted by adjusting the width of the selected image 78 according to the width of the layout frame 80C1, and by adjusting the height of the selected image 78 according to the height of the layout frame 80C1. Note that, although the examples shown in Figures 19A and 19B show an example in which both the width and height of the selected image 78 are adjusted, it is sufficient to adjust one of the width and height of the selected image 78 as long as adjusting one of the width and height of the selected image 78 enables the image area in the selected image 78 at a position corresponding to the position of the recommended area 68 to fit within the layout frame 80C1.

[0091] 19A and 19B, the width and height of selected image 78 are trimmed to match the width and height of layout frame 80C1. Note that, although trimming is illustrated here, this is merely an example, and as long as the image area in selected image 78 at a position corresponding to the position of recommended area 68 fits within layout frame 80C1, adjusted image 78C may be obtained by reducing selected image 78, or adjusted image 78C may be obtained by performing both trimming and reduction.

[0092] 20, processor 48 generates layout image 82C by allocating each of six adjusted images 78C to a corresponding layout frame 80C1. A subject that falls within recommended area 68 is captured in each layout frame 80C1 of layout image 82C obtained in this manner. Layout image 82C is also output by processor 48 in a manner similar to the example shown in FIG.

[0093] Next, an example of the flow of main processes included in the image management process 62 of the smart device 12 will be described with reference to Fig. 21. The processes shown in the flowchart of Fig. 21 are an example of an "image processing method" according to the present disclosure. For convenience of explanation, the following description will be given on the assumption that live view imaging is being performed by the imaging device 26.

[0094] 21, the processor 48 displays the live view image 36 on the screen 34, and also displays the recommended area 68 superimposed on the center of the live view image 36 (see FIG. 7). After the processing of step ST10 is executed, the image management processing 62 proceeds to step ST12.

[0095] In step ST12, the processor 48 acquires a plurality of main-exposure images 66 obtained by performing interval imaging in response to the interval imaging instruction, and position information 70 related to the recommended area 68 applied to each main-exposure image 66 (see FIG. 7). After the processing of step ST12 is executed, the image management processing 62 proceeds to step ST14.

[0096] In step ST14, the processor 48 generates a plurality of data sets 74 corresponding to the plurality of actual exposure images 66 acquired in step ST12 and records them on the memory card 58 (see FIGS. 7 and 8). After the processing of step ST14 is executed, the image management processing 62 proceeds to step ST16.

[0097] In step ST16, the processor 48 generates a plurality of thumbnail images 76 based on the plurality of data sets 74 recorded on the memory card 58 and displays them on the screen 34 (see FIG. 9). After the processing of step ST16 is executed, the image management processing 62 proceeds to step ST18.

[0098] In step ST18, the processor 48 acquires, as a plurality of selected images 78, a plurality of main exposure images 66 corresponding to a plurality of thumbnail images 76 selected in response to the selection instruction 77 (see FIGS. 10 and 11). Each selected image 78 is allocated to a corresponding layout frame 80A1 in the layout frame image 80A. In this case, the selected image 78 is allocated to the layout frame 80A1 so that the center C1 of the recommended area 68 reproduced in accordance with the position information 70 associated with the selected image 78 coincides with the center C2 of the layout frame 80A1 (see FIG. 12). After the processing of step ST18 is executed, the image management processing 62 proceeds to step ST20.

[0099] In step ST20, the processor 48 generates an adjusted image 78A by adjusting the size of each selected image 78 so that it fits within each layout frame 80A1 (see FIG. 13). In this case, the shape of each selected image 78 is also adjusted to match the shape of each layout frame 80A1. The size and shape adjustment is achieved by trimming and / or reducing the image. After the processing of step ST20 is executed, the image management processing 62 proceeds to step ST22.

[0100] In step ST22, the processor 48 generates a layout image 82A by allocating each adjusted image 78A generated in step ST20 to a corresponding layout frame 80A1 in the layout frame image 80A (see FIG. 13). After the processing of step ST22 is executed, the image management processing 62 proceeds to step ST24.

[0101] In step ST24, processor 48 outputs layout image 82A to a predetermined output destination such as server 14, printer 18, display 30, or memory card 58 (see FIG. 14). After the processing of step ST24 is executed, image management processing 62 ends.

[0102] As described above, in this embodiment, a live-view image 36 is displayed on the screen 34, and a recommended area 68 is displayed within the live-view image 36. The recommended area 68 is an area that indicates a recommended position within the live-view image 36 for a subject that appears in the live-view image 36. Therefore, for example, the recommended area 68 displayed within the live-view image 36 allows the user 13 to fit a subject intended by the user 13 within a layout frame 80A1 by providing guidance instructions for the subject and / or adjusting the angle of view and / or composition by the user 13. With the recommended area 68 displayed within the live-view image 36, multiple selected images 78, each with outer edges larger than those of the recommended area 68, are acquired. Then, multiple adjusted images 78A based on the multiple selected images 78 obtained by interval image capture are output in a selected layout (for example, the layout of the two layout frames 80A1 included in the layout image 82A). At least a portion of the subject included in the recommended area 68 is captured in the adjusted image 78A. Therefore, compared to when the main exposure image 66 obtained by interval shooting without using the recommended area 68 is simply allocated to the layout frame 80A1, multiple adjusted images 78A in which the subject within the recommended area 68 is captured in an appropriate position can be obtained with the selected layout.

[0103] Furthermore, in this embodiment, an image is used as the adjusted image 78A, the size of which has been adjusted so that the image area of ​​the corresponding selected image 78 at a position corresponding to the position of the recommended area 68 in the selected image 78 fits within the layout frame 80A1 in the layout image 82A. Therefore, the image area of ​​the selected image 78 at a position corresponding to the position of the recommended area 68 can fit within the layout frame 80A1 in the layout image 82A.

[0104] Furthermore, in this embodiment, the size of the selected image 78 is adjusted by adjusting the width of the selected image 78 according to the width of the layout frame 80A1 and / or adjusting the height of the selected image 78 according to the height of the layout frame 80A1. Therefore, the image area at a position corresponding to the position of the recommended area 68 in the selected image 78 can be adjusted to fit the width and / or height of the layout frame 80A1 in the layout image 82A.

[0105] Furthermore, in this embodiment, the adjustment of the size of the selected image 78 is achieved by trimming and / or reducing the selected image 78. Therefore, the adjustment of the size of the selected image 78 can be achieved more effectively than when neither trimming nor reducing the selected image 78 is performed.

[0106] Furthermore, in this embodiment, an image obtained by adjusting the size of the selected image 78 to match the size of the layout frame 80A1 and adjusting the shape of the selected image 78 to match the shape of the layout frame 80A1 is used as the adjusted image 78A. Therefore, the size and shape of the layout frame 80A1 and the size and shape of the adjusted image 78A match, so that the adjusted image 78A can be allocated (in other words, fitted) to the layout frame 80A1.

[0107] Furthermore, in this embodiment, the positional relationship between the recommended area 68 and the layout frame 80A1 is such that the part of the subject that appears in at least the center of the recommended area 68 (center C1 in the examples shown in FIGS. 12 and 13) is located in the part that appears in the center of the layout frame 80A1 (center C2 in the examples shown in FIGS. 12 and 13). Therefore, the part that appears in at least the center of the recommended area 68 can be positioned in the center of the layout frame 80A1.

[0108] Furthermore, in this embodiment, an image is used as the adjusted image 78A, in which the size of the selected image 78 is adjusted to fit the selected image 78 into the layout frame 80A1 according to the position information 70 indicating the position of the recommended area 68 within the selected image 78. Therefore, an adjusted image 78A of a size that allows the subject appearing in the recommended area 68 to fit into the layout frame 80A1 can be obtained.

[0109] Furthermore, in this embodiment, the final exposure image 66 and position information 70 are recorded on the memory card 58 in a state in which they are associated with each other. The final exposure image 66 recorded on the memory card 58 is retrieved from the memory card 58 as a selected image 78 in response to a selection instruction 77 given by the user 13, and the position information 70 associated with the final exposure image 66 is also retrieved from the memory card 58. Then, in accordance with the position information 70 associated with the selected image 78, the size of the selected image 78 is adjusted to a size such that the image area in the selected image 78 at a position corresponding to the position of the recommended area 68 fits within the layout frame 80A1 in the layout image 82A. Therefore, after the final exposure image 66 is obtained, the size of the selected image 78 can be adjusted to a size such that the image area in the selected image 78 at a position corresponding to the position of the recommended area 68 fits within the layout frame 80A1 in the layout image 82A, at a timing intended by the user 13.

[0110] Furthermore, in this embodiment, an image is used as the adjusted image 78A, the size of which has been adjusted so that an image area at a position corresponding to the position of the recommended area 68 in the selected image 78 fits into a layout frame 80A1 in the layout image 82A. The layout frame 80A1 is a vertically long frame when viewed from the front of the screen 34. Therefore, the image area at a position corresponding to the position of the recommended area 68 in the selected image 78 can be fitted into the layout frame 80A1, which is a vertically long frame when viewed from the front of the screen 34 in the layout image 82A.

[0111] Furthermore, in this embodiment, a square region is used as the recommended region 68. Therefore, compared to when the shape of the recommended region 68 is a vertically or horizontally elongated rectangular region, the image region at a position corresponding to the position of the recommended region 68 in the selected image 78 can be laid out in an appropriate position for any of the layout frames 80A1, 80B1, and 80C1.

[0112] Furthermore, in this embodiment, the size of the final exposure image 66 selected in response to a selection instruction 77 from the multiple final exposure images 66 recorded on the memory card 58 is adjusted, and the adjusted image 78A obtained by the size adjustment is allocated to the layout frame 80A1. Therefore, a layout image 82A can be obtained in which the adjusted image 78A obtained by adjusting the size of the final exposure image 66 intended by the user 13 is laid out.

[0113] Furthermore, in this embodiment, a thumbnail image 76 that the user 13 desires to use as a layout target is selected from the plurality of thumbnail images 76 displayed on the screen 34 in response to a selection instruction 77, and the final exposure image 66 corresponding to the selected thumbnail image 76 is set as a selected image 78. Then, an adjusted image 78A obtained by adjusting the size of the selected image 78 is allocated to the layout frame 80A1. Therefore, the user 13 can easily select the final exposure image 66 that the user 13 desires to use as a layout target as the selected image 78. As a result, the adjusted image 78A obtained by adjusting the size of the selected image 78 desired by the user 13 can be laid out in the layout image 82A.

[0114] In the above embodiment, the layout frame images 80A, 80B, and 80C are exemplified, but other layout frame images may be used. For example, a layout frame image in which multiple layout frames of different shapes depending on the film or model, such as mini, wide, and square, may be used.

[0115] In the above embodiment, an example has been given in which the recommended region 68 is fixed to a certain location (e.g., the center) within the live-view image 36. However, the position of the recommended region 68 may be changed in response to a given instruction and / or various conditions. For example, the position of the recommended region 68 within the live-view image 36 may be changed in response to an instruction given by the user 13 to the smart device 12. Furthermore, for example, the position of the recommended region 68 within the live-view image 36 may be changed so as to track a specific subject (e.g., a pre-specified object) recognized by performing an AI-based object recognition process on the live-view image 36 (e.g., object recognition process using a trained model obtained by performing machine learning on a model such as a neural network so as to recognize a specific subject) and / or a non-AI-based object recognition process (e.g., object recognition process using a template matching method capable of recognizing a specific subject).

[0116] In the above embodiment, an example was given in which the size of the recommended region 68 within the live-view image 36 was fixed, but the size of the recommended region 68 within the live-view image 36 may be changed in response to a given instruction and / or various conditions. For example, the position of the recommended region 68 within the live-view image 36 may be changed in response to an instruction given by the user 13 to the smart device 12. Furthermore, for example, the size of the recommended region 68 within the live-view image 36 may be changed in response to the size and / or type of a specific subject recognized by the above-described AI or non-AI object recognition processing.

[0117] In the above embodiment, an example has been described in which the image management process 62 is performed by the computer 40, but the present disclosure is not limited to this, and at least a portion of the processing included in the image management process 62 may be performed by a device provided outside the computer 40. An example of this case will be described below with reference to FIG.

[0118] Fig. 22 is a conceptual diagram showing an example of the configuration of the image management system 100. In the example shown in Fig. 22, the image management system 100 is an example of the "image processing device" according to the present disclosure.

[0119] The image management system 100 includes a computer 40 and an external device 102. For example, the external device 102 is a server, and is communicatively connected to the computer 40 via a network 16 (for example, a WAN and / or LAN, etc.). Although a server is exemplified here, at least one personal computer or the like may be used as the external device 102 instead of a server.

[0120] An example of the external device 102 is at least one server that directly or indirectly transmits and receives data to and from the computer 40 via the network 16. The external device 102 receives a processing execution instruction provided from the processor 48 of the computer 40 via the network 16. The external device 102 then executes processing in accordance with the received processing execution instruction and transmits the processing result to the computer 40 via the network 16. In the computer 40, the processor 48 receives the processing result transmitted from the external device 102 via the network 16 and executes processing using the received processing result.

[0121] An example of the processing execution instruction is an instruction to cause the external device 102 to execute at least a part of the image management processing 62. A first example of at least a part of the image management processing 62 (i.e., a processing to be executed by the external device 102) is a processing to generate a data set 74. In this case, the external device 102 executes the processing to generate the data set 74 in response to the processing execution instruction provided from the processor 48 via the network 16, and transmits a first processing result (e.g., the data set 74) that is the processing result to the computer 40 via the network 16. In the computer 40, the processor 48 receives the first processing result and executes the same processing as in the above embodiment using the received first processing result.

[0122] A second example of at least a part of the image management process (i.e., a process to be executed by the external device 102) is a process for generating a thumbnail image 76. In this case, the external device 102 executes a process for generating a thumbnail image 76 in response to a process execution instruction provided from the processor 48 via the network 16, and transmits a second processing result (e.g., the thumbnail image 76) that is the result of the process to the computer 40 via the network 16. In the computer 40, the processor 48 receives the second processing result and executes a process similar to that of the above embodiment using the received second processing result.

[0123] A third example of at least a part of the image management process (i.e., a process to be executed by the external device 102) is a process for generating an adjusted image 78A. In this case, the external device 102 executes a process for generating the adjusted image 78A in response to a process execution instruction provided from the processor 48 via the network 16, and transmits a third processing result (e.g., adjusted image 78A) that is the result of the process to the computer 40 via the network 16. In the computer 40, the processor 48 receives the third processing result and executes the same process as in the above embodiment using the received third processing result.

[0124] A fourth example of at least a part of the image management process (i.e., a process to be executed by the external device 102) is a process of generating a layout image 82A by laying out the adjusted image 78A in the layout frame image 80A. In this case, the external device 102 executes a process of generating a layout image 82A by laying out the adjusted image 78A in the layout frame image 80A in response to a process execution instruction provided from the processor 48 via the network 16, and transmits a fourth processing result (e.g., layout image 82A) that is the processing result to the computer 40 via the network 16. In the computer 40, the processor 48 receives the fourth processing result and executes a process similar to that of the above embodiment using the received fourth processing result.

[0125] The external device 102 may be realized by cloud computing. Cloud computing is merely an example, and the external device 102 may be realized by network computing such as fog computing, edge computing, or grid computing.

[0126] In the above embodiment, an example in which the image management program 60 is stored in the storage 50 has been described, but the present disclosure is not limited to this. For example, the image management program 60 may be stored in a portable, computer-readable, non-transitory storage medium such as an SSD or a USB flash drive. The image management program 60 stored in the non-transitory storage medium is installed in the computer 40 of the smart device 12. The processor 48 executes image management processing in accordance with the image management program 60.

[0127] In addition, the image management program 60 may be stored in a storage device such as another computer or server connected to the smart device 12 via a network, and the image management program 60 may be downloaded and installed on the computer 40 in response to a request from the smart device 12.

[0128] It is not necessary to store the entire image management program 60 in a storage device such as another computer or server device connected to the smart device 12, or to store the entire image management program 60 in the storage 50; only a portion of the image management program 60 may be stored.

[0129] The hardware resources that execute image management processing can include the following types of processors: Examples of processors include a CPU, which is a general-purpose processor that functions as a hardware resource that executes image management processing by executing software, i.e., a program; and dedicated electrical circuits, such as FPGAs, PLDs, or ASICs, which are processors with circuit configurations specifically designed to execute specific processes. Each processor has built-in or connected memory, and uses the memory to execute image management processing.

[0130] The hardware resource that executes the image management process may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the image management process may be a single processor.

[0131] As an example of a system configured with a single processor, first, one processor is configured with a combination of one or more CPUs and software, and this processor functions as a hardware resource that executes image management processing. Second, there is a system that uses a processor that realizes the functions of the entire system, including multiple hardware resources that execute image management processing, on a single IC chip, as typified by SoCs. In this way, image management processing is realized using one or more of the above-mentioned various processors as hardware resources.

[0132] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The image management process described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the process.

[0133] The above-described description and illustrations are a detailed explanation of the parts related to the present disclosure and are merely an example of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or elements may be replaced with other parts from the above-described description and illustrations, as long as they do not deviate from the gist of the present disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the parts related to the present disclosure, the above-described description and illustrations omit explanations of common general technical knowledge that do not require particular explanation to enable the implementation of the present disclosure.

[0134] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference. [Explanation of symbols]

[0135] 10,100 Image Management System 12 Smart Devices 13 users 14 Servers 14A Recording Media 16 Network 18 Printing device 20 Instant Film 22 Surface 24 images 25 Printed matter 26 Imaging device 28 Touch Panel Display 30 Display 32 Touch Panel 34 screens 36 Live View images 40 Computer 42 Image Sensor 44 UI devices 46 External I / F 48 processors 50 Storage 52 memory 54 Bus 56 Electrical Signals 58 Memory Card 60 Image Management Program 62 Image Management Processing 66 exposure images 68 Recommended Areas 70 Location information 71 soft keys 72 Identifier 74 datasets 76 thumbnail images 77 Selection Instructions 78 Selected Images 78A,78B,78C Adjusted image 80A, 80B, 80C Layout frame images 80A1, 80B1, 80C1 Layout Frame 82A, 82B, 80C layout images 102 External device C1,C2,C3,C4 center

Claims

1. a processor; The processor: Display the live view image on the screen, displaying a recommended area indicating a recommended position of the live view image within the live view image; acquiring a plurality of captured images each having an outer edge larger than an outer edge of the recommended area while the recommended area is displayed within the live view image; A plurality of adjusted images based on the plurality of captured images are output in a selected layout. Image processing device.

2. The adjusted image is an image whose size is adjusted so that an image area at a position corresponding to the position of the recommended area in the captured image fits into a layout frame in the layout. The image processing device according to claim 1 .

3. The size of the captured image is adjusted by adjusting the width of the captured image in accordance with the width of the layout frame and / or by adjusting the height of the captured image in accordance with the height of the layout frame. The image processing device according to claim 2 .

4. The size of the captured image is adjusted by trimming and / or reducing the captured image. The image processing device according to claim 2 .

5. The adjusted image is an image in which the shape of the captured image is adjusted to match the shape of the layout frame. The image processing device according to claim 2 .

6. The positional relationship between the recommended area and the layout frame is such that a portion of the subject that is captured in at least the center of the recommended area is disposed in the center of the layout frame. The image processing device according to claim 2 .

7. The adjusted image is an image in which the size of the captured image is adjusted to fit the image area into the layout frame in accordance with position information indicating the position of the recommended area within the captured image. The image processing device according to claim 2 .

8. The captured image and the position information are recorded in a recording medium in a state where the captured image and the position information are associated with each other, In response to a given extraction instruction, the captured image is extracted from the recording medium, and the location information associated with the captured image extracted from the recording medium is also extracted from the recording medium; The adjusted image is an image in which the size of the captured image extracted from the recording medium is adjusted to a size that fits the image area into the layout frame according to the position information extracted from the recording medium. The image processing device according to claim 7 .

9. The layout frame is a horizontally long frame or a vertically long frame when viewed from the front of the screen. The image processing device according to claim 2 .

10. The recommended area is a square area. The image processing device according to claim 1 .

11. The captured images are obtained by interval shooting or continuous shooting. The image processing device according to claim 1 .

12. The plurality of captured images are selected from a plurality of candidate images obtained by the interval imaging or the continuous imaging in accordance with a given selection instruction. The image processing device according to claim 11 .

13. the plurality of candidate images are displayed on the screen as a plurality of thumbnail images; Each of the plurality of captured images is the candidate image corresponding to the thumbnail image selected from the plurality of thumbnail images. The image processing device according to claim 12.

14. An image processing device according to any one of claims 1 to 13; an image sensor; The live view image is obtained by capturing an image with the image sensor. Terminal device.

15. Displaying live view images on the screen; displaying a recommended area indicating a recommended position of the live view image within the live view image; While the recommended area is displayed within the live view image, a plurality of captured images each having an outer edge larger than an outer edge of the recommended area are acquired; and outputting a plurality of adjusted images based on the plurality of captured images in a selected layout; The adjusted image is an image whose size is adjusted so that an image area at a position corresponding to the position of the recommended area in the captured image fits into a layout frame in the layout. Image processing methods.

16. A program for causing a computer to execute a process, The process comprises: Displaying live view images on the screen; displaying a recommended area indicating a recommended position of the live view image within the live view image; While the recommended area is displayed within the live view image, a plurality of captured images each having an outer edge larger than an outer edge of the recommended area are acquired; and outputting a plurality of adjusted images based on the plurality of captured images in a selected layout; The adjusted image is an image whose size is adjusted so that an image area at a position corresponding to the position of the recommended area in the captured image fits into a layout frame in the layout. program.

Images