Image processing device, image processing method, and recording medium

Abstract

Provided are an image processing device, an image processing method and a recording medium for relatively easily producing an album similar to a sample album. A page (74) of the sample album is displayed in a page display area (70), and a sample image (80) among the images pasted on the page (74) is displayed in a sample image display area (80). An image (I1) similar to the sample image (80) is displayed in an image selection area (90), and when an OK button (91) is clicked, the image (I1) is pasted at the position where the sample image is pasted. Images similar to sample images (Ir101 to Ir104) pasted on other image pasting areas are also found, and an album is produced in the same manner. An album similar to the sample album is produced.

Description

Technical Field

[0001] The present invention relates to an image processing device, an image processing method and a recording medium. Background Art

[0002] As digital cameras, smartphones, etc. become more popular, opportunities for taking photos increase, and the number of images obtained through taking photos gradually increases. Most images are often recorded in the form of image data on the main body of a digital camera, smartphone, etc. or a memory card. It is not easy to find the desired image from a large number of images, so there are few opportunities to view the captured images. Therefore, it is considered to keep the desired images from the many captured images as a paper album. For example, there is a technology for making a photo album with a layout corresponding to the world view of a picture book (Patent Document 1) and a technology for making albums of the same quality (Patent Document 2). In addition, sometimes adjustments such as image correction are performed when editing an album, so it is also possible to consider a technology for displaying a sample image when performing adjustments such as image correction (Patent Document 3).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2016-018418

[0006] Patent Document 2: Japanese Patent Application Publication No. 2005-184789

[0007] Patent Document 3: Japanese Patent Application Publication No. 2010-198078 Summary of the invention

[0008] Technical issues to be solved by the invention

[0009] When you want to make a photo album, it becomes extremely troublesome if the user has to select the images to be pasted in the album, determine the positions to paste the selected images in the album, and determine the sizes of the images to be pasted in the album. Sometimes, images suitable for the album are not selected, or the images are not pasted in the appropriate positions, which will lead to a decrease in the completeness of the album. Patent document 1 is a technology for making a photo album with a picture book worldview, but it does not consider making a photo album with a high degree of completeness in a simpler way. In patent document 2, a sample image with a composition of an image to be inserted in the image insertion area is inserted into the image insertion area of ​​the template as a guide image, but the template image insertion area displayed on the display screen is small, so the guide image is not clear, and it is not easy to select the image to be inserted in the image insertion area of ​​the template. In patent document 3, making a photo album is not considered.

[0010] The purpose of the present invention is to be able to produce a photo album with a high degree of completion relatively simply.

[0011] Means for solving technical problems

[0012] The image processing device based on the present invention is characterized in that it comprises: a first display control unit, which controls the display device so that a first display area is displayed on a display screen, and the first display area displays pages of an album composed of multiple pages; a second display control unit, which controls the display device so that a second display area is displayed on the display screen, and the second display area displays an image of an image pasted in an image pasting area of ​​the page displayed in the first display area; and a third display control unit, which controls the display device so that a third display area is displayed on the display screen, and the third display area displays an image different from the image displayed in the second display area.

[0013] The present invention also provides an image processing method suitable for an image processing device. That is, in this method, a first display control unit controls the display device so that a first display area is displayed on a display screen, the first display area displays a page of an album consisting of a plurality of pages, a second display control unit controls the display device so that a second display area is displayed on a display screen, the second display area displays one image of an image pasted to an image pasting area of ​​a page displayed on the first display area, and a third display control unit controls the display device so that a third display area is displayed on a display screen, the third display area displays an image different from the image displayed in the second display area.

[0014] The present invention may be as follows, that is, an image processing device includes a processor, and the processor performs the following processing: controlling the display device so that the first display area is displayed on the display screen, and the first display area displays pages of an album consisting of multiple pages; controlling the display device so that the second display area is displayed on the display screen, and the second display area displays an image in the image pasting area pasted on the page displayed in the first display area; and controlling the display device so that the third display area is displayed on the display screen, and the third display area displays an image different from the image displayed in the second display area.

[0015] The present invention also provides a computer-readable program for controlling an image processing apparatus and a recording medium storing the program.

[0016] Preferably, the third display control means displays, for example, in the third display area, an image whose similarity to the image displayed in the second display area is equal to or greater than a threshold value.

[0017] The device may also include an image input unit for inputting a plurality of images. In this case, the third display control unit may, for example, display an image having a similarity greater than a threshold value to the image displayed in the second display area from among the plurality of images input by the image input unit in the third display area.

[0018] A fourth display control unit may be further provided for controlling the display device so that a fourth display area is displayed on the display screen, wherein the fourth display area displays a plurality of images input from the image input unit.

[0019] For example, the fourth display control unit may display the plurality of images input from the image input unit in the fourth display area in the order of similarity to the images displayed in the third display area.

[0020] Preferably, the higher at least any one of the similarity with respect to the image displayed in the second display area, the consistency with respect to the facial information contained in the image displayed in the second display area, or the consistency with respect to the photographing timing of the image displayed in the second display area, the higher the similarity.

[0021] A designation unit may be provided for designating any one of the plurality of images to be displayed in the fourth display area. In this case, the third display control unit displays the image designated by the designation unit in the third display area, for example.

[0022] It may also be provided with a 5th display control unit, which controls the display device so that the 5th display area is displayed on the display screen, and the 5th display area displays at least one album among multiple albums. In this case, the 1st display control unit, for example, displays the page of the album displayed in the 5th display area in the 1st display area.

[0023] A selection unit may be provided to select a template of an album. In this case, the fifth display control unit displays the album corresponding to the template selected by the selection unit in the fifth display area, for example.

[0024] At least one of the first display control unit and the second display control unit preferably displays the second display area image in the image included in the first display area page in a reduced size compared to the second display area image.

[0025] A command input unit may also be provided for inputting a command for displaying an image other than the image displayed in the second display area. In this case, the second display control unit, for example, preferably displays an image other than the image displayed in the second display area among the images contained in the page displayed in the first display area based on the command input unit.

[0026] The device may further include an image product creating unit for creating an image product using the image displayed in the third display area.

[0027] The image product creating unit creates a photo album as an image product by, for example, pasting the image displayed in the third display area to an image pasting area corresponding to the image displayed in the second display area in the page displayed in the first display area.

[0028] Effects of the Invention

[0029] According to the present invention, by displaying the page of the reference album in the first display area and displaying the reference image in the second display area, the image displayed in the second display area is referred to and the image is displayed in the third display area, thereby finding the image pasted in the area corresponding to the image pasting area of ​​the reference album. Therefore, it is possible to create an album similar to the reference album relatively easily. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 An overview of an image processing system is shown.

[0031] Figure 2 is a block diagram showing the electrical structure of a client computer.

[0032] Figure 3 This is a flowchart showing the processing procedure of the client computer.

[0033] Figure 4 This is a flowchart showing the processing procedure of the client computer.

[0034] Figure 5 This is an example of a photo album creation window.

[0035] Figure 6 The relationship between the template and the sample album is shown.

[0036] Figure 7 The pages that make up a sample album are shown.

[0037] Figure 8 This is an example of a photo album creation window.

[0038] Fig. 9 This is a flowchart showing the sample image switching process procedure.

[0039] Fig.10 This is an example of a sample page.

[0040] Fig.11 This is an example of a page of a created photo album.

[0041] Fig.12 The process of the wedding ceremony is shown. DETAILED DESCRIPTION

[0042] Figure 1 FIG. 1 is a diagram showing an embodiment of the present invention, and shows an overview of an image processing system.

[0043] The image processing system is a system for extracting images from a plurality of images to create an album.

[0044] The image processing system includes a client computer 1 (an example of an image processing apparatus), an order receiving server 2, and a printer 3. The client computer 1 and the order receiving server 2 are communicable via the Internet. The order receiving server 2 is connected to the printer 3.

[0045] In the client computer 1, an image is extracted from a plurality of images, and image data representing the extracted image is sent to the order receiving server 2. The image data is sent from the order receiving server 2 to the printer 3, and a photo album is created in the printer 3 (an example of an image product creating unit). The created photo album is transmitted to the user of the client computer 1.

[0046] Figure 2 It is a block diagram showing the electrical structure of the client computer 1 .

[0047] The overall operation of the client computer 1 is centrally controlled by a CPU (Central Processing Unit) 10 .

[0048] The client computer 1 includes a display device 11 for displaying images and other information on a display screen, and a communication device 12 for connecting to the Internet or other networks and communicating with devices other than the client computer 1. The client computer 1 also includes a hard disk 13, a hard disk drive 14 for accessing the hard disk 13, a memory 15 for storing data, a keyboard 16 for inputting commands, and a mouse 17. The client computer 1 also includes an optical disk drive 18 for accessing an optical disk 19, and a memory card reader 20 for writing data to a memory card 21 and reading data recorded in the memory card 21.

[0049] The operation program of the client computer 1 described later is received by the communication device 12 via the Internet. The received operation program is installed in the client computer 1. The operation program may be recorded in a portable recording medium such as an optical disk 19 and read from the portable recording medium, rather than being received by the client computer 1 via a network such as the Internet and then installed in the client computer 1. In this case, the operation program read from the portable recording medium is installed in the client computer 1. The computer (CPU 10) of the client computer 1 can read the operation program.

[0050] Figure 3 and Figure 4 This is a flowchart showing the processing procedure of the client computer 1 .

[0051] In this embodiment, an album similar to the sample album is prepared with reference to the image pasted in the sample album. In this embodiment, the case of preparing a wedding album is described, but it is not limited to wedding albums and can also be applied to the case of preparing graduation albums, albums showing children's growth records, and other albums. In addition, the album can be composed of multiple pages and images (photos) can be pasted in the album, regardless of the name, including flyers, brochures, etc.

[0052] If the album making program based on this embodiment is started, the display screen of the display device 11 displays Figure 5 The photo album creation window 50 is shown (step S31).

[0053] Figure 5 This is an example of the photo album creation window 50.

[0054] A file menu button 51 displaying a character string of "file", a thumbnail menu button 52 displaying a character string of "number of thumbnails", a window menu button 53 displaying a character string of "window", and a setting menu button 54 displaying a character string of "setting" are formed at the upper left of the album creation window 50. The file menu button 51 is clicked by the user when creating a new album, etc. The setting menu button 54 is clicked by the user when specifying an image folder storing images to be pasted to a newly created album, etc.

[0055] The album creation window 50 includes an album display area 60 (an example of the fifth display area) for displaying a sample album, a page display area 70 (an example of the first display area) for displaying images of sample pages, a sample image display area 80 (an example of the second display area) for displaying sample images, a selected image display area 90 (an example of the third display area) for displaying images selected according to the album creation program or images selected by the user, and an image overview display area 100 (an example of the fourth display area).

[0056] As described later, if the template used in the album is selected by the user, multiple albums that are samples corresponding to the selected template can be found. The most suitable album from the found albums is displayed in the album display area 60. The album display area 60 is formed with a previous sample button 61 displaying a string of "previous sample" and a next sample button 62 displaying a string of "next sample". The sample albums described above are displayed in the album display area 60. By clicking the previous sample button 61, the previous sample album of the album displayed in the album display area 60 among the found multiple albums is displayed in the album display area 60. By clicking the next sample button 62, the next sample album of the album displayed in the album display area 60 among the found multiple albums is displayed in the album display area 60. When displaying an album, it is sufficient to display information that can identify the album. The album cover can be displayed, and identification information such as the album number that determines the album can also be displayed. In addition, the identification information of the album can also be displayed in a list format.

[0057] A previous page button 71 displaying a string "previous page" and a next page button 72 displaying a string "next page" are formed in the page display area 70. When the previous page button 71 is clicked, the previous page of the page displayed in the page display area 70 is displayed in the page display area 70, and when the next page button 72 is clicked, the next page of the page displayed in the page display area 70 is displayed in the page display area 70. The page displayed in the page display area 70 may be displayed as a single page in the page display area 70 of the left and right double pages, or may be displayed as a single page in the page display area 70 of either left or right double pages.

[0058] A previous image button 81 on which a character string “previous image” is displayed and a next image button 82 on which a character string “next image” is displayed are formed in the sample image display area 80. When the previous image button 81 is clicked, the image previous to the image displayed in the sample image display area 80 in the page displayed in the page display area 70 is displayed in the sample image display area 80. When the next image button 82 is clicked, the image next to the image displayed in the sample image display area 80 in the page displayed in the page display area 70 is displayed in the sample image display area 80.

[0059] A confirmation button 91 displaying a character string "Confirm" is formed in the selected image display area 90. When the confirmation button 91 is clicked, the image displayed in the selected image display area 90 is confirmed as the image to be pasted in the album.

[0060] The image list display area 100 displays a recommended image list display area 101 that lists recommended images or a time-series image list display area 102 that displays images in time order. A recommendation tab having a character string "recommended" is formed at the upper left of the recommended image list display area 101, and by clicking the recommendation tab, the recommended image list display area 101 is displayed in the image list display area 100. A time-series tab having a character string "time-series" is formed at the upper left of the time-series image list display area 102, and by clicking the time-series tab, the time-series image list display area 102 is displayed in the image list display area 100. The album display area 60, the page display area 70, the sample image display area 80, the selected image display area 90, and the image list display area 100 may overlap with each other, or may be displayed in a non-overlapping manner.

[0061] If the album creation window 50 is displayed, the user specifies an image folder storing images used in the album ( Figure 3 Step S32). If the user clicks the setting menu button 54, a setting menu appears on the display screen of the display device 11. If the menu "folder" included in the setting menu is clicked, a folder reference window (not shown) appears on the display screen of the display device 11, and the mouse 17 is used to specify a desired image folder.

[0062] Next, the user selects the template used in the album ( Figure 3 Step S33). If the user clicks the file menu button 51, a file menu appears on the display screen of the display device 11. If the menu "New" included in the file menu is clicked, a new window (not shown) appears on the display screen of the display device 11, and the desired template is selected using the mouse 17 (an example of a selection unit).

[0063] If a template is selected, a suitable album is found from past sample albums created using the selected template in the following manner (step S34).

[0064] Figure 6 The relationship between the template selected by the user (assuming that the template T1 is selected) and the sample album created using the template is shown.

[0065] Assume that there are sample albums Ab1 to Ab10 in the sample albums created using the template T1. In the sample album Ab1, the sample images Ir100 to Ir199 are pasted in the image pasting area of ​​the template T1.

[0066] Figure 7 A part of the pages constituting the sample album Ab1 is shown.

[0067] Sample album Ab1 is a double-page spread of pages 1 to 18 (excluding the front and back covers). Sample images Ir100 to Ir104 are pasted on page 1 according to the layout of template T1. Sample images Ir105 to Ir109 are pasted on page 2 according to the layout of template T1. Sample images are also pasted on other pages according to the layout of template T1, and sample images Ir195 to Ir199 are pasted on page 18 according to the layout of template T1.

[0068] As with the sample album Ab1, sample albums Ab2 to Ab10 other than the sample album Ab1 also have sample images Ir200 to Ir1099 pasted in accordance with the layout of the template T1. Sample images Ir200 to Ir299, Ir300 to Ir399, Ir400 to Ir499, Ir500 to Ir599, Ir600 to Ir699, Ir700 to Ir799, Ir800 to Ir899, Ir900 to Ir999, and Ir1000 to Ir1099 pasted in the sample albums Ab2, Ab3, Ab4, Ab5, Ab6, Ab7, Ab8, Ab9, and Ab10, respectively.

[0069] Among the sample images Ir100 to Ir1099 pasted in the sample albums Ab1 to Ab10, sample images having a similarity above a threshold with images stored in an image folder set by the user can be found. The sample album using the most sample images above the threshold is suitable as the sample album used by the user.

[0070] The sample album thus found is displayed in the album display area 60 ( Figure 3 Step S35) In this embodiment, it is assumed that the sample album Ab1 is suitable as a sample album.

[0071] Figure 8 This is an example of the photo album creation window 50.

[0072] The cover 64 of the sample album Ab1 is displayed in the album display area 60 of the album creation window 50. By observing the cover 64, the user can know that the album can be created by referring to the sample album Ab1 having the cover 64. By clicking the previous sample button 61 or the next sample button 62, any cover of the sample albums Ab2 to Ab10 other than the cover 64 of the sample album Ab1 displayed in the album display area 60 is displayed in the album display area 60. In the lower center of the sample album display area 60, a character string 63 is displayed, indicating which sample album cover is displayed among the sample albums Ab1 to Ab10 of the template T1 selected by the user. The denominator of the character string 63 is the number of the sample albums Ab1 to Ab10 of the template T1 selected by the user, and the numerator of the character string 63 is a number indicating which album is displayed in the album display area 60.

[0073] Furthermore, in the page display area 70 displayed by the CPU 10 (an example of the first display control unit), the first page ( Figure 3 Step S36). Figure 8 In the example shown, the cover 64 of the sample album Ab1 is displayed in the album display area 60, and therefore the first page 74 of the sample album Ab1 is displayed in the page display area 70. As described above, the sample images Ir100, Ir101, Ir102, Ir103, and Ir104 are pasted on the first page 74. By clicking the previous page button 71, the previous page of the page displayed in the page display area 70 is displayed in the page display area 70 (in this case, there is no previous page, so the previous page button 71 cannot be clicked.). By clicking the next page button 72, the next page of the page displayed in the page display area 70 is displayed in the page display area 70. In the lower center of the page display area 70, a character string 73 indicating which page of the sample album the page displayed in the page display area 70 is is displayed. The denominator of the character string 73 is the total number of pages in the album, and the numerator of the character string 73 indicates which page the page displayed in the page display area 70 is.

[0074] In the sample image display area 80 displayed by the CPU 10 (an example of the second display control unit), the first image ( Figure 4 Step S37). Figure 8In the example shown, the first page 74 of the sample album Ab1 is displayed in the page display area 70, so the first sample image Ir100 (an example of a single image) of the first page 74 is displayed in the sample image display area 80. The sample image Ir100 displayed in the page display area 70 is smaller than the sample image Ir100 displayed in the sample image display area 80. The sample image Ir100 displayed in the sample image display area 80 is large and therefore easy to confirm. By clicking the previous image button 81, among the sample images Ir100 to Ir104 pasted on the page 74 displayed in the page display area 70, the previous image of the sample image Ir100 displayed in the sample image display area 80 is displayed in the sample image display area 80 (in this case, there is no previous image of the sample image Ir100, so the previous image button 81 cannot be clicked. However, the last sample image among the images pasted on the page previous to the page on which the sample image Ir100 is pasted may be displayed.). By clicking the next image button 82, the next image of the image Ir100 displayed in the sample image display area 80 is displayed in the sample image display area 80. A character string 83 indicating the image number of the page in which the sample image Ir100 displayed in the sample image display area 80 is displayed is displayed in the lower center of the sample image display area 80. The denominator of the character string 83 indicates the total number of images in the page in which the sample image Ir100 is displayed, and the numerator indicates the image number of the sample image Ir100 among the images displayed on the page.

[0075] The similarity between the image stored in the image folder selected by the user {the image recorded in the memory card 21 or the like, and the image read by the client computer through the memory card reader / writer 20 (an example of an image input unit for inputting a plurality of images)} and the sample image Ir100 displayed in the sample image display area 80 is calculated. From the images stored in the image folder selected by the user, an image having the highest similarity with the sample image Ir100 displayed in the sample image display area 80 and above a threshold value is found ( Figure 4 Step S38). The found image is displayed in the selected image display area 90 (step S38) by the CPU 10 (step S38) as the selected image 92 (step S38) ... as the selected image 92 (step S38) (step S38) as the selected image 92 (step S38) (step S38) Figure 4 Step S39) When the confirmation button 91 formed in the selection image display area 90 is clicked, the selection image 92 displayed in the selection image display area 90 is confirmed as the image pasted at the position of the page where the sample image Ir100 is pasted.

[0076] Next, an image whose similarity to the sample image Ir100 displayed in the sample image display area 80 is greater than a threshold value is found from the images stored in the image folder selected by the user ( Figure 4Step S40). The found images are displayed in a list in the recommended image list display area 101 (displayed by the CPU 10 (an example of the fourth display control unit)). Figure 4 Step S41).

[0077] The recommended images I1 to I15 are displayed in the recommended image list display area 101 in the order of high similarity with the sample image Ir100 displayed in the sample image display area 80. It is possible to understand which image is similar to the sample image. Images not displayed in the recommended image list display area 101 are displayed in the recommended image list display area 101 by scrolling. Check boxes B1 to B15 are formed on the left side of the recommended images I1 to I15. The recommended image I1 among the recommended images I1 to I15 displayed in the recommended image list display area 101 is displayed in the selected image display area 90, so the check box B1 formed on the left side of the recommended image I1 is checked. When an image other than the recommended image I1 is displayed in the selected image display area 90, any one of the check boxes B1 to B15 formed on the left side of the recommended image to be displayed is checked. The desired image can be selected. For example, if the check box B2 is checked by the mouse 17 (an example of a designation unit), the recommended image I2 corresponding to the check box B2 is displayed in the selected image display area 90, and the check box B1 is removed. By displaying the desired image in the selected image display area 90, the user can determine the image to be pasted in the album while comparing it with the sample image Ir100 displayed in the sample image display area 80. However, it is also possible to provide an image change button or the like inside or outside the selected image display area 90 instead of displaying it in the image list display area 100 (the recommended image list display area 101, the time-series image list display area 102), and switch the image displayed in the selected image display area 90 by clicking the image change button or the like. The images to be switched and displayed may be in the order of similarity to the sample image Ir100, or may not be in the order of similarity. Furthermore, when there are many images displayed in the recommended image list display area 101, the similarity threshold can be increased to reduce the images displayed in the recommended image list display area 101. Conversely, when there are few images displayed in the recommended image list display area 101, the images displayed in the recommended image list display area 101 can be increased.

[0078] exist Figure 8In the state shown, if the previous sample button 61 formed in the album display area 60 is clicked, the cover of the sample album Ab10 is displayed instead of the cover 64 of the sample album Ab1 displayed in the album display area 60. And, if the next sample button 62 formed in the album display area 60 is clicked, the cover of the next sample album Ab2 is displayed instead of the cover 64 of the sample album Ab1 displayed in the album display area 60. If the previous sample button 61 is clicked, the first page of the sample album Ab10 is displayed in the album display area 60, and if the next sample button 62 is clicked, the first page of the sample album Ab2 is displayed in the page display area 70.

[0079] When there is a previous page of the page 74 displayed in the page display area 70, if the previous page button 71 is clicked, the previous page is displayed in the page display area 70. The first sample image of the previous page is displayed in the sample image display area 80. When there is a next page of the page 74 displayed in the page display area 70, if the next page button 72 is clicked, the next page is displayed in the page display area 70. The first sample image of the next page is displayed in the sample image display area 80.

[0080] If the previous image button 81 or the next image button 82 formed in the sample image display area 80 is clicked, a switching instruction is generated and the sample image displayed in the sample image display area 80 is switched. However, even if the previous image button 81 or the next image button 82 formed in the sample image display area 80 is not clicked, a switching instruction is generated and the sample image Ir100 displayed in the sample image display area 80 is switched by clicking the previous sample button 61 or the next sample button 62 formed in the album display area 60, or by clicking the previous page button 71 or the next page button 72 formed in the page display area 70.

[0081] Fig. 9 This is a flowchart showing the processing procedure of the client computer 1 when a switching instruction is generated.

[0082] As described above, if the previous sample button 61, the next sample button 62, the previous page button 71, the next page button 72, the previous image button 81 or the next image button 82 (an example of an instruction input unit) is clicked, a switching instruction is generated, and the sample image corresponding to the clicked button is displayed in the sample image display area 80 (step S101).

[0083] When the sample image displayed in the sample image display area 80 is switched and a new sample image (an example of an image other than the image displayed in the sample image display area 80 among the images contained in the page displayed in the page display area 70) is displayed in the sample image display area 80 (step S102), the similarity of the image stored in the image folder designated by the user to the switched sample image is calculated. The image with the highest calculated similarity is found (step S103), and the found image is displayed in the selected image display area 90 (step S104). Furthermore, an image with a similarity greater than or equal to a threshold value is found from the images stored in the image folder designated by the user (step S105), and the images stored in the image folder designated by the user are displayed in the recommended image list display area 101 in the order of high similarity (step S106).

[0084] In this way, every time the sample image displayed in the sample image display area 80 changes, the image displayed in the selected image display area 90 is switched, and the images displayed in the recommended image list display area 101 and the display order of the images also change.

[0085] Fig.10 is an example of a sample page 74 displayed in the page display area 70, and Figure 8 The sample shown is enlarged compared to page 74. Fig.11 This is an example of a page Pg constituting a photo album created by referring to the sample page 74 .

[0086] refer to Fig.10 Image pasting areas Ar1, Ar2, Ar3, Ar4 and Ar5 are formed on the sample page 74, and sample images Ir100, Ir101, Ir102, Ir103 and Ir104 are pasted in these image pasting areas Ar1, Ar2, Ar3, Ar4 and Ar5, respectively.

[0087] refer to Fig.11 In the page Pg, image pasting areas Ar1, Ar2, Ar3, Ar4, and Ar5 are formed in the same layout as the sample page. Images Ir1, Ir21, Ir22, Ir12, and Ir11 stored in the image folder selected by the user are pasted in these image pasting areas Ar1, Ar2, Ar3, Ar4, and Ar5.

[0088] Paste on Fig.11 The image Ir1 in the image pasting area Ar1 of the page Pg shown is pasted on the reference Fig.10 The image Ir100 of the image pasting area Ar1 of the sample page 74 shown in the figure is selected as an image with high similarity in composition, etc. Fig.10The sample image Ir101 of the image pasting area Ar2 is pasted on Fig.11 The image Ir21 of the image pasting area Ar2 is pasted on Fig.10 The sample image Ir102 of the image pasting area Ar3 is pasted on Fig.11 The image Ir22 of the image pasting area Ar3 is pasted on Fig.10 The sample image Ir103 of the image pasting area Ar4 is pasted on Fig.11 The image Ir12 of the image pasting area Ar4 and the image pasted on Fig.10 The sample image Ir104 of the image pasting area Ar5 is pasted on Fig.11 The images Ir11 in the image pasting area Ar5 are all images with high similarity in composition, etc. A photo album of the page Pg having the same impression as the sample page 74 is created. Data representing the page Pg thus created is sent to the order receiving server 2, and a paper photo album is created by the printer 3. However, template data, data representing the selected image, and data representing the pasting position of the image may be sent to the order receiving server 2 to create data representing the photo album in the order receiving server 2. Pages other than the page Pg may be created in the same manner as the sample pages of the sample photo album, and the user may create a photo album similar to the sample photo album.

[0089] The images displayed in the selected image display area 90, the images displayed in the recommended image list display area 101, and the order of the images are determined based on the similarity with respect to the sample image displayed in the sample image display area 80. However, the similarity is not only the similarity obtained by comparing the images, but also the consistency of the information of the face contained in the sample image and the information of the face contained in the image stored in the image folder selected by the user (the information of the face refers to all the information known from the face, and may be any one of the number of faces contained in the image, the size of the face relative to the image, and the gender known from the face). For example, the face contained in the sample image and the face contained in the image stored in the image folder specified by the user may be subjected to face recognition processing respectively, and the consistency of the face obtained by face recognition may be set as the similarity. In addition, the similarity may also use the similarity of the shooting timing of the image. For example, if the shooting timing of the sample image and the shooting timing of the image stored in the image folder specified by the user have a high consistency, it can be regarded as a high similarity.

[0090] Fig.12 The relationship between the flow of the wedding ceremony and the timings at which the sample images Ir100 to Ir199 pasted on the respective pages of the sample album Ab1 in the wedding ceremony are photographed is shown.

[0091] For example, the wedding ceremony begins at time t0, and the bride and groom enter before time t1. From time t1 to time t2, the bride and groom are introduced, and from time t2 to time t3, the guests of honor are greeted. From time t3 to time t4, toasts are made, from time t4 to time t5, the wedding cake is cut, and from time t5 to time t6, there is a chat and a meal. From time t6 to time t7, there are entertainment performances by guests, from time t7 to time t8, there is a flower-giving ceremony to parents, and from time t8 to time t9, there is a thank-you speech by the bride and groom. In this way, in activities such as wedding ceremonies, a general process has been determined, and objects to be photographed in each time period have also been determined.

[0092] In the sample album, sample images of the contents of the flow of the activity are pasted in the sample album. For example, images corresponding to the "bride and groom entering the venue" performed from time T0 to time T1 are pasted on pages 1 and 2 of the sample album. Images corresponding to the "introduction of the bride and groom" are pasted on pages 3 and 4 of the sample album. Similarly, images corresponding to the "greetings from the host and the guest" are pasted on page 5 of the sample album, images corresponding to the "cheers" are pasted on page 6 of the sample album, images corresponding to the "wedding cake cutting ceremony" are pasted on pages 7 and 8 of the sample album, images corresponding to the "conversation and dining" are pasted on pages 9 to 12 of the sample album, images corresponding to the "entertainment performances of the guests" are pasted on pages 13 to 15 of the sample album, images corresponding to the "flower presentation ceremony" are pasted on pages 16 and 17 of the sample album, and images corresponding to the "speech of thanks" are pasted on page 18 of the sample album.

[0093] The time of shooting is recorded in the image file title, so by referring to the shooting time, it is possible to know at which shooting timing the image was shot. Among the images stored in the image folder selected by the user, images with the same shooting timing as the images displayed in the sample image display area 80 are corrected in a manner that increases the similarity, and images with different shooting timings from the images displayed in the sample image display area 80 are corrected in a manner that decreases the similarity, so that the image with the highest corrected similarity can be displayed in the selected image display area 90. Furthermore, the images can be displayed in the recommended image list display area 101 in the order of the corrected similarity. For example, in Figure 8In the example, without considering the shooting timing, it is assumed that the similarity between the sample image Ir100 and the image I1 is 0.8, and the similarity between the present image Ir100 and the image I2 is 0.75. Without considering the shooting timing, the image I1 is found as the image with the highest similarity to the sample image Ir100, and the image I1 is displayed in the selected image display area 90. In contrast, the sample image Ir100 is the image of the first page, and therefore can be considered as the sample image of the scene of "the bride and groom enter" from time T0 to time T1. It is assumed that the image I1 was taken in the scene of "the flower presentation ceremony" from time T7 to time T8, and the image I2 was taken in the scene of "the bride and groom enter" from time T0 to time T1. Image I1 is an image taken in the scene of "the flower presentation ceremony", and it is considered that it does not match the first page to the second page where the image of "the bride and groom enter" is pasted. For example, the correction value of the similarity of the image I1 with respect to the photographing timing is 0, and the correction value of the similarity of the image I2 with respect to the photographing timing is 0. Since the correction value is 0, the similarity of the image I1 is 0.8+0=0.8, and since the correction value is 0.1, the similarity of the image I2 is 0.75+0.1=0.85. The similarity of the image I2 is greater than that of the image I1, and the image I2 is displayed in the selected image display area 90.

[0094] In this way, the similarity can be improved by taking into account the shooting timing. The shooting timing can also be the shooting time itself.

[0095] In the above-mentioned embodiment, in the recommended image list display area 101, images to be displayed are selected and displayed according to the degree of similarity, and in the time-series image list display area 102, images to be displayed are selected and displayed according to the time sequence, but other selection methods and display methods may be used. For example, in the recommended image list display area 101, images to be displayed are selected according to the degree of similarity when the degree of consistency of the shooting timing is not considered, but a display method such as marking a preferred mark near an image whose degree of consistency of the shooting timing is higher than a threshold value may be used. And, for example, in the time-series image list display area 102, the image to be displayed is selected according to the time sequence, which is the same as in the above-mentioned embodiment, but a display method such as marking a preferred mark near an image displayed in the sample image display area 80 and an image whose similarity is higher than a threshold value may be used.

[0096] In the above embodiment, a wedding photo album is created, but a photo album other than a wedding photo album can be created with reference to a sample photo album. For example, a photo album that summarizes school activities over the past year can also be created. In this case, when a new photo album is created using a photo album created a year ago as a sample, many activities that take place over the past year are held at the same time each year, so the similarity of images taken at the same time can also be increased.

[0097] The processing unit that executes the above-mentioned processing includes, in addition to the CPU 10 that executes software and functions as various processing units, programmable logic devices such as FPGA (field-programmable gate array) that can change the circuit structure after manufacturing, and ASIC (application specific integrated circuit) and other processors with circuit structures specially designed to execute specific processing, that is, dedicated electrical circuits.

[0098] A processing unit may be composed of one of these various processors, or may be composed of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs or a CPU and an FPGA). As an example of a plurality of processing units being composed of one processor, first, there is a method in which a processor is composed of a combination of one or more CPUs and software, such as represented by a client computer or a server, and the processor functions as a plurality of processing units. Second, there is a method in which a processor is used to implement the functions of the entire system including a plurality of processing units by an IC (integrated circuit) chip, such as represented by a system on a chip. In this way, various processing units are composed of one or more various processors as a hardware structure.

[0099] Furthermore, more specifically, the hardware structure of these various processors is an electric circuit in which circuit elements such as semiconductor elements are combined.

[0100] Explanation of symbols

[0101] 1-client computer, 2-order receiving server, 3-printer, 10-CPU, 11-display device, 12-communication device, 13-hard disk, 14-hard disk drive, 15-memory, 16-keyboard, 17-mouse, 18-optical disk drive, 19-optical disk, 20-memory card reader / writer, 21-memory card, 50-album creation window, 51-file menu button, 52-thumbnail button, 53-window menu button, 54-setting menu button, 60-album display area, 61-previous sample button, 62-next sample button, 63-character string, 64-cover, 70-page display area, 71-previous page button, 72-next page button, 73 -character string, 74-page 1, 80-sample image display area, 81-previous image button, 82-next image button, 83-character string, 90-select image display area, 91-confirm button, 92-select image, 100-image list display area, 101-recommended image list display area, 102-time series image list display area, Ab1-Ab10-sample album, Ar1-Ar5-image paste area, B1-B2-check box, I1-I2-recommended image, Ir1-Ir2-image, Ir100-Ir1099-sample image, Ir11-Ir12-image, Ir21-Ir22-image, T1-template.

Claims

1. An image processing device comprising: a first display control unit for controlling the display device so that a first display area is displayed on the display screen, the first display area displaying pages of a sample album consisting of a plurality of pages that cannot be edited; a second display control unit that controls the display device so that a second display area is displayed on the display screen, the second display area displaying one sample image among sample images pasted to the image pasting area of ​​the page displayed in the first display area; and a third display control unit configured to control the display device so that a third display area is displayed on the display screen, the third display area displaying an image different from the sample image displayed in the second display area, The third display control unit displays, in the third display area, an image whose similarity to the sample image displayed in the second display area is greater than or equal to a threshold value.

2. The image processing device according to claim 1, wherein: The image processing device further includes an image input unit, the image input unit inputting a plurality of images, The third display control unit displays, in the third display area, an image whose similarity to a sample image displayed in the second display area is greater than or equal to a threshold value among the plurality of images input by the image input unit.

3. The image processing device according to claim 2, wherein: The image processing device further includes a fourth display control unit configured to control the display device so that a fourth display area is displayed on the display screen, the fourth display area displaying a plurality of images input from the image input unit.

4. The image processing device according to claim 3, wherein: The fourth display control unit displays the plurality of images input from the image input unit in the fourth display area in order of similarity to the images displayed in the third display area.

5. The image processing device according to claim 4, wherein: The similarity is higher the higher at least any one of the similarity with respect to the sample image displayed in the second display area, the consistency with respect to the information of the face contained in the sample image displayed in the second display area, and the consistency with respect to the shooting timing of the sample image displayed in the second display area.

6. The image processing device according to claim 3, wherein: The image processing device further includes a specifying unit that specifies any image among the plurality of images displayed in the fourth display area. The third display control unit displays the image designated by the designation unit in the third display area.

7. The image processing device according to claim 1, wherein: The image processing device further includes a fifth display control unit configured to control the display device so that a fifth display area is displayed on the display screen, wherein the fifth display area displays at least one sample album among a plurality of sample albums. The first display control unit causes the page of the sample album displayed in the fifth display area to be displayed in the first display area.

8. The image processing device according to claim 7, wherein: The image processing device further includes a selection unit, which selects a template for the album. The fifth display control unit displays a sample album corresponding to the template selected by the selection unit in the fifth display area.

9. The image processing apparatus according to claim 1, wherein: At least one of the first display control unit and the second display control unit displays a sample image to be displayed in the second display area among sample images included in the page displayed in the first display area in a reduced size compared to the sample image displayed in the second display area.

10. The image processing apparatus according to claim 1, wherein: The image processing device further includes a command input unit for inputting a command to display a sample image other than the sample image displayed in the second display area. The second display control unit displays, in response to an instruction input from the instruction input unit, sample images other than sample images displayed in the second display area among sample images included in the page displayed in the first display area.

11. The image processing apparatus according to claim 1, wherein: The image processing device further includes an image product creating unit that creates an image product using the image displayed in the third display area.

12. The image processing device according to claim 11, wherein: The image product creating unit creates an album as an image product by pasting the image displayed in the third display area to an image pasting area corresponding to the sample image displayed in the second display area in the page displayed in the first display area.

13. An image processing method, wherein: The first display control unit controls the display device so that a first display area is displayed on the display screen, wherein the first display area displays a page of a sample album that cannot be edited and is composed of a plurality of pages. a second display control unit controlling the display device so that a second display area is displayed on the display screen, wherein the second display area displays one sample image among sample images pasted to the image pasting area of ​​the page displayed in the first display area; a third display control unit controlling the display device so that a third display area is displayed on the display screen, the third display area displaying an image different from the sample image displayed in the second display area; The third display control unit displays, in the third display area, an image whose similarity to the sample image displayed in the second display area is greater than or equal to a threshold value.

14. A recording medium storing a program, the program being a computer for controlling an image processing device and being readable by the computer, the program controlling the computer of the image processing device in the following manner: Controlling the display device in such a manner that a first display area is displayed on the display screen, wherein the first display area displays pages of a sample album that cannot be edited and is composed of a plurality of pages; controlling the display device so that a second display area is displayed on the display screen, the second display area displaying one sample image among sample images pasted to the image pasting area of ​​the page displayed in the first display area; controlling the display device so that a third display area is displayed on the display screen, the third display area displaying an image different from the sample image displayed in the second display area, An image having a similarity greater than or equal to a threshold value with respect to the sample image displayed in the second display area is displayed in the third display area.

Images