Image processing device and method, and program

Abstract

The present invention includes: a reception means for receiving an operation by a user; and a display control means for performing control to cause a display device to display a display screen in which are arranged a layout selection area for selecting a layout for arranging images and an image selection area for selecting an image to be arranged in the layout. The display control means changes a selectable layout in the layout selection area in response to a change, due to a user operation, in the selection of an image in the image selection area, and performs control so as to display, as the selectable layout, a layout in which at least the number of selected images selected in the image selection area can be arranged.

Description

Image processing device, method, and program

[0001] The present invention relates to an image processing device, method, and program, and more particularly to an image processing device, method, and program for laying out images obtained by photography or the like.

[0002] 2. Description of the Related Art Conventionally, there has been a printing system capable of arranging and printing a plurality of photographic images taken by an imaging device on a single sheet of paper (see Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2005-35280

[0004] However, in the printing system described in Patent Document 1, the image selection screen and the layout selection / preview screen for layout printing, in which multiple images are arranged on one sheet of paper, are different screens, making operation very cumbersome. For example, if the desired print result is not obtained after selecting an image, selecting a layout, and checking the preview, the user must return to the image selection screen to reselect the image.

[0005] The present invention has been made in consideration of the above problems, and has as its object to make it easier to select a layout and images to be arranged.

[0006] In order to achieve the above object, the image processing device of the present invention has a reception means for receiving operations by a user, and a display control means for controlling the display device to display a display screen that has a layout selection area for selecting a layout in which images are to be arranged, and an image selection area for selecting images to be arranged in the layout, and the display control means changes the layouts that can be selected in the layout selection area in response to a change in the selection of images in the image selection area by user operation, and controls the display device to display as the selectable layout a layout that can accommodate more images than the number of selected images selected in the image selection area.

[0007] According to the present invention, it is possible to make the operation of selecting a layout and an image to be arranged easier.

[0008] Other features and advantages of the present invention will become apparent from the following description taken in conjunction with the accompanying drawings, in which the same or similar elements are designated by the same reference numerals.

[0009] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments of the present invention, and are used, together with the description, to explain the principles of the present invention. A diagram showing the configuration of a printing system according to an embodiment of the present invention. A diagram showing an example of the functional configuration and appearance of a mobile device, which is an example of an image processing apparatus according to an embodiment. A diagram showing an example of the functional configuration and appearance of a mobile device, which is an example of an image processing apparatus according to an embodiment. A diagram showing an example of an image according to an embodiment. A diagram showing an example of a layout and an example of a layout image that can be used in a layout printing application according to an embodiment. A diagram showing an example of a layout and an example of a layout image that can be used in a layout printing application according to an embodiment. A diagram showing an example of a layout and image selection screen of the layout printing application according to an embodiment. A diagram showing screen transitions during a layout selection operation according to an embodiment. A diagram showing screen transitions during a layout selection operation according to an embodiment. A diagram showing screen transitions during a layout selection operation according to an embodiment. A diagram showing screen transitions during a layout selection operation according to an embodiment. A diagram showing screen transitions during a layout selection operation according to an embodiment. A diagram showing screen transitions during a layout selection operation according to an embodiment. A diagram showing screen transitions during a layout selection operation according to an embodiment. A diagram showing screen transitions during a layout selection operation according to an embodiment. A diagram showing screen transitions when the number of selected images increases during image selection according to an embodiment. FIG. 1 shows a screen transition when the number of selected images increases when selecting images in an embodiment. FIG. 2 shows a screen transition when the number of selected images increases when selecting images in an embodiment. FIG. 3 shows a screen transition when the number of selected images increases when selecting images in an embodiment. FIG. 4 shows a screen transition when the number of selected images decreases when selecting images in an embodiment. FIG. 5 shows a screen transition when the number of selected images decreases when selecting images in an embodiment. FIG. 6 shows a screen transition when the number of selected images decreases when selecting images in an embodiment. FIG. 7 shows a screen transition when the number of selected images decreases when selecting images in an embodiment. FIG. 8 shows a simple preview image stored in a working memory in an embodiment. FIG. 9 shows a simple preview image stored in a working memory in an embodiment.10 is a flowchart showing a display process of a layout / image selection screen by a layout printing application according to an embodiment.

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] 1 is a diagram showing an example of a printing system according to this embodiment, and shows a configuration including a mobile device 100, which is an example of an image processing apparatus according to this embodiment, and a printing apparatus 200. Print data generated using a layout printing application according to this embodiment executed on the mobile device 100 can be sent to the printing apparatus 200 and printed by the printing apparatus 200.

[0012] Communication between the mobile device 100 and the printing device 200 may be wireless communication, such as wireless LAN (Local Area Network), or wired communication, such as USB (Universal Serial Bus) or Ethernet. Furthermore, when a wireless LAN is used for communication between the mobile device 100 and the printing device 200, communication may be via a router 300 that has a wireless LAN access point separate from the mobile device 100 or the printing device 200. Alternatively, the mobile device 100 or the printing device 200 may be provided with a simple wireless LAN router function, and the mobile device 100 and the printing device 200 may communicate using that wireless LAN router function.

[0013] 2A and 2B, an outline of the configuration and functions of a mobile device 100 such as a smartphone or tablet device will be described as an example of a device to which the image processing device of this embodiment is applied. Note that in addition to smartphones and tablet devices, the present invention can also be applied to devices such as digital cameras, portable media players, personal computers, and game consoles as image processing devices.

[0014] Fig. 2A is a block diagram showing the functional configuration of mobile device 100, and Fig. 2B is a diagram showing an example of the appearance of mobile device 100 as seen from the front. In Fig. 2A, control unit 101 controls each unit of mobile device 100 in accordance with input signals and programs stored in non-volatile memory 103. Note that instead of control of the entire mobile device 100 by control unit 101, the entire mobile device 100 may be controlled by multiple pieces of hardware sharing the processing.

[0015] The imaging unit 102 converts subject light imaged by a lens included in the imaging unit 102 into an electrical signal, performs signal processing such as noise reduction and A / D conversion, and outputs the resulting digital data as image data. The image data thus obtained is stored in a working memory 104 used as a buffer memory, and then undergoes predetermined image processing in the control unit 101 and is recorded in a storage medium 110. It is also possible to store the captured image data in an external storage device using an online storage service, including a social networking service on the Internet, via the public network connection unit 113 or the connection unit 111. When storing the image data in an external storage device using an online storage service, the OS (Operating System) of the mobile device 100 or an installed application may automatically upload all images, or only images specified by the user may be uploaded.

[0016] The non-volatile memory 103 is an electrically erasable and recordable non-volatile memory, and stores various programs executed by the control unit 101. The layout printing program of this embodiment is also held in the non-volatile memory 103 and installed as a layout printing application. The layout printing application may be installed in the storage medium 110. The processing of the mobile device 100 in this embodiment is realized by loading the layout printing application. The layout printing application also has a program for utilizing the basic functions of the OS installed in the mobile device 100. The OS of the mobile device 100 may have a program for realizing the processing of this embodiment.

[0017] The working memory 104 is used as a buffer memory for temporarily storing image data generated by the imaging unit 102, as image display memory for the display unit 106, and as a working area for the control unit 101. In the layout printing application of this embodiment, the working memory 104 is also used as a temporary storage destination for simple preview images, which will be described later.

[0018] The operation unit 105 is used to receive instructions from the user for the mobile device 100. The operation unit 105 includes operation members such as a power button 105a for turning on / off the power of the mobile device 100 shown in FIG. 2B , a volume up button 105b, a volume down button 105c, and a touch panel 105d formed on the display unit 106.

[0019] The display unit 106 displays image data, characters for interactive operations, icons for various application operations, etc. The display unit 106 does not necessarily have to be built into the mobile device 100. In other words, the mobile device 100 only needs to be able to connect to an external display unit 106 and have at least a display control function for controlling the display of the display unit 106.

[0020] The storage medium 110 can record image data output from the imaging unit 102 as an image file. The storage medium 110 may be configured to be detachable from the mobile device 100, or may be built into the mobile device 100. That is, the mobile device 100 only needs to have a means for accessing the storage medium 110. The non-volatile memory 103 and the storage medium 110 do not necessarily need to be configured as independent hardware, and the non-volatile memory 103 may have the functions of the storage medium 110 described in this embodiment. Also, as described above, the layout printing application of this embodiment may be installed on the storage medium 110.

[0021] The connection unit 111 is an interface for communicating with other devices, including the printing device 200. The mobile device 100 of this embodiment can exchange data with the printing device 200 via the connection unit 111. In this embodiment, the connection unit 111 includes an interface for communicating with the printing device 200 via a wireless LAN, and the control unit 101 controls the connection unit 111 to realize wireless LAN communication with the printing device 200.

[0022] The public network connection unit 113 is an interface used when performing public wireless communication. The mobile device 100 can make calls and perform data communication with other devices via the public network connection unit 113. When making a call, the control unit 101 inputs and outputs audio signals via the microphone 114 and the speaker 115. The public network connection unit 113 includes an interface for performing communication using 4G. Note that other communication methods, such as LTE, WiMAX, ADSL, FTTH, so-called 3G, or 5G, may also be used instead of 4G. Furthermore, the connection unit 111 and the public network connection unit 113 do not necessarily need to be configured as independent hardware, and for example, a single antenna may be used for both.

[0023] 3 is a diagram showing examples of images stored in the storage medium 110 of the mobile device 100. The layout printing application in this embodiment reads these images from the storage medium 110, processes them according to the printing paper used in the printing device 200 and the layout described below, and generates print data.

[0024] 3 shows only 15 images, but in reality, more than several thousand image files may be stored in the storage medium 110 of the mobile device 100. These image files may be stored in the nonvolatile memory 103 of the mobile device 100, or may be stored in a device other than the mobile device 100 or in an external storage device provided by an online storage service. In the latter case, the image data may be downloaded from the external storage device to the nonvolatile memory 103 or the working memory 104 via the connection unit 111 or the public network connection unit 113 and used.

[0025] FIG. 4A is a diagram showing an example of a layout that can be used with the layout printing application of this embodiment. The layout printing application of this embodiment can apply a user-selected image to each frame of each layout to create a layout image such as that shown in FIG. 4B, and print it using the printing device 200. FIG. 4A shows eight layouts, layouts 1 to 8, as examples, but the present invention is not limited to eight types and may have more or less than eight types. Furthermore, the layout design is not limited to the layout shown in FIG. 4A, and any layout design can be used. Furthermore, the layout may be changed depending on settings in the layout printing application, such as the type of printing device 200 and the paper size used for printing on the printing device 200.

[0026] Next, a description will be given of a layout printing application according to this embodiment that runs on the mobile device 100. Fig. 5 is a diagram showing an example of a layout and image selection screen (display image) in the layout printing application according to this embodiment.

[0027] 5, the layout selection area 500 is an area for selecting a layout from layouts 1 to 8 shown in FIG. 4A in the layout printing application. The layout selection area 500 displays layouts in three candidate layout display areas: a selected candidate layout display area 501, a previous candidate layout display area 504, and a next candidate layout display area 505. The layouts displayed in the selected candidate layout display area 501, the previous candidate layout display area 504, and the next candidate layout display area 505 can be switched sequentially by operating the scroll bar 506, using the display layout switching buttons 507 or 508, or by swiping the layout selection area 500. The multiple layouts displayed in the layout selection area 500 are displayed in order of the number of images that can be arranged in each layout.

[0028] The layout displayed in the selection candidate layout display area 501 is the currently selected layout, and therefore it is desirable to display it prominently compared to the layouts displayed in the previous candidate layout display area 504 and the next candidate layout display area 505. Possible methods for making it prominent include, for example, displaying the layout in the selection candidate layout display area 501 larger than the other layouts, or displaying a special frame around the selection candidate layout display area 501. Other possible methods include, for example, shading the layout display areas other than the selection candidate layout display area 501, or displaying them in a lighter color.

[0029] The image selection area 510 is an area for displaying thumbnail images of image data that can be used for layout and for selecting images to be laid out. Image data in the non-volatile memory 103 and storage medium 110 in the mobile device 100 is searched, and image data that can be used for layout is displayed side by side in the image selection area 510. The image data may be obtained from all images in the non-volatile memory 103 and storage medium 110, or from only one of the non-volatile memory 103 or storage medium 110. Furthermore, only a specific folder designated by the application may be targeted, or the user may be prompted to specify a folder from which images are to be obtained. Furthermore, as described above, it is also possible to obtain image data from an external storage device of another device or an online storage service via the connection unit 111 or public network connection unit 113.

[0030] The order in which the thumbnail images are displayed may be the order in which the image data was discovered, or may be sorted and displayed in order of the date the image data was taken, created, or updated. In addition, in the description of this embodiment, when an image is displayed in the image selection area 510, it is resized and displayed after being cropped into a square like the thumbnail image 511, but it is also possible to resize and display the image without cropping.

[0031] When the user performs an operation to select an image, such as a tap operation on the touch panel 105d, an image selection mark 512 is displayed to indicate that the image has been selected, and a simple preview image is displayed in which the selected image is fitted into an empty frame of each layout being displayed in the layout selection area 500. Furthermore, when an operation to deselect an image that has already been selected, such as by a tap operation on the touch panel 105d, the image selection mark 512 is hidden, and a simple preview image is displayed in which the deselected image has been deleted from the simple preview image of each layout displayed in the layout selection area 500.

[0032] Then, by pressing an OK button 522, the layout shown in the selection candidate layout display area 501 and the selected image can be confirmed.

[0033] 6A to 6H are diagrams showing screen transitions during layout selection operation, and illustrate a case in which layouts 1 to 8 shown in FIG. 4A are displayed in order in the selection candidate layout display area 501. FIG.

[0034] Fig. 6A shows a screen in which layout 1 is displayed in the selected candidate layout display area 501, layout 2 is displayed in the next candidate layout display area 505, and thumbnail image 511 is selected. In this state, when an instruction to proceed to the next layout is given by operating the scroll bar 506, the display layout switching button 508, or a swipe operation on the layout selection area 500, the screen transitions to the screen shown in Fig. 6B. Fig. 6B shows a state in which layout 2 is displayed in the selected candidate layout display area 501, layout 1 is displayed in the previous candidate layout display area 504, and layout 3 is displayed in the next candidate layout display area 505. An image corresponding to the selected thumbnail image 511 is displayed in frame 1 of each layout.

[0035] Similarly, each time an instruction to advance to the next layout is given, the layout displayed in the selected candidate layout display area 501 is changed in sequence from layout 3 to layout 8, as shown in Figures 6C to 6H. Furthermore, the previous candidate layout display area 504 and the next candidate layout display area 505 respectively display the layouts before and after the layout displayed in the selected candidate layout display area 501.

[0036] Conversely, when an instruction to return to the previous layout is given by operating the scroll bar 506, the display layout switching button 508, swiping the layout selection area 500, or the like, the layout displayed in the selection candidate layout display area 501 is changed to the previous layout, and the previous candidate layout display area 504 and the next candidate layout display area 505 respectively display the layouts before and after the layout displayed in the selection candidate layout display area 501. In this way, the user can select a desired layout.

[0037] 6A, layout 2 is displayed in the next candidate layout display area 505, but because the selected candidate layout is the first layout 1, no layout is displayed in the previous candidate layout display area 504. However, the present invention is not limited to this. The layout display may be looped, and when the first layout is displayed in the selected candidate layout display area 501, the last layout 8 may be displayed in the previous candidate layout display area 504. Similarly, in the example shown in FIG. 6H, layout 1 may be displayed in the next candidate layout display area 505.

[0038] Next, the transition of the screen when selecting an image will be described. In each frame of each layout displayed in the layout selection area 500, images corresponding to thumbnail images selected from the thumbnail images displayed in the image selection area 510 are arranged in the selected order. In this case, if the aspect ratios of each frame and the selected image differ, the present embodiment describes a fill arrangement in which the image is cropped to fit the aspect ratio of the frame. However, a fit arrangement in which the image is arranged so that it is inscribed in the frame may also be used. Furthermore, frames in which no image is arranged are displayed with a diagonal line or the like, as in the empty frame 503 in Figure 5, to indicate that no image is arranged.

[0039] First, we will explain the case where the number of selected images increases. Figures 7A to 7D are diagrams showing screen transitions when the number of selected images increases. Figure 7A shows a screen where no images are selected and layout 1 is displayed in the selection candidate layout display area 501. Here, as shown in 9a in Figure 9A, a simple preview image in a state where no images are selected may be generated for each layout and stored in the working memory 104. This allows for quick display switching when switching layouts as shown in Figures 6A to 6H.

[0040] When a thumbnail image 701 displayed in the image selection area 510 is tapped on the screen of Fig. 7A, an image selection mark 512 is displayed above the thumbnail image 701, as shown in Fig. 7B. Furthermore, a simple preview image is generated and displayed in which the selected image is fitted to frame 1 of layout 1 displayed in the selected candidate layout display area 501 and frame 1 of layout 2 displayed in the subsequent candidate layout display area 505.

[0041] At this time, as shown in 9b of FIG. 9A, simple preview images are generated in which the selected image is applied to frame 1 of all layouts from layout 3 onwards, which are not displayed on the screen of FIG. 7A, and saved in working memory 104, thereby enabling quick switching of the display when switching between the layouts shown in FIGS. 6A to 6H.

[0042] Next, when the thumbnail image 702 is further tapped on the screen of FIG. 7B , an image selection mark 512 is displayed above the thumbnail image 702 as shown in FIG. 7C , and each of the simple preview images displayed in the layout selection area 500 is updated. In this case, layout 1 has only one frame in which an image can be placed, and therefore the two selected images cannot be placed therein, so it is removed from the display targets in the layout selection area 500. That is, when two images are selected, layouts 2 to 8 are designated as selectable layouts, and simple preview images are generated and displayed in which the image of the selected thumbnail image 702 is placed in frame 2 of each layout, as shown in FIG. 9A 9c. At this time, because layout 1, which was displayed in the selected candidate layout display area 501, is removed from the display targets, a simple preview image of the next layout, layout 2, is displayed in the selected candidate layout display area 501. Furthermore, a simple preview image of the next layout 3 is displayed in the next candidate layout display area 505.

[0043] When thumbnail image 703 is further tapped on the screen of FIG. 7C , an image selection mark 512 is displayed above thumbnail image 703 as shown in FIG. 7D , and each of the simple preview images displayed in the layout selection area 500 is updated. As when the number of selected images increases to two, when three images are selected, layouts with two or fewer frames are excluded from display in the layout selection area 500. That is, in addition to layout 1, layouts 2 and 3 are also excluded from display. As shown in FIG. 9B , layouts 4 to 8 are designated as selectable layouts, and a simple preview image is generated in which the image of thumbnail image 703 is placed in frame 3 of each layout, as shown in FIG. 9B 9d. In this case, because layout 2, which was displayed in the selected candidate layout display area 501, and layout 3, which was displayed in the next candidate layout display area 505, are excluded from display, a simple preview image of the next layout, layout 4, is displayed in the selected candidate layout display area 501. Furthermore, a simple preview image of the next layout 5 is displayed in the next candidate layout display area 505. Similarly, each time a thumbnail image is selected, the corresponding image is fitted into an empty frame, and layouts with insufficient frames are removed from the selectable layouts.

[0044] Next, we will explain what happens when an image is deselected. FIGS. 8A to 8D are diagrams illustrating screen transitions when the number of selected images decreases. FIG. 8A shows the same screen as FIG. 7D . FIG. 8B shows the state in which a selected thumbnail image 701 on this screen is tapped and deselected. In this case, the image selection mark 512 on the thumbnail image 701 is hidden, and the simple preview images displayed in the layout selection area 500 are updated. Since the number of selected images has now been reduced to two, layouts 2 and 3, which had previously been removed from the display list, are once again displayed. Furthermore, since thumbnail image 701 has been deselected, the image selection order becomes thumbnail image 702 → thumbnail image 703. Applying the images in this order, starting from frame 1 of each layout, results in a simple preview image such as that shown in FIG. 9B at 9e.

[0045] 8A continues to be displayed, so layout 4 is also displayed in the selection candidate layout display area 501 in FIG. 8B. Layout 3, which has become the display target, is displayed in the previous candidate layout display area 504.

[0046] In other words, when the number of selected images increases or decreases, if the layout displayed before the image selection / cancellation remains the display target, the selection candidate layout display area 501 continues to display that layout, and if the layout is no longer the display target, the next display target layout is displayed.

[0047] In FIG. 8B , the selected thumbnail image 702 is tapped, and the state in which the selection is deselected is shown in FIG. 8C . In this case, the image selection mark 512 on the thumbnail image 702 is hidden, and each of the quick preview images displayed in the layout selection area 500 is updated. At this time, the number of selected images has been reduced to one, and layout 1, which had been removed from the display list, is once again included in the display list. Furthermore, with the selection of thumbnail image 702 now deselected, only thumbnail image 703 remains selected. Therefore, when the image of thumbnail image 703 is fitted to frame 1 of each layout, a quick preview image such as that shown in FIG. 9B 9f is obtained.

[0048] 8B continues to be displayed, so in FIG. 8C, layout 4 is also displayed in the selected candidate layout display area 501. Layout 3 continues to be displayed in the previous candidate layout display area 504.

[0049] Finally, in Fig. 8C, the selected thumbnail image 703 is tapped, and the state in which the selection is deselected is shown in Fig. 8D. In this case, the image selection mark 512 on the thumbnail image 703 is hidden, and each of the simple preview images displayed in the layout selection area 500 is updated. At this time, the selection of the thumbnail image 703 is deselected, and the display returns to the simple preview image shown in 9a in Fig. 9A, in which no images are arranged in each layout.

[0050] As described above, by narrowing down the selectable layouts in accordance with the number of images selected by the user, the user can easily select a layout in which the selected images can be arranged.

[0051] Next, the display process of the layout / image selection screen by the layout printing application in this embodiment will be described with reference to the flowchart in Fig. 10. The flowchart in Fig. 10 starts when the layout printing application in this embodiment is launched and the layout / image selection screen is displayed. The process in Fig. 10 is performed by the control unit 101 of the mobile device 100 executing the layout printing application.

[0052] In S101, the layout printing application displays available layouts in the layout selection area 500. At this time, as described above, available layouts may be selected based on current settings such as the printer type, paper size, and type. Specifically, first, as shown in 9a in Fig. 9A, a simple preview image representing a state in which no image is set in each frame for each layout is generated and saved in the working memory 104. Then, from among these, the application displays the simple preview images of the layouts to be displayed in the selected candidate layout display area 501, previous candidate layout display area 504, and next candidate layout display area 505.

[0053] Immediately after the layout printing application is executed, as shown in Fig. 7A, layout 1 is displayed in the selected candidate layout display area 501, and layout 2 is displayed in the next candidate layout display area 505. Also, for example, if you transition to the layout / image selection screen after printing using layout 5, layout 5 may continue to be displayed in the selected candidate layout display area 501, layout 4 may be displayed in the previous candidate layout display area 504, and layout 6 may be displayed in the next candidate layout display area 505, as shown in Fig. 11.

[0054] Next, in S102, thumbnail images of image data that can be used for printing, among the image data stored in the storage medium 110, etc., are displayed in an image selection area 510 in a row.

[0055] Next, in S103, it is determined whether or not the OK button 522 has been selected. If it is determined that the OK button 522 has not been selected, the process proceeds to S104.

[0056] In S104, it is determined whether an operation to change the layout displayed in the layout selection area 500 has been performed. If it is determined in S104 that an operation to change the display of the simple preview image has been performed, the process proceeds to S105. In S105, the simple preview image stored in the work memory 104 is read out in response to the user's operation, and is displayed in the selected candidate layout display area 501, the previous candidate layout display area 504, and the next candidate layout display area 505, and the process proceeds to S106. On the other hand, if it is determined in S104 that an operation to change the layout displayed in the layout selection area 500 has not been performed, the process proceeds to S106.

[0057] In S106, it is determined whether a selection operation by tapping on a thumbnail image displayed in the image selection area 510 or a deselection operation by tapping on a thumbnail image of an already selected image has been performed. If it is determined that an image selection operation or deselection operation has not been performed, the process returns to S103 and the user's operation is monitored again. On the other hand, if it is determined that an image selection operation or deselection operation has been performed, the process proceeds to S107.

[0058] In S107, a layout to be displayed in the layout selection area 500 is selected from the layouts according to the number of images currently selected. Here, layouts that have a number of frames less than the number of selected images are excluded from the display targets and are not displayed. In other words, as described with reference to Figures 7A to 7D, if the number of selected images is two, layout 1 is excluded from the display targets, and if the number of selected images is three, layouts 2 and 3 in addition to layout 1 are also excluded from the display targets.

[0059] In S108, the selected images are fitted in order into the layout selected in S107 to generate a simple preview image, which is then saved in the working memory 104. Furthermore, simple preview images of the layouts are displayed in the selected candidate layout display area 501, previous candidate layout display area 504, and next candidate layout display area 505, and the process returns to S103, where user operations are monitored again.

[0060] If the number of selected images increases as a result of the image selection operation in S105, the layout that was displayed in the selection candidate layout display area 501 before the image selection operation in S107 may become hidden and unavailable for selection. In this case, layouts that can be laid out with the current number of selected images are displayed, and the selected layout is changed. At this time, a layout that has the same number of frames as the number of selected images is basically displayed in the selection candidate layout display area 501. However, if there is no layout with the same number of frames, a layout with a number of frames equal to or greater than the number of selected images may be displayed in the selection candidate layout display area 501. If the number of selected images decreases as a result of the selection deselection operation in S105, the layout displayed in the selection candidate layout display area 501 before the image selection operation is not changed, and the display of the simple preview is changed in S108.

[0061] Finally, if it is determined in S103 that the OK button 522 has been pressed, the process proceeds to S109, where the layout displayed in the selection candidate layout display area 501 and the selected image are confirmed, and the screen transitions to the print preview screen. On the print preview screen, the preview is displayed at a larger display size than the simple preview displayed in the selection candidate layout display area 501, making it easier to check the image and print layout.

[0062] As described above, according to this embodiment, it is possible to select a layout and images to be arranged on a single layout / image selection screen, which makes it easier to select a layout and images to be arranged even on devices with small display screens.

[0063] In the above embodiment, the application is described as printing with a selected layout and image, but it does not necessarily have to print. For example, the application can be used for other purposes, such as uploading edited images to a social networking service (SNS).

[0064] <Other Embodiments> The present invention may be applied to a system consisting of multiple devices or to an apparatus consisting of a single device. The present invention may also be realized by supplying a program that realizes one or more of the functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and having one or more processors in a computer of the system or apparatus read and execute the program. The present invention may also be realized by a circuit (e.g., an ASIC) that realizes one or more functions.

[0065] The present invention is not limited to the above-described embodiments, and various modifications and variations can be made without departing from the spirit and scope of the present invention. Therefore, to apprise the public of the scope of the present invention, the following claims are appended.

[0066] This application claims priority based on Japanese Patent Application No. 2023-139119, filed on August 29, 2023, the entire contents of which are incorporated herein by reference.

Claims

1. An image processing device comprising: a reception means for receiving operations by a user; and a display control means for controlling a display screen to be displayed on a display device, the display screen having a layout selection area for selecting a layout in which images are to be arranged, and an image selection area for selecting images to be arranged in the layout, wherein the display control means controls to change the layouts selectable in the layout selection area in response to a change in the image selection area by user operation, and to display as the selectable layouts a layout in which images equal to or greater than the number of selected images selected in the image selection area can be arranged.

2. The image processing device according to claim 1, characterized in that the display control means changes the selectable layouts in the layout selection area in response to a change in the image selection in the image selection area by user operation, so that a layout in which the number of selected images selected in the image selection area is arranged becomes selectable.

3. The image processing device according to claim 1, characterized in that the display control means, in response to a change in the image selection in the image selection area by user operation, hides a layout in which fewer images can be arranged than the number of selected images selected in the image selection area.

4. An image processing device according to any one of claims 1 to 3, characterized in that said display control means controls so that selectable layouts are displayed in said layout selection area in order of the number of images that can be laid out.

5. An image processing device as claimed in any one of claims 1 to 4, characterized in that the display control means displays the selected layout in the layout selection area in a manner distinct from other layouts, and when the selected layout becomes unselectable due to a change in image selection resulting in an increase in the number of selected images, controls the selected layout to be changed to one of the layouts that are selectable after the increase in the number of selected images.

6. The image processing device according to claim 5, characterized in that, when the selected layout becomes unselectable due to an increase in the number of selected images, the display control means controls to change the selected layout to a layout in which the same number of images as the increased number of selected images are arranged.

7. The image processing device according to claim 5, wherein said display control means performs control so that, when the selected image is changed and the number of selected images is reduced, the selected layout is not changed.

8. An image processing device according to any one of claims 1 to 7, characterized in that the display control means controls to display a simple preview of the images selected in the image selection area, each arranged in the layout displayed in the layout selection area.

9. The image processing device according to claim 8, characterized in that the display control means controls the display device to display a preview screen in which a preview of the image selected in the image selection area, arranged in the layout selected in the layout selection area, is displayed in a larger display size than the simple preview, in response to a predetermined operation for confirming the layout selection in the layout selection area and the image selection in the image selection area.

10. An image processing device as described in claim 1, further comprising: a communication means for performing communication; and a generation means for generating print data corresponding to a preview image of the confirmed layout when the reception means receives an operation to confirm the selected layout, and characterized in that the print data is transmitted to a printing device via the communication means.

11. The image processing device according to any one of claims 1 to 10, wherein the image processing device is a mobile device and further comprises the display device.

12. An image processing method comprising: a display control step in which a display control means controls a display screen to be displayed on a display device, the display screen including a layout selection area for selecting a layout in which images are to be arranged, and an image selection area for selecting images to be arranged in the layout; a step in which a reception means receives operation by a user; and a step in which the display control means controls the display screen to change the layouts selectable in the layout selection area in response to a change in the image selection area selected by the user operation, and to display as the selectable layouts a layout in which images equal to or greater than the number of selected images selected in the image selection area can be arranged.

13. A program for causing a computer to function as each of the means of the image processing device according to any one of claims 1 to 11.

14. A program for causing a computer to execute each step of the image processing method according to claim 12.

Images