Image processing device, method, and program

Abstract

To facilitate an operation of selecting a layout and an image to dispose.SOLUTION: An image processing device comprises: reception means which receives an operation executed by a user; and display control means which performs control to display on a display device a display screen in which a layout selection area for selecting a layout for disposing an image and an image selection area for selecting the image to dispose in the layout are disposed. In response to a fact that selection of an image in the image selection area is changed by a user operation, the display control means changes a layout selectable in the layout selection area.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an image processing apparatus, method, and program, and more particularly to an image processing apparatus, method, and program for laying out images obtained by photography or the like. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been a printing system capable of arranging and printing a plurality of photographic images taken by an imaging device on a single sheet of paper (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2005-35280 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the printing system described in Patent Document 1 has a very cumbersome operation because the image selection screen for layout printing, in which multiple images are arranged on one sheet of paper, and the layout selection / preview screen are different screens. For example, if the desired print result is not obtained after selecting an image and selecting a layout and checking the preview, it is necessary to return to the image selection screen and reselect the image.

[0005] The present invention has been made in consideration of the above problems, and has an object to make it easier to select a layout and images to be arranged. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the image processing device of the present invention has a reception means for receiving operations by a user, and a display control means for controlling the display of a display screen on a display device, the display screen including a layout selection area for selecting a layout in which to arrange images, and an image selection area for selecting images to be arranged in the layout, and the display control means changes the layout selectable in the layout selection area in response to a change in the selection of images in the image selection area by user operation. Effect of the Invention

[0007] According to the present invention, it is possible to facilitate the operation of selecting a layout and images to be arranged. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing the configuration of a printing system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram showing an example of the functional configuration and external appearance of a mobile device which is an example of an image processing apparatus according to an embodiment. [Diagram 3] 1A to 1C are diagrams showing examples of images according to an embodiment. [Figure 4] 5A to 5C are views showing examples of layouts and examples of layout images that can be used in a layout printing application according to the embodiment. [Diagram 5] 5A and 5B are diagrams illustrating an example of a layout / image selection screen of a layout printing application in the embodiment. [Figure 6] 6A to 6C are diagrams showing screen transitions during a layout selection operation in the embodiment. [Figure 7] 11A to 11C are diagrams showing screen transitions when the number of selected images increases during image selection in the embodiment. [Figure 8] 11A to 11C are diagrams showing screen transitions when the number of selected images decreases during image selection in the embodiment. [Figure 9] 5A and 5B are diagrams showing simple preview images stored in a working memory in the embodiment. [Figure 10]6 is a flowchart showing display processing of a layout / image selection screen by a layout printing application in an embodiment. [Figure 11] FIG. 4 is a diagram showing an example of an initial screen of a layout / image selection screen in the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0010] <First embodiment> 1 is a diagram showing an example of a printing system according to the present embodiment, and shows a configuration including a mobile device 100, which is an example of an image processing device according to the present embodiment, and a printing device 200. Print data generated using a layout printing application according to the present embodiment executed on the mobile device 100 can be sent to the printing device 200 and printed by the printing device 200.

[0011] The communication between the mobile device 100 and the printing device 200 may be wireless communication such as wireless LAN (Local Area Network) or wired communication such as USB (Universal Serial Bus) or Ethernet. When wireless LAN is used for communication between the mobile device 100 and the printing device 200, communication may be via a router 300 having a wireless LAN access point separate from the mobile device 100 and the printing device 200. Alternatively, the mobile device 100 or the printing device 200 may have a simple wireless LAN router function, and the mobile device 100 and the printing device 200 may communicate using the wireless LAN router function.

[0012] Next, an outline of the configuration and functions of a mobile device 100 such as a smartphone or tablet device will be described as an example of a device to which the image processing device of this embodiment is applied, with reference to Fig. 2. Note that the present invention can also be applied to devices such as digital cameras, portable media players, personal computers, and game consoles as image processing devices, in addition to smartphones and tablet devices.

[0013] FIG. 2(a) is a block diagram showing the functional configuration of the mobile device 100, and FIG. 2(b) is a diagram showing an example of the external appearance of the mobile device 100 as viewed from the front. 2(a), a control unit 101 controls each unit of the mobile device 100 in accordance with an input signal and a program stored in a non-volatile memory 103. Note that instead of the control unit 101 controlling the entire mobile device 100, the entire mobile device 100 may be controlled by multiple pieces of hardware sharing the processing.

[0014] The imaging unit 102 converts the subject light imaged by the lens included in the imaging unit 102 into an electric signal, performs signal processing such as noise reduction processing and A / D conversion, and outputs the obtained digital data as image data. The image data obtained in this manner is stored in a working memory 104 used as a buffer memory, and then undergoes predetermined image processing in the control unit 101 and is recorded in a storage medium 110. It is also possible to store the image data obtained by imaging in an external storage device using an online storage service including a social networking service on the Internet via a public network connection unit 113 or a connection unit 111. When storing in an external storage device using an online storage service, all images may be automatically uploaded by the OS (Operating System) of the mobile device 100 or an installed application, but only images specified by the user may be uploaded.

[0015] The non-volatile memory 103 is an electrically erasable and recordable non-volatile memory, and stores various programs executed by the control unit 101. The layout printing program of this embodiment is also held in the non-volatile memory 103 and installed as a layout printing application. The layout printing application may be installed in the storage medium 110. The processing of the mobile device 100 in this embodiment is realized by reading the layout printing application. The layout printing application also has a program for utilizing basic functions of the OS installed in the mobile device 100. The OS of the mobile device 100 may have a program for realizing the processing of this embodiment.

[0016] The working memory 104 is used as a buffer memory for temporarily storing image data generated by the imaging unit 102, an image display memory for the display unit 106, a working area for the control unit 101, etc. In the layout printing application of this embodiment, the working memory 104 is also used as a temporary storage destination for simple preview images, which will be described later.

[0017] The operation unit 105 is used to receive instructions from a user for the mobile device 100. The operation unit 105 includes operation members such as a power button 105a for turning on / off the power of the mobile device 100 shown in FIG. 2B, a volume up button 105b, a volume down button 105c, and a touch panel 105d formed on the display unit 106.

[0018] The display unit 106 displays image data, characters for interactive operations, icons for various operations of applications, etc. The display unit 106 does not necessarily have to be built into the mobile device 100. In other words, the mobile device 100 only needs to be able to connect to an external display unit 106 and have at least a display control function for controlling the display of the display unit 106.

[0019] The storage medium 110 can record the image data output from the imaging unit 102 as an image file. The storage medium 110 may be configured to be detachable from the mobile device 100, or may be built into the mobile device 100. In other words, it is sufficient for the mobile device 100 to have at least a means for accessing the storage medium 110. The non-volatile memory 103 and the storage medium 110 do not necessarily need to be configured as independent hardware, and the non-volatile memory 103 may have the functions of the storage medium 110 described in this embodiment. In addition, as described above, the layout printing application of this embodiment may be installed in the storage medium 110.

[0020] The connection unit 111 is an interface for communicating with other devices including the printing device 200. The mobile device 100 of this embodiment can exchange data with the printing device 200 via the connection unit 111. In this embodiment, the connection unit 111 includes an interface for communicating with the printing device 200 over a wireless LAN, and the control unit 101 realizes wireless LAN communication with the printing device 200 by controlling the connection unit 111.

[0021] The public network connection unit 113 is an interface used when performing public wireless communication. The mobile device 100 can make a call or perform data communication with other devices via the public network connection unit 113. When making a call, the control unit 101 inputs and outputs a voice signal via the microphone 114 and the speaker 115. The public network connection unit 113 includes an interface for performing communication using 4G. It is to be noted that, in addition to 4G, other communication methods such as LTE, WiMAX, ADSL, FTTH, so-called 3G and 5G may be used. In addition, the connection unit 111 and the public network connection unit 113 do not necessarily need to be configured as independent hardware, and for example, one antenna can be used for both.

[0022] FIG. 3 is a diagram showing an example of an image stored in the storage medium 110 of the mobile device 100. As shown in FIG. The layout printing application in this embodiment reads these images from the storage medium 110, processes them according to the printing paper used in the printing device 200 and the layout (described later), and generates print data.

[0023] 3 shows only 15 images, but more than several thousand image files may be stored in the storage medium 110 of the actual mobile device 100. These image files may be stored in the non-volatile memory 103 of the mobile device 100, or may be stored in a device other than the mobile device 100 or in an external storage device provided by an online storage service. In the latter case, the image data may be downloaded from the external storage device to the non-volatile memory 103 or working memory 104 via the connection unit 111 or the public network connection unit 113 for use.

[0024] FIG. 4A is a diagram showing an example of a layout that can be used in the layout printing application of this embodiment. The layout printing application in this embodiment can apply an image selected by the user to each frame of each layout, create a layout image as shown in FIG. 4( b ), and print it using the printing device 200 . In Fig. 4(a), eight types of layouts, from layout 1 to layout 8, are given as examples, but the present invention is not limited to eight types, and there may be more or less than eight types. In addition, the design of the layout is not limited to the layout shown in Fig. 4(a), and any layout design may be used. In addition, the layout may be changed depending on settings in the layout printing application, such as the type of printing device 200 and the paper size used for printing by the printing device 200.

[0025] Next, a layout printing application that operates on the mobile device 100 in this embodiment will be described. FIG. 5 is a diagram showing an example of a layout / image selection screen (display image) in the layout printing application of the present embodiment.

[0026] 5, the layout selection area 500 is an area for selecting a layout from layouts 1 to 8 shown in FIG. 4(a) in the layout printing application. In the layout selection area 500, layouts are displayed in three candidate layout display areas, namely, a selected candidate layout display area 501, a previous candidate layout display area 504, and a next candidate layout display area 505. The layouts displayed in the selected candidate layout display area 501, the previous candidate layout display area 504, and the next candidate layout display area 505 can be switched in sequence by operating a scroll bar 506, using display layout switching buttons 507 or 508, or by swiping the layout selection area 500. Note that the multiple layouts displayed in the layout selection area 500 are displayed in order of the number of images that can be arranged in each layout.

[0027] The layout displayed in the selection candidate layout display area 501 is the currently selected layout, and therefore it is desirable to display it prominently compared with the layouts displayed in the previous candidate layout display area 504 and the next candidate layout display area 505. Possible methods for making it prominent include, for example, displaying the layout in the selection candidate layout display area 501 larger than the other layouts, or displaying a special frame around the selection candidate layout display area 501. As another method, for example, it is possible to shade the layout display areas other than the selection candidate layout display area 501, or to display them lightly.

[0028] The image selection area 510 is an area for displaying thumbnail images of image data that can be used for layout and selecting an image to be laid out. Image data in the non-volatile memory 103 and the storage medium 110 in the mobile device 100 is searched for, and image data that can be used for layout is displayed side by side in the image selection area 510. The image data may be acquired from all images in the non-volatile memory 103 and the storage medium 110, or from only one of the non-volatile memory 103 or the storage medium 110. Only a specific folder designated by an application may be targeted, or the user may be allowed to designate a folder from which images are acquired. Furthermore, as described above, it is also possible to acquire the image data from an external storage device of another device or an online storage service via the connection unit 111 or the public network connection unit 113.

[0029] The order in which the thumbnail images are displayed may be the order in which the image data was found, or the order in which the image data was shot, created, or updated. In addition, in the description of this embodiment, when an image is displayed in the image selection area 510, the image is resized and displayed after being trimmed into a square like the thumbnail image 511, but the image may be resized and displayed without being trimmed.

[0030] When the user performs an operation to select an image, such as a tap operation on touch panel 105d, an image selection mark 512 is displayed to indicate that the image has been selected, and a simple preview image is displayed in which the selected image is fitted into an empty frame of each layout being displayed in layout selection area 500. In addition, when an operation is performed to deselect an image that has already been selected, such as by tapping on touch panel 105d, image selection mark 512 is hidden and a simple preview image is displayed in which the deselected image has been deleted from the simple preview images of each layout displayed in layout selection area 500.

[0031] Then, by pressing an OK button 522, the layout shown in the selection candidate layout display area 501 and the selected image can be confirmed.

[0032] FIG. 6 is a diagram showing the transition of the screen during a layout selection operation, and illustrates a case in which layouts 1 to 8 shown in FIG.

[0033] Fig. 6(a) shows a screen in which layout 1 is displayed in the selection candidate layout display area 501, layout 2 is displayed in the next candidate layout display area 505, and a thumbnail image 511 is selected. In this state, when an instruction to proceed to the next layout is given by operating the scroll bar 506, the display layout switching button 508, or a swipe operation on the layout selection area 500, the screen transitions to the screen shown in Fig. 6(b). Fig. 6(b) shows a state in which layout 2 is displayed in the selection candidate layout display area 501, layout 1 is displayed in the previous candidate layout display area 504, and layout 3 is displayed in the next candidate layout display area 505. An image corresponding to the selected thumbnail image 511 is displayed in frame 1 of each layout.

[0034] 6(c) to 6(h), each time an instruction to advance to the next layout is given, the layout displayed in the selected candidate layout display area 501 is changed in sequence from layout 3 to layout 8. In addition, the previous candidate layout display area 504 and the next candidate layout display area 505 respectively display the layouts before and after the layout displayed in the selected candidate layout display area 501.

[0035] Conversely, when an instruction to return to the previous layout is given by operating the scroll bar 506, the display layout switching button 508, a swipe operation on the layout selection area 500, or the like, the layout displayed in the selection candidate layout display area 501 is changed to the previous layout, and the previous and next layouts to the layout displayed in the selection candidate layout display area 501 are displayed in the previous candidate layout display area 504 and the next candidate layout display area 505, respectively. In this way, the user can select a desired layout.

[0036] In the example shown in Fig. 6(a), layout 2 is displayed in the next candidate layout display area 505, but since the selected candidate layout is the first layout 1, no layout is displayed in the previous candidate layout display area 504. However, the present invention is not limited to this, and the layout display may be looped, and when the first layout is displayed in the selected candidate layout display area 501, the last layout 8 may be displayed in the previous candidate layout display area 504. Similarly, in the example shown in Fig. 6(h), layout 1 may be displayed in the next candidate layout display area 505.

[0037] Next, the transition of the screen when selecting an image will be described. In each frame of each layout displayed in the layout selection area 500, images corresponding to thumbnail images selected from thumbnail images displayed in the image selection area 510 are arranged in the selected order. In this case, if the aspect ratio of each frame differs from that of the selected image, a fill arrangement is described in this embodiment in which the image is cut to match the aspect ratio of the frame, but a fit arrangement in which the image is arranged so as to be inscribed in the frame may also be used. In addition, frames in which no image is arranged are displayed with diagonal lines or the like, as in the empty frame 503 in Fig. 5, to indicate that no image is arranged.

[0038] First, a case where the number of selected images increases will be described with reference to Fig. 7, which shows the transition of the screen when the number of selected images increases. Fig. 7(a) shows a screen in which no image is selected and layout 1 is displayed in selection candidate layout display area 501. Here, as shown in Fig. 9(a), a simple preview image in which no image is selected may be generated for each layout and stored in working memory 104. In this way, the display can be quickly switched when switching layouts as shown in Fig. 6.

[0039] When a thumbnail image 701 displayed in image selection area 510 is tapped on the screen in Fig. 7(a), an image selection mark 512 is displayed above the thumbnail image 701 as shown in Fig. 7(b). Furthermore, a simple preview image in which the selected image is fitted to frame 1 of layout 1 displayed in selected candidate layout display area 501 and frame 1 of layout 2 displayed in next candidate layout display area 505 is generated and displayed.

[0040] At this time, as shown in FIG. 9(b), simple preview images are generated in which the selected image is applied to frame 1 of all layouts from layout 3 onwards, which are not displayed on the screen of FIG. 7(a), and the simple preview images are saved in the working memory 104, thereby enabling the display to be quickly switched when switching layouts as shown in FIG. 6.

[0041] Next, when the thumbnail image 702 is further tapped on the screen of FIG. 7(b), the image selection mark 512 is displayed above the thumbnail image 702 as well, as shown in FIG. 7(c), and each simple preview image displayed in the layout selection area 500 is also updated. In this case, layout 1 has only one frame in which an image can be placed, and therefore the two selected images cannot be placed therein, and so is removed from the display targets in layout selection area 500. In other words, when two images are selected, layouts 2 to 8 are set as selectable layouts, as shown in FIG. 9C, and a simple preview image is generated and displayed in which the image of the selected thumbnail image 702 is placed in frame 2 of each layout. At this time, since layout 1 that was displayed in selected candidate layout display area 501 is removed from the display targets, a simple preview image of layout 2, which is the next layout, is displayed in selected candidate layout display area 501. Furthermore, a simple preview image of the next layout 3 is displayed in next candidate layout display area 505.

[0042] When the thumbnail image 703 is further tapped on the screen of FIG. 7(c), an image selection mark 512 is displayed on the thumbnail image 703 as shown in FIG. 7(d), and each simple preview image displayed in the layout selection area 500 is updated. As in the case where the number of selected images is increased to two, when three images are selected, layouts with two or less frames in each layout are excluded from being displayed in the layout selection area 500. That is, in addition to layout 1, layouts 2 and 3 are also excluded from being displayed, and as shown in FIG. 9(d), a simple preview image is generated in which the image of the thumbnail image 703 is arranged in frame 3 of each layout, with layouts 4 to 8 being selected as selectable layouts. In this case, layout 2 displayed in the selected candidate layout display area 501 and layout 3 displayed in the next candidate layout display area 505 are excluded from being displayed, so a simple preview image of the next layout, layout 4, is displayed in the selected candidate layout display area 501. Furthermore, a simple preview image of the next layout 5 is displayed in the next candidate layout display area 505. Similarly, each time a thumbnail image is selected, the corresponding image is fitted into an empty frame, and layouts with insufficient frames are removed from the selectable layouts.

[0043] Next, a case where the selection of images is cancelled will be described below. Fig. 8 shows the transition of the screen when the number of selected images is reduced. FIG. 8(a) shows a screen in the same state as FIG. 7(d). FIG. 8(b) shows a state in which the selected thumbnail image 701 on this screen is tapped and the selection is cancelled. In this case, the image selection mark 512 on the thumbnail image 701 is hidden, and each of the simple preview images displayed in the layout selection area 500 is updated. At this time, since the number of selected images has been reduced to two, layouts 2 and 3, which had been removed from the display targets, are again displayed. In addition, since the selection of thumbnail image 701 has been cancelled, the selection order of images becomes thumbnail image 702→thumbnail image 703. If the images are applied in this order starting from frame 1 of each layout, a simple preview image such as that shown in FIG. 9(e) is obtained.

[0044] At this time, layout 4 displayed in Fig. 8(a) continues to be the display target, so in Fig. 8(b) layout 4 is also displayed in the selection candidate layout display area 501. Moreover, layout 3, which has become the display target, is displayed in the previous candidate layout display area 504.

[0045] In other words, when the number of selected images increases or decreases, the selection candidate layout display area 501 continues to display the layout that was displayed before the image was selected / deselected if it is still the layout to be displayed, and displays the next layout to be displayed if it is no longer the layout to be displayed.

[0046] FIG. 8(c) shows a state in which the selected thumbnail image 702 in FIG. 8(b) is tapped and the selection is cancelled. In this case, the image selection mark 512 on the thumbnail image 702 is made invisible, and each of the simple preview images displayed in the layout selection area 500 is updated. At this time, since the number of selected images has been reduced to one, layout 1, which had been removed from the display targets, is once again made a display target. Furthermore, since the selection of thumbnail image 702 has been cancelled, only the image of thumbnail image 703 is selected. Therefore, when the image of thumbnail image 703 is fitted to frame 1 of each layout, a simple preview image such as that shown in FIG. 9(f) is obtained.

[0047] At this time, layout 4 displayed in Fig. 8(b) continues to be the display target, so in Fig. 8(c) layout 4 is also displayed in the selection candidate layout display area 501. Also, layout 3 continues to be displayed in the previous candidate layout display area 504.

[0048] Finally, in Fig. 8(c), the selected thumbnail image 703 is tapped, and the state in which the selection is cancelled is shown in Fig. 8(d). In this case, the image selection mark 512 on the thumbnail image 703 is made invisible, and each of the simple preview images displayed in the layout selection area 500 is updated. At this time, as the selection of the thumbnail image 703 is cancelled, the selection of all images is cancelled, and the screen returns to the simple preview image as shown in Fig. 9(a), in which no image is arranged in each layout, and this is displayed.

[0049] As described above, by narrowing down the selectable layouts in accordance with the number of images selected by the user, the user can easily select a layout in which the selected images can be arranged.

[0050] Next, the display process of the layout / image selection screen by the layout printing application in this embodiment will be described with reference to the flowchart in FIG. The flowchart shown in Fig. 10 starts when the layout printing application of this embodiment is launched and a layout / image selection screen is displayed. The process shown in Fig. 10 is performed by the control unit 101 of the mobile device 100 executing the layout printing application.

[0051] In S101, the layout printing application displays available layouts in a layout selection area 500. At this time, as described above, the available layouts may be selected according to the current settings such as the printer type, paper size, and type. Specifically, first, a simple preview image showing a state in which no image is set in each frame for each layout is generated as shown in Fig. 9(a) and saved in the working memory 104. Then, from among them, the application displays simple preview images of layouts to be displayed in a selection candidate layout display area 501, a previous candidate layout display area 504, and a next candidate layout display area 505.

[0052] Immediately after the layout printing application is executed, as shown in Fig. 7(a), layout 1 is displayed in the selected candidate layout display area 501, and layout 2 is displayed in the next candidate layout display area 505. Also, for example, if the layout / image selection screen is displayed after printing using layout 5, layout 5 may continue to be displayed in the selected candidate layout display area 501, layout 4 in the previous candidate layout display area 504, and layout 6 in the next candidate layout display area 505, as shown in Fig. 11.

[0053] Next, in S102, thumbnail images of image data that can be used for printing, among the image data stored in the storage medium 110 or the like, are displayed in an image selection area 510 in a line.

[0054] Next, in S103, it is determined whether or not the OK button 522 has been selected. If it is determined that the OK button 522 has not been selected, the process proceeds to S104.

[0055] In S104, it is determined whether or not an operation has been performed to change the layout displayed in layout selection area 500. If it is determined in S104 that an operation has been performed to change the display of the simple preview image, the process proceeds to S105. In S105, the simple preview image stored in the working memory 104 is read out in response to a user operation, and is displayed in the selection candidate layout display area 501, the previous candidate layout display area 504, and the next candidate layout display area 505, and the process proceeds to S106. On the other hand, if it is determined in S104 that an operation to change the layout displayed in the layout selection area 500 has not been performed, the process proceeds to S106.

[0056] In S106, it is determined whether a selection operation is performed by tapping on a thumbnail image displayed in image selection area 510, or whether a deselection operation is performed by tapping on a thumbnail image of an already selected image. If it is determined that no image selection operation or deselection operation has been performed, the process returns to S103 and monitors the user's operation again. On the other hand, if it is determined that an image selection operation or deselection operation has been performed, the process transitions to S107.

[0057] In S107, a layout to be displayed in layout selection area 500 is selected from among the layouts according to the number of images currently selected. Here, layouts that have a number of frames less than the number of selected images are excluded from display and hidden. That is, as described with reference to Fig. 7, when the number of selected images is two, layout 1 is excluded from display, and when the number of selected images is three, in addition to layout 1, layout 2 and layout 3 are also excluded from display.

[0058] In S108, the selected images are fitted in order into the layout selected in S107 to generate a simple preview image, and the simple preview image is saved in the working memory 104. Furthermore, simple preview images of the layouts are displayed in the selected candidate layout display area 501, previous candidate layout display area 504, and next candidate layout display area 505, and the process returns to S103, where the user operation is monitored again.

[0059] When the number of selected images increases due to the image selection operation in S105, the layout displayed in the selection candidate layout display area 501 before the image selection operation in S107 may become hidden and cannot be selected. In that case, layouts that can be laid out with the current number of selected images are displayed and the selected layout is changed. At this time, a layout in which the same number of frames as the number of selected images is laid out is basically displayed in the selection candidate layout display area 501. However, if there is no layout with the same number of frames, a layout with a number of frames equal to or greater than the number of selected images may be displayed in the selection candidate layout display area 501. When the number of selected images decreases due to the selection cancellation operation in S105, the layout displayed in the selection candidate layout display area 501 before the image selection operation is not changed, and the display of the simple preview is changed in S108.

[0060] Finally, if it is determined in S103 that the OK button 522 has been pressed, the process proceeds to S109, where the layout displayed in the selection candidate layout display area 501 and the selected image are confirmed, and the screen transitions to a print preview screen. On the print preview screen, a preview is displayed in a larger display size than the simple preview displayed in the selection candidate layout display area 501, making it easier to check the images and print layout.

[0061] As described above, according to this embodiment, it is possible to select a layout and an image to be arranged on one layout / image selection screen. This makes it easier to select a layout and an image to be arranged even on a device with a small display screen.

[0062] In the above embodiment, the application is described as printing with the selected layout and image, but it does not necessarily have to print. For example, the application can be used for other purposes, such as uploading edited images to a social network service (SNS).

[0063] <Other embodiments> The present invention may be applied to a system made up of a plurality of devices, or to an apparatus made up of a single device.

[0064] The present invention can also be realized by supplying a program for implementing one or more of the functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0065] <Summary> The disclosure of this embodiment includes the following configuration.

[0066] (Item 1) A reception means for receiving an operation by a user; a display control means for controlling a display screen on a display device, the display screen having a layout selection area for selecting a layout in which images are to be arranged and an image selection area for selecting an image to be arranged in the layout; The image processing device according to claim 1, wherein the display control means changes a selectable layout in the layout selection area in response to a change in the image selection area by a user operation. (Item 2) The image processing device described in item 1, characterized in that the display control means changes the selectable layouts in the layout selection area in response to a change in the image selection area by a user operation, so that a layout in which the number of selected images selected in the image selection area can be arranged becomes selectable. (Item 3) The image processing device described in item 2 is characterized in that the display control means, in response to a change in the image selection in the image selection area by a user operation, hides a layout in which only a number of images less than the number of selected images selected in the image selection area can be arranged. (Item 4) The image processing device described in item 2 or 3, characterized in that the display control means controls the display of a layout in which a number of selected images equal to or greater than the number of selected images selected in the image selection area can be arranged as a selectable layout in response to a change in the image selection area by a user operation. (Item 5) 5. The image processing device according to any one of items 1 to 4, wherein the display control means controls so that the selectable layouts are displayed in the layout selection area in order of the number of images that can be laid out. (Item 6) The display control means displaying the selected layout in the layout selection area in a manner that distinguishes it from other layouts; When the selected layout is hidden due to an increase in the number of selected images caused by a change in the selection of images, the selected layout is changed to one of the layouts selectable after the increase in the number of selected images. 5. The image processing device according to any one of items 2 to 4, characterized in that the image processing device is controlled as follows. (Item 7) The image processing device described in item 6, characterized in that when the selected layout becomes hidden due to an increase in the number of selected images, the display control means controls to change the selected layout to a layout in which the same number of images as the increased number of selected images are arranged. (Item 8) 7. The image processing device according to item 6, wherein the display control means performs control so that, when the selection of images is changed and the number of selected images is reduced, the selected layout is not changed. (Item 9) The image processing device according to any one of items 1 to 8, characterized in that the display control means controls to display a simple preview in which the images selected in the image selection area are arranged in the layout displayed in the layout selection area. (Item 10) The image processing device described in item 9 is characterized in that the display control means controls the display device to display a preview screen in which a preview of the image selected in the image selection area, arranged in the layout selected in the layout selection area, is displayed in a larger display size than the simple preview, in response to a predetermined operation for confirming the layout selection in the layout selection area and the image selection in the image selection area. (Item 11) A communication means for carrying out the communication; a generating unit configured to generate print data corresponding to a preview image of the confirmed layout when the accepting unit accepts an operation to confirm the selected layout, 11. The image processing device according to any one of items 1 to 10, wherein the print data is transmitted to a printing device via the communication means. (Item 12) The image processing device is a mobile device, 12. The image processing device according to any one of items 1 to 11, further comprising the display device. (Item 13) a display control step in which a display control means controls a display screen on a display device, the display screen having a layout selection area for selecting a layout in which images are to be arranged and an image selection area for selecting an image to be arranged in the layout; A step of accepting an operation by a user by an accepting means; changing a selectable layout in the layout selection area in response to a change in the image selection area by a user operation, by the display control means; 13. An image processing method comprising: (Item 14) 13. A program for causing a computer to function as each of the means of the image processing device according to any one of items 1 to 12. (Item 15) 14. A program for causing a computer to execute each step of the image processing method according to Item 13.

[0067] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0068] 100: mobile device, 101: control unit, 102: imaging unit, 103: non-volatile memory, 104: working memory, 105: operation unit, 106: display unit, 110: storage medium, 111: connection unit, 113: public network connection unit, 200: printing device, 300: router, layout selection area 500, 501: selection candidate layout display area, 504: previous candidate layout display area, 505: next candidate layout display area, 510: image selection area, 522: OK button

Claims

1. A means of receiving user operations, The system includes a display control means that controls the display device to display a display screen having a layout selection area for selecting a layout on which images are placed, and an image selection area for selecting images to be placed on the layout. The image processing apparatus is characterized in that the display control means changes the selectable layout in the layout selection area in response to a change in the image selection area due to user operation, and controls the display to show a layout that can accommodate more than or equal to the number of selected images selected in the image selection area as the selectable layout.

2. The image processing apparatus according to claim 1, wherein the display control means changes the selectable layout in the layout selection area in response to a change in the image selection area due to user operation, so that a layout in which the number of selected images selected in the image selection area are arranged becomes selectable.

3. The image processing apparatus according to claim 1, wherein the display control means hides layouts in which fewer images can be placed than the number of selected images selected in the image selection area, in response to a change in the selection of images in the image selection area due to user operation.

4. The image processing apparatus according to claim 1, characterized in that the display control means controls the display of selectable layouts in the layout selection area in order of the number of images that can be laid out.

5. The display control means is In the aforementioned layout selection area, the selected layout is displayed separately from other layouts. If the selected layout becomes unavailable due to a change in image selection and an increase in the number of selected images, the selected layout will be changed to one of the layouts that become available after the increase in the number of selected images. The image processing apparatus according to claim 1, characterized in that it controls in such a manner.

6. The image processing apparatus according to claim 5, characterized in that, if the selected layout becomes unavailable due to an increase in the number of selected images, the display control means controls the layout to change to a layout in which the same number of images as the increased number of selected images are arranged.

7. The image processing apparatus according to claim 5, characterized in that the display control means controls the selected layout not to change when the selection of images is changed and the number of selected images decreases.

8. The image processing apparatus according to claim 1, characterized in that the display control means controls the display to show a simplified preview of the image selected in the image selection area, arranged in the layout displayed in the layout selection area.

9. The image processing apparatus according to claim 8, characterized in that the display control means controls the display device to display a preview screen on the display device, in which a preview of the image selected in the image selection area placed on the layout selected in the layout selection area is displayed at a larger display size than the simplified preview, in response to a predetermined operation for confirming the layout selection in the layout selection area and the image selection in the image selection area.

10. Communication means for conducting communication, The system further includes a generation means that, when the reception means receives an operation to confirm the selected layout, generates print data corresponding to the preview image of the confirmed layout, The image processing apparatus according to claim 1, characterized in that it transmits the print data to a printing device via the communication means.

11. The image processing device is a mobile device, The image processing apparatus according to claim 1, further comprising the display device.

12. A display control step involves controlling the display control means to display a display screen on a display device that includes a layout selection area for selecting a layout on which images are arranged, and an image selection area for selecting images to be placed on the layout. The process by which the reception means accepts operations from the user, The display control means controls the layout to change the selectable layout in the layout selection area in response to a change in the image selection area due to user operation, and to display a layout as the selectable layout that can accommodate more than or equal to the number of selected images selected in the image selection area. An image processing method characterized by having the following features.

13. A program for causing a computer to function as one of the means of an image processing apparatus according to any one of claims 1 to 11.

14. A program for causing a computer to perform each step of the image processing method described in claim 12.

Images