Image processing device and method, and program

Abstract

An image processing apparatus includes: a receiving section configured to receive an operation of a user; and a display control section configured to perform control to display, on a display device, a display screen on which a layout selection region for selecting a layout in which an image is to be arranged and an image selection region for selecting an image to be arranged in the layout are arranged, wherein the display control section changes a selectable layout in the layout selection area in response to a change in selection of an image in the image selection area by a user operation, and control to display, as a selectable layout, a layout in which images equal to or greater than the number of selected images selected in the image selection area can be arranged.

Description

TECHNICAL FIELD

[0001] The present application relates to an image processing apparatus and method, and a program, and more particularly to an image processing apparatus and method, and a program for laying out an image obtained by image capturing or the like. BACKGROUND

[0002] Conventionally, there has been a printing system capable of arranging and printing a plurality of photographic images taken by an image capturing apparatus on a single sheet of paper (see Patent Literature 1).

[0003] LIST OF CITATIONS

[0004] PATENT LITERATURE

[0005] Patent Literature 1: Japanese Patent Laid-Open No. 2005-35280 SUMMARY

[0006] TECHNICAL PROBLEM

[0007] However, in the printing system described in Patent Literature 1, the image selection screen and the layout selection / preview screen for layout printing in which a plurality of images are arranged on a sheet of paper are different screens, thereby making the operation very cumbersome. For example, if the preview for printing is not as desired by the user when checking the preview after selecting the images and the layout, and if the user wants to reselect the images, the user has to return to the image selection screen.

[0008] The present application has been made in view of the above problems, and makes it easier to select a layout and images to be arranged as its object.

[0009] SOLUTION TO PROBLEM

[0010] To achieve the above object, an image processing apparatus of the present application includes: a reception means configured to receive an operation of a user; and a display control means configured to control to display a display screen on a display device, a layout selection area for selecting a layout of images to be arranged and an image selection area for selecting images to be arranged in the layout being arranged on the display screen, wherein the display control means changes selectable layouts in the layout selection area in response to a change in selection of images in the image selection area by the user operation, and controls to display, as selectable layouts, layouts capable of arranging images equal to or more than a number of selection images selected in the image selection area.

[0011] ADVANTAGEOUS EFFECT OF THE INVENTION

[0012] The present application makes it easier to select images to be laid out and arranged.

[0013] Other features and advantages of the present application will become apparent from the following description, taken in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of the application. It is to be understood that the same reference numerals shall be used throughout to designate portions of the application. BRIEF DESCRIPTION OF DRAWINGS

[0014] The accompanying drawings incorporated in and forming a part of the specification illustrate embodiments of the application and, together with the description, serve to explain the principles of the application.

[0015] Figure 1 is a diagram illustrating a configuration of a print system according to an embodiment of the present application.

[0016] Figure 2A is a diagram illustrating an example of a functional configuration and an appearance of a mobile device as an example of an image processing apparatus according to an embodiment.

[0017] Figure 2B is a diagram illustrating an example of a functional configuration and an appearance of a mobile device as an example of an image processing apparatus according to an embodiment.

[0018] Figure 3 is a diagram illustrating an example of an image according to an embodiment.

[0019] Figure 4A is a diagram illustrating an example of a layout that can be used in a layout print application and an example of an image of the layout according to an embodiment.

[0020] Figure 4B is a diagram illustrating an example of a layout that can be used in a layout print application and an example of an image of the layout according to an embodiment.

[0021] Figure 5 is a diagram illustrating an example of a layout / image selection screen of a layout print application according to an embodiment.

[0022] Figure 6A is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0023] Figure 6B is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0024] Figure 6C is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0025] Figure 6D is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0026] Figure 6E is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0027] Figure 6FFIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0028] Figure 6G FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0029] Figure 6H FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0030] Figure 7A FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0031] Figure 7B FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0032] Figure 7C FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0033] Figure 7D FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0034] Figure 8A FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0035] Figure 8B FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0036] Figure 8C FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0037] Figure 8D FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0038] Figure 9A FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0039] Figure 9B FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0040] Figure 10 FIG. 1 is a diagram illustrating a screen transition during a layout selection operation according to an embodiment.

[0041] Figure 11 is a diagram illustrating an example of an initial screen of a layout / image selection screen according to the embodiment. DETAILED DESCRIPTION

[0042] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the application. A plurality of features are described in the embodiments, but the application is not limited to require all such features, and a plurality of such features can be appropriately combined. Furthermore, in the drawings, the same or similar configurations are given the same reference numerals, and redundant description thereof is omitted.

[0043] <First Embodiment>

[0044] Figure 1 is a diagram illustrating an example of a printing system according to this embodiment, which shows a configuration constituted by a mobile device 100 as an example of an image processing apparatus according to this embodiment, and a printing apparatus 200. Printing data generated using a layout printing application according to this embodiment executed on the mobile device 100 is transmitted to the printing apparatus 200, and can be printed by the printing apparatus 200.

[0045] The communication between the mobile device 100 and the printing apparatus 200 can be wireless communication such as wireless LAN (Local Area Network), or wired communication such as USB (Universal Serial Bus) or Ethernet. Furthermore, in a case where wireless LAN is used for the communication between the mobile device 100 and the printing apparatus 200, the communication can be performed via a router 300 having a wireless LAN access point separate from the mobile device 100 and the printing apparatus 200. Alternatively, the mobile device 100 or the printing apparatus 200 can be provided with a simple wireless LAN router function, and the mobile device 100 and the printing apparatus 200 can communicate using this wireless LAN router function.

[0046] Next, a summary of the configuration and functions of the mobile device 100 such as a smartphone or a tablet device will be described as an example of a device to which this embodiment is applied, with reference to Figure 2A and Figure 2B Note that the present application can be applied to devices such as digital cameras, portable media players, personal computers, and game machines as image processing apparatuses in addition to smartphones and tablet devices.

[0047] Figure 2A is a block diagram illustrating the functional configuration of the mobile device 100, and Figure 2B is a diagram illustrating an example of the appearance of the mobile device 100 seen from the front.

[0048] In Figure 2AIn the present embodiment, the control unit 101 controls each unit of the mobile device 100 in accordance with an input signal and a program stored in the nonvolatile memory 103. Note that, instead of the control unit 101 controlling the entire mobile device 100, a plurality of hardware components can share the processing load to control the entire mobile device 100.

[0049] The imaging unit 102 converts light from a subject formed by a lens included in the imaging unit 102 into an electric signal, performs signal processing such as noise reduction and A / D conversion, and outputs the resulting digital data as image data. The image data thus obtained is stored in the work memory 104 serving as a buffer memory, undergoes predetermined image processing in the control unit 101, and is then recorded on the storage medium 110. It is also possible to save the captured image data to an external storage device using an online storage service including a social networking service on the Internet via the public network connection unit 113 or the connection unit 111. When saving the image data to the external storage device using the online storage service, the OS (operating system) of the mobile device 100 or an installed application can automatically upload all images, or can upload only images designated by the user.

[0050] The nonvolatile memory 103 is an electrically erasable and recordable nonvolatile memory, and stores various programs executed by the control unit 101. The layout printing program of this embodiment is also stored in the nonvolatile memory 103 and installed as a layout printing application. The layout printing application can be installed in the storage medium 110. The processing of the mobile device 100 in this embodiment is realized by loading the layout printing application. The layout printing application also has a program for utilizing the basic functions of the OS installed in the mobile device 100. The OS of the mobile device 100 can also have a program for realizing the processing of this embodiment.

[0051] The work memory 104 is used as a buffer memory for temporarily storing image data generated by the imaging unit 102, as an image display memory of the display unit 106, and as a work area of the control unit 101. In the layout printing application of this embodiment, the work memory 104 is also used as a temporary storage destination of a quick preview image that will be described later.

[0052] The operation unit 105 is used to receive instructions to the mobile device 100 from the user. The operation unit 105 includes operation members such as a power button 105a for turning the power of the mobile device 100 on / off, a volume up button 105b, a volume down button 105c, and a touch panel 105d formed on the display unit 106 as shown in FIG. 1. Figure 2B

[0053] ​The display unit 106 displays image data, characters for interactive operation, icons for various application operations, and the like. The display unit 106 is not necessarily built into the mobile device 100. In other words, the mobile device 100 only needs to be able to connect to an external display unit 106 and have a display control function at least for controlling display of the display unit 106.

[0054] The storage medium 110 can record image data output from the imaging unit 102 as image files. The storage medium 110 can be configured to be detachable from the mobile device 100, or can be built into the mobile device 100. In other words, the mobile device 100 only needs to have a component at least for accessing the storage medium 110.

[0055] The nonvolatile memory 103 and the storage medium 110 are not necessarily configured as independent hardware components, and the nonvolatile memory 103 can have the functions of the storage medium 110 described in this embodiment. Also, as described above, the layout printing application of this embodiment can be installed in the storage medium 110.

[0056] The connection unit 111 is an interface for communicating with other devices including the printing device 200. The mobile device 100 of this embodiment can exchange data with the printing device 200 via the connection unit 111. In this embodiment, the connection unit 111 includes an interface for communicating with the printing device 200 via wireless LAN, and the control unit 101 controls the connection unit 111 to realize wireless LAN communication with the printing device 200.

[0057] The public network connection unit 113 is an interface for public wireless communication. The mobile device 100 can make a call and perform data communication with other devices via the public network connection unit 113. During the call, the control unit 101 inputs and outputs audio signals via the microphone 114 and the speaker 115. The public network connection unit 113 includes an interface for communicating using 4G. Note that other communication methods such as LTE, WiMAX, ADSL, FTTH, so-called 3G, and 5G can be used instead of 4G. Furthermore, the connection unit 111 and the public network connection unit 113 are not necessarily configured as independent hardware components; for example, a single antenna can be used for both.

[0058] Figure 3 An example of images stored in the storage medium 110 of the mobile device 100 is shown.

[0059] The layout printing application in this embodiment reads out these images from the storage medium 110, processes them to match the print paper to be used in the printing device 200 and the layout (described below), and generates print data.

[0060] Note that, Figure 3 Only 15 images are shown, but the actual storage medium 110 of the mobile device 100 can sometimes store more than several thousand image files. These image files can be stored in the nonvolatile memory 103 of the mobile device 100, or can be stored in a device other than the mobile device 100 or in an external storage device provided by an online storage service. In the latter case, the image data can be downloaded from the external storage device to the nonvolatile memory 103 or the work memory 104 via the connection unit 111 or the public network connection unit 113 and used.

[0061] Figure 4A is a diagram illustrating examples of layouts that can be used with the layout printing application of this embodiment.

[0062] The layout printing application of this embodiment sets the image selected by the user to each section of each layout, thereby creating a layout image such as those shown in Figure 4B which can then be printed using the printing device 200.

[0063] Figure 4A Eight types of layouts, Layout 1 to Layout 8, are shown as examples, but the present application is not limited to eight types and can have more or less than eight types. Furthermore, the designs of the layouts are not limited to those shown in Figure 4A and any layout having an arbitrary design can be used. Furthermore, the layout can change depending on the settings in the layout printing application, such as the type of the printing device 200 and the paper size for printing by the printing device 200.

[0064] Next, an explanation of the layout printing application running on the mobile device 100 in this embodiment will be given.

[0065] Figure 5 is a diagram illustrating an example of a layout / image selection screen (display image) in the layout printing application of this embodiment.

[0066] In Figure 5 , the layout selection area 500 is for selecting a layout from Figure 4AThe layout selection regions 1 to 8 shown in FIG. 5 select regions of a layout. In the layout selection region 500, layouts are displayed in three candidate layout display regions: a main candidate layout display region 501, a previous candidate layout display region 504, and a next candidate layout display region 505. The layouts displayed in the main candidate layout display region 501, the previous candidate layout display region 504, and the next candidate layout display region 505 can be switched in order by operating the scroll bar 506, using the display layout switching buttons 507 or 508, or sliding the layout selection region 500. The plurality of layouts displayed in the layout selection region 500 are displayed in order of the number of images that can be arranged in each layout.

[0067] The layout displayed in the main candidate layout display region 501 is the currently selected layout, so it is desirable to display it in a manner that highlights it compared to the layouts displayed in the previous candidate layout display region 504 and the next candidate layout display region 505. Possible methods of highlighting it include, for example, displaying the layout in the main candidate layout display region 501 larger than the other layouts, or displaying a special box around the main candidate layout display region 501. Other possible methods include, for example, shading the layout display regions other than the main candidate layout display region 501, or displaying them in a lighter color.

[0068] The image selection region 510 is a region for displaying thumbnail images of image data that can be used for a layout to select an image to be laid out. The image data of the images in the non-volatile memory 103 and the storage medium 110 in the mobile device 100 are searched, and the image data that can be used for a layout are displayed side by side in the image selection region 510. The image data of all the images in the non-volatile memory 103 and the storage medium 110 can be obtained, or only the image data of the images in one of the non-volatile memory 103 or the storage medium 110 can be obtained. Furthermore, the folder from which the image data is obtained can be specified by the application, or by the user. Furthermore, as described above, the image data can be obtained from another device or an external storage device of an online storage service via the connection unit 111 or the public network connection unit 113.

[0069] The order in which the thumbnail images are displayed can be the order in which the image data is found, or can be sorted and displayed in order of the date on which the image data was taken, created, or updated. Furthermore, in the description of this embodiment, when an image is displayed in the image selection region 510, it is resized and displayed after being cropped into a square as the image thumbnail image 511, but it is also possible to resize and display the image without cropping.

[0070] When a user performs an operation to select an image (such as tapping on the touch panel 105d), an image selection mark 512 is displayed to indicate that the image has been selected, and a quick preview image is displayed, in which the selected image is embedded in an empty segment of each layout currently displayed in the layout selection area 500.

[0071] Furthermore, when an operation is performed to deselect a selected image (such as by tapping on the touch panel 105d), the image selection marker 512 is hidden and a quick preview image is displayed, in which the deselected image is removed from the quick preview image displayed in the layout selection area 500 for each layout.

[0072] Then, by pressing the OK button 522, the layout shown in the main candidate layout display area 501 and the selected image / multiple images can be confirmed.

[0073] Figure 6A to Figure 6H This is a diagram showing the screen transitions during the layout selection process, and it illustrates the... Figure 4A The layouts 1 to 8 shown are displayed in the main candidate layout display area 501 in sequence.

[0074] Figure 6A The screen shows a layout where layout 1 is displayed in the main candidate layout display area 501, layout 2 is displayed in the next candidate layout display area 505, and thumbnail image 511 is selected. In this state, when a command to move to the next layout is given by operating the scroll bar 506, displaying the layout switching button 508, or by sliding the layout selection area 500, the screen changes to... Figure 6B The scene shown. Figure 6B The diagram shows the state in which layout 2 is displayed in the main candidate layout display area 501, layout 1 is displayed in the previous candidate layout display area 504, and layout 3 is displayed in the next candidate layout display area 505. The image corresponding to the selected thumbnail image 511 is displayed in segment 1 of each layout.

[0075] Similarly, each time an instruction is given to proceed to the next layout, the layout displayed in the main candidate layout display area 501 changes sequentially from layout 3 to layout 8, such as... Figure 6C to Figure 6H As shown in the diagram. Furthermore, in the previous candidate layout display area 504 and the next candidate layout display area 505, layouts that precede and follow the layout displayed in the main candidate layout display area 501 are displayed, respectively.

[0076] On the other hand, when an instruction to return to the previous layout is given by operating the scroll bar 506 or the layout switching button 508, or by sliding the layout selection area 500, the layout displayed in the main candidate layout display area 501 is changed to the previous layout, and the layouts before and after the layout displayed in the main candidate layout display area 501 are displayed in the previous candidate layout display area 504 and the next candidate layout display area 505. In this way, the user can select the desired layout.

[0077] In Figure 6A , the layout 2 is displayed in the next candidate layout display area 505, but because the selected candidate layout is the layout 1, which is the first layout, no layout is displayed in the previous candidate layout display area 504. However, the present application is not limited to this, and the order of the layouts to be displayed can be circular, and when the first layout is displayed in the main candidate layout display area 501, the last layout 8 can be displayed in the previous candidate layout display area 504. Similarly, in the example shown in Figure 6H , the layout 1 can be displayed in the next candidate layout display area 505.

[0078] Next, the screen transition when an image is selected will be explained.

[0079] In each section of each layout displayed in the layout selection area 500, the image corresponding to the thumbnail image selected from the thumbnail image selection area 510 is placed in the order of selection. At this time, if the aspect ratio of each section is different from the aspect ratio of the selected image, a "padding" placement in which the image is cut to match the aspect ratio of the section is used in this embodiment; however, an "inset" placement in which the image is placed so that it is inscribed in the section can also be used. Furthermore, for a section in which no image is placed, a diagonal line or the like is displayed, as in the empty section 503 in Figure 5 , to indicate that no image is arranged.

[0080] First, the case in which the number of selected images is increased will be explained. Figure 7A to Figure 7D is a diagram showing the screen transition when the number of selected images is increased.

[0081] Figure 7A A screen in which no image is selected and the layout 1 is displayed in the main candidate layout display area 501 is shown. Here, as shown in 9a of Figure 9A , a quick preview image in which no image is selected can be generated for each layout and stored in the work memory 104. This allows quick display switching when switching the layout shown in Figure 6A to Figure 6H .

[0082] In Figure 7AOn the screen, when a thumbnail image 701 displayed in the image selection area 510 is tapped, an image selection marker 512 is displayed on the thumbnail image 701, such as... Figure 7B As shown in the figure. In addition, quick preview images are generated and displayed in which the selected images are embedded in segment 1 of layout 1 displayed in the main candidate layout display area 501 and segment 1 of layout 2 displayed in the next candidate layout display area 505.

[0083] At this time, as Figure 9A As shown in 9b, it is possible to generate an image in which the selected image is set to... Figure 7A The screen does not display quick preview images of all layout segments 1 starting from layout 3, and these quick preview images are stored in the working memory 104, thereby enabling... Figure 6A to Figure 6H The layout shown is used for quick switching of display.

[0084] Next, when Figure 7B When you tap the thumbnail image 702 on the screen, as shown Figure 7C As shown, image selection marker 512 is displayed above thumbnail image 702, and each of the quick preview images displayed in layout selection area 500 is updated.

[0085] In this case, layout 1 has only one section where an image can be placed, so it cannot hold two selected images. Therefore, it is removed from the list of layouts to be displayed in layout selection area 500. In other words, layouts 2 through 8 are selectable layouts when two images are selected, as shown below. Figure 9A As shown in 9c, the image in which the selected thumbnail image 702 is generated and displayed is a quick preview image placed in segment 2 of each layout. At this time, because layout 1 displayed in the main candidate layout display area 501 is removed from the list of layouts to be displayed, a quick preview image of the next layout (layout 2) is displayed in the main candidate layout display area 501. In addition, a quick preview image of the next layout 3 is displayed in the next candidate layout display area 505.

[0086] exist Figure 7C In the screen shown, if you tap the thumbnail image 703 further, then as... Figure 7DAs shown in FIG. 9d, the image selection mark 512 is displayed over the thumbnail image 703, and the quick preview images in which the image of the thumbnail image 703 is placed in the segment 3 of each layout are generated. In this case, the layout 2 displayed in the main candidate layout display area 501 and the layout 3 displayed in the next candidate layout display area 505 are excluded from the list of layouts to be displayed, and thus the quick preview image of the next layout (i.e., the layout 4) is displayed in the main candidate layout display area 501. Further, the quick preview image of the next layout 5 is displayed in the next candidate layout display area 505. Similarly, each time a thumbnail image is selected, the corresponding image is placed in the empty segment, and the layout whose number of segments is insufficient is removed from the selectable layouts. Figure 9B As shown in FIG. 9d, the image selection mark 512 is displayed over the thumbnail image 703, and the quick preview images in which the image of the thumbnail image 703 is placed in the segment 3 of each layout are generated. In this case, the layout 2 displayed in the main candidate layout display area 501 and the layout 3 displayed in the next candidate layout display area 505 are excluded from the list of layouts to be displayed, and thus the quick preview image of the next layout (i.e., the layout 4) is displayed in the main candidate layout display area 501. Further, the quick preview image of the next layout 5 is displayed in the next candidate layout display area 505. Similarly, each time a thumbnail image is selected, the corresponding image is placed in the empty segment, and the layout whose number of segments is insufficient is removed from the selectable layouts.

[0087] Next, a case in which an image is deselected will be explained. Figure 8A to Figure 8D is a view showing a screen transition when the number of selected images is reduced.

[0088] Figure 8A the same screen as Figure 7D is shown. On this screen, the selected thumbnail image 701 is tapped, and Figure 8B a state when the selection is canceled is shown. In this case, the image selection mark 512 on the thumbnail image 701 is hidden, and each quick preview image displayed in the layout selection area 500 is updated. At this time, since the number of selected images is reduced to two, the layouts 2 and 3 that have been removed from the list of layouts to be displayed are included in the list again. Also, because the thumbnail image 701 is deselected, the image selection order is changed so that the thumbnail image 702 becomes first and the thumbnail image 703 becomes second. Arranging the images in this order from the segment 1 of each layout results in the quick preview images shown in FIG. 9e. Figure 9B

[0089] At this time, Figure 8A the layout 4 shown in FIG. 9c continues to be in the list of layouts to be displayed, and thus, in Figure 8B FIG. 9e, the layout 4 is also displayed in the main candidate layout display area 501. Further, the layout 3 that is included in the list of layouts to be displayed again is displayed in the previous candidate layout display area 504.

[0090] ​In other words, if the number of selected images increases or decreases, and if the layout displayed before the images were selected / deselected remains in the list of layouts to be displayed, the layout continues to be displayed in the main candidate layout display area 501, and if the layout is removed from the list of layouts to be displayed, the next layout to be displayed is displayed in the main candidate layout display area 501.

[0091] Figure 8C A state in which the selected thumbnail image 702 in Figure 8B is tapped and deselected is shown. In this case, the image selection mark 512 on the thumbnail image 702 is hidden, and each quick preview image displayed in the layout selection area 500 is updated. At this time, the number of selected images has decreased to one, and the layout 1 that has been removed from the list of layouts to be displayed is included in the list of layouts to be displayed again. Further, as the thumbnail image 702 is deselected, only the thumbnail image 703 remains selected. Therefore, when the image of the thumbnail image 703 is placed in the section 1 of each layout, quick preview images such as those shown in 9f in Figure 9B are obtained.

[0092] At this time, Figure 8B the layout 4 displayed in Figure 8C continues to be in the list of layouts to be displayed, therefore, in the layout 4 continues to be displayed in the main candidate layout display area 501. Further, the layout 3 continues to be displayed in the previous candidate layout display area 504.

[0093] Figure 8D Finally, Figure 8C A state in which the selected thumbnail image 703 in Figure 9A is tapped and deselected is shown. In this case, the image selection mark 512 on the thumbnail image 703 is hidden, and each quick preview image displayed in the layout selection area 500 is updated. At this time, as the thumbnail image 703 is deselected, all thumbnail images are deselected, the quick preview images return to those shown in 9a in in which no images are placed in each layout and are displayed.

[0094] As described above, by narrowing down the selectable layouts according to the number of images selected by the user, the user can easily select a layout in which the selected images can be arranged.

[0095] Figure 10 Next, the display processing of the layout / image selection screen of the layout printing application in this embodiment will be described with reference to the flowchart in

[0096] Figure 10The flowchart shown in FIG. 9A starts with the layout print application of this embodiment being started and the layout / image selection screen being displayed. Figure 10 The processing shown in FIG. 9A is executed by the control unit 101 of the mobile device 100 executing the layout print application.

[0097] In step S101, the layout print application displays the available layouts in the layout selection region 500. At this time, as described above, the available layouts can be selected in accordance with the current settings such as the printer type, the size and type of paper, and the like. Specifically, first, as shown in FIG. 10A, the available layouts are displayed in the layout selection region 500. Figure 9A In step S101, the layout print application displays the available layouts in the layout selection region 500. At this time, as described above, the available layouts can be selected in accordance with the current settings such as the printer type, the size and type of paper, and the like. Specifically, first, as shown in FIG. 10A, the available layouts are displayed in the layout selection region 500.

[0098] Immediately after the layout print application is executed, as shown in FIG. 9B, layout 1 is displayed in the main candidate layout display region 501, and layout 2 is displayed in the next candidate layout display region 505. Further, for example, if printing is executed using layout 5 and then the screen transitions to the layout / image selection screen, layout 5 can continue to be displayed in the main candidate layout display region 501, layout 4 is displayed in the previous candidate layout display region 504, and layout 6 is displayed in the next candidate layout display region 505, as shown in FIG. 9C. Figure 7A Figure 11

[0099] Next, in step S102, thumbnail images of the image data that can be used for printing among the image data stored in the storage medium 110 or the like are displayed side by side in the image selection region 510.

[0100] Next, in step S103, it is determined whether the OK button 522 is selected. If it is determined that the OK button 522 is not selected, the processing proceeds to step S104.

[0101] In step S104, it is determined whether an operation to change the layout displayed in the layout selection region 500 is executed. If it is determined in step S104 that an operation to change the display of the quick preview image is executed, the processing proceeds to step S105.

[0102] In step S105, the quick preview images stored in the work memory 104 are read in response to the user operation, and are displayed in the main candidate layout display region 501, the previous candidate layout display region 504, and the next candidate layout display region 505, and the processing proceeds to step S106.

[0103] ​​On the other hand, if it is determined in step S104 that the operation of changing the layout displayed in the layout selection region 500 is not performed, the process proceeds to step S106.

[0104] In step S106, it is determined whether a selection operation is performed by tapping the thumbnail image displayed in the image selection region 510 or whether a deselection operation is performed by tapping the thumbnail image of the image that has been selected.

[0105] If it is determined that the image selection operation or the deselection operation is not performed, the process returns to step S103 and the operation of the user is monitored again. On the other hand, if it is determined that the image selection operation or the deselection operation is performed, the process proceeds to step S107.

[0106] In step S107, the layout to be displayed in the layout selection region 500 is selected from the layouts according to the number of the images that are currently selected. Here, the layout whose number of sections is less than the number of the selected images is excluded from the list of the layouts to be displayed and is not displayed. In other words, as described with reference to FIG. 6, if the number of the selected images is two, the layout 1 is excluded from the list of the layouts to be displayed, and if the number of the selected images is three, the layouts 2 and 3 are excluded from the list of the layouts to be displayed in addition to the layout 1. Figure 7A to Figure 7D

[0107] In step S108, the selected images are placed in the layouts in the list of the layouts to be displayed in step S107 in order to generate the quick preview images, and the quick preview images are saved in the work memory 104. Further, the quick preview images of the layouts are displayed in the main candidate layout display region 501, the previous candidate layout display region 504, and the next candidate layout display region 505, and the process returns to step S103 in which the operation of the user is monitored again.

[0108] ​If the number of images selected as a result of the image selection operation in step S105 increases, the layout displayed in the main candidate layout display area 501 before the image selection operation can become hidden and unavailable for selection in step S107. In this case, a layout that can accommodate the number of currently selected images is displayed, and the currently selected layout is changed. At this time, a layout of a number of sections equal to the number of selected images is basically displayed in the main candidate layout display area 501. However, if there is no layout of the same number of sections, a layout of a number of sections equal to or greater than the number of selected images can be displayed in the main candidate layout display area 501. If the number of images selected as a result of the deselection operation in step S105 decreases, the layout displayed in the main candidate layout display area 501 before the image selection operation does not change, and the display of the quick preview image is changed in step S108.

[0109] Finally, if it is determined in step S103 that the OK button 522 is pressed, the process proceeds to step S109, in which the layout displayed in the main candidate layout display area 501 and the selected images are confirmed, and the screen transitions to a print preview screen. On the print preview screen, the preview image is displayed in a larger display size than the quick preview image displayed in the main candidate layout display area 501, so that it is easier to check the images and the print layout.

[0110] As described above, according to this embodiment, it is possible to select a layout and images to be arranged on a single layout / image selection screen, which makes it easier to select a layout and images to be arranged even on a device having a small display screen.

[0111] In the above embodiment, an application of printing with selected layouts and images is described, but it is not necessarily printing. For example, the application can be used for other purposes, such as uploading edited images to an SNS (Social Networking Service).

[0112] <OTHER EMBODIMENTS>

[0113] The present application can be applied to a system composed of a plurality of devices, or to a device composed of a single device.

[0114] The present application can be implemented by supplying a program for implementing one or more functions of the above-described embodiments to a system or an apparatus via a network or a storage medium, and causing one or more processors in a computer of the system or the apparatus to read out and execute the program. The present application can also be implemented by a circuit (e.g., ASIC) for implementing one or more functions.

[0115] The present application is not limited to the above embodiments, and various changes and modifications can be made within the spirit and scope of the present application. Therefore, in order to inform the public of the scope of the present application, the appended claims are presented.

[0116] This application claims priority to Japanese Patent Application No. 2023-139119, filed August 29, 2023, which is hereby incorporated by reference herein.

Claims

1. An image processing apparatus comprising: reception means configured to receive an operation of a user; and display control means configured to control to display, on a display device, a display screen on which a layout selection area for selecting a layout in which images are to be arranged and an image selection area for selecting images to be arranged in the layout are arranged, wherein the display control means changes selectable layouts in the layout selection area in response to a change in selection of images in the image selection area by a user operation, and controls to display, as selectable layouts, layouts in which a number of images equal to or greater than a number of selected images selected in the image selection area can be arranged. 2.The image processing apparatus according to claim 1, wherein the display control means changes selectable layouts in the layout selection area in response to a change in selection of images in the image selection area by a user operation so that a layout in which a number of selected images selected in the image selection area is arranged is selectable. 3.The image processing apparatus according to claim 1, wherein the display control means hides, in response to a change in selection of images in the image selection area by a user operation, a layout in which a number of images less than a number of selected images selected in the image selection area can be arranged. 4.The image processing apparatus according to any one of claims 1 to 3, wherein the display control means controls display of selectable layouts in the layout selection area in order of an available number of images that can be arranged. 5.The image processing apparatus according to any one of claims 1 to 4, wherein the display control means displays a currently selected layout in the layout selection area in a manner that distinguishes it from other layouts, and in a case where the currently selected layout becomes unselectable due to an increase in a number of selected images in response to a change in selection of images, changes the currently selected layout to one of layouts that can be selectable after the number of selected images is increased. 6.The image processing apparatus according to claim 5, wherein in a case where the currently selected layout becomes unselectable due to an increase in a number of selected images, the display control means controls to change the currently selected layout to a layout in which a number of images equal to the increased number of selected images can be arranged. 7.The image processing apparatus according to claim 5, wherein in a case where a number of selected images is decreased in response to a change in selection of images, the display control means controls not to change the currently selected layout. 8.The image processing apparatus according to any one of claims 1 to 7, wherein the display control means controls to display a quick preview in which images selected in the image selection area are arranged in a layout displayed in the layout selection area. ​ 9. The image processing apparatus according to claim 8, wherein the display control means controls to display, on the display device, a preview screen in which a preview of the image selected in the image selection area and arranged in the layout selected in the layout selection area is displayed at a display size larger than a display size of the quick preview, in response to a predetermined operation for confirming selection of the layout in the layout selection area and selection of the image in the image selection area.

10. The image processing apparatus according to claim 1, further comprising: communication means configured to perform communication; and generation means configured to generate print data corresponding to a preview image of a selected layout, when the receiving means receives an operation for confirming selection of the layout, wherein the print data is transmitted to a print device via the communication means.

11. The image processing apparatus according to any one of claims 1 to 10, wherein the image processing apparatus is a mobile device, and further comprising the display device.

12. An image processing method comprising: a display control step in which display control means controls to display a display screen on a display device, a layout selection area for selecting a layout in which an image is to be arranged and an image selection area for selecting an image to be arranged in the layout are arranged on the display screen; a reception step in which reception means receives an operation of a user; and a step in which the display control means changes selectable layouts in the layout selection area in response to a change in selection of an image in the image selection area by a user operation, and controls to display a layout capable of arranging an image equal to or larger than a number of selected images in the image selection area as a selectable layout.

13. A program for causing a computer to function as each of the means of the image processing apparatus according to any one of claims 1 to 11.

14. A program for causing a computer to execute each step of the image processing method according to claim 12.

Images