Image processing device, image processing method, and program

Abstract

To provide an image on which all the editing content is reflected and an image on which a portion of the editing content is not reflected in a mixed manner.SOLUTION: An image processing device applied with this technique performs make-up processing including processing of adjusting the color of the lip and doodling processing including processing of synthesizing an image for synthesis according to the doodling work by a user targeting each photographed image obtained by performing plural times of imaging targeting the user as a subject, generates a plurality of edition images, and outputs the plurality of first edition images being the edition images on which the contents of the make-up processing and the doodling processing are reflected and the plurality of second edition images being the edition images on which the content of the make-up processing is reflected but the content of the doodling processing is not reflected that are generated based on the photographed images. This technique can be applied to a photograph creation game machine which provides a series of games for printing the photographed image on a seal sheet.SELECTED DRAWING: Figure 16

Description

[Technical field]

[0001] The present technology relates to an image processing device, an image processing method, and a program, and in particular to an image processing device, an image processing method, and a program that are capable of providing a mixture of images in which all editing content is reflected and images in which some editing content is not reflected. [Background technology]

[0002] Conventionally, photo sticker creation devices are known. The photo sticker creation devices take a picture of a user, allow the user to edit the photographed image, and print the edited image on sticker paper for provision. The photo sticker creation devices are installed in amusement facilities and the like.

[0003] The flow of a game provided by the photo sticker creation device typically involves taking a photo of the user in the shooting space as the subject, then moving the user to the editing space, editing the image according to the operations performed in the editing space, and printing the edited image on sticker paper.

[0004] In this manner, in a typical photo sticker creating device, sticker paper on which an edited image is printed is provided to the user. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2008-283365 A Summary of the Invention [Problem to be solved by the invention]

[0006] In cases where editing is not successful, printing the image before editing may result in a better overall appearance of the sticker sheet. Therefore, it is conceivable to have the user select whether to print the edited image or the image before editing before starting printing, but if, for example, a user selects to print an image in its unedited state because an image was not edited successfully, when this selection is applied to all images, even images that were successfully edited will be printed in their unedited state.

[0007] The present technology has been made in view of such circumstances, and makes it possible to provide a mixture of images in which all of the editing content is reflected and images in which some of the editing content is not reflected. [Means for solving the problem]

[0008] The image processing device to which the present technology is applied includes an editing unit that performs a retouching process including a process for adjusting the size of the eyes, a makeup process including a process for adjusting the color of the lips, and a doodling process including a process for compositing an image to be composited in accordance with doodling work by the user, on each of the photographed images obtained by photographing a user a plurality of times, and generates a plurality of edited images, and generates a plurality of first edited images that are the edited images in which the contents of the retouching process, the makeup process, and the doodling process are reflected, and a plurality of second edited images that are the edited images in which the contents of the retouching process and the makeup process are reflected but the contents of the doodling process are not reflected, which are generated based on the respective photographed images. To display simultaneously on the same screen and an output unit for outputting the signal.

[0009] The editing section can perform, as the doodling process, a process of compositing the compositing image, which includes handwritten characters and a stamp image input by the user, with the photographed image to be edited. The editing section can perform the makeup process including a process of adjusting the color of the cheeks as well as the color of the lips.

[0010] The output section can be configured to transmit the first edited image and the second edited image to an external server for display on a screen of the user's mobile terminal.

[0011] In this technology, a retouching process including a process of adjusting the size of the eyes, a makeup process including a process of adjusting the color of the lips, and a doodling process including a process of compositing an image for composition according to doodling by the user are performed on each of the photographed images obtained by photographing a user multiple times, and a plurality of edited images are generated. In addition, a plurality of first edited images, which are the edited images reflecting the contents of the retouching process, the makeup process, and the doodling process, and a plurality of second edited images, which are the edited images reflecting the contents of the retouching process and the makeup process but not the contents of the doodling process, are generated based on the respective photographed images. To display simultaneously on the same screen is output. Effect of the Invention

[0012] According to the present technology, it is possible to provide a mixture of images in which the entire editing content is reflected and images in which some editing content is not reflected. [Brief description of the drawings]

[0013] [Figure 1] 1 is a perspective view showing an example of the external configuration of a photo sticker creation device according to the present technology; [Diagram 2] FIG. 2 is a perspective view of the photo sticker creating device as seen from another angle. [Diagram 3] FIG. 1 is a diagram illustrating the movement of a user. [Figure 4] FIG. 13 illustrates an example of the configuration of a pre-selection unit; [Diagram 5] FIG. 2 is a diagram illustrating an example of the configuration of an imaging unit. [Figure 6] FIG. 4 is a diagram showing an example of the configuration of a background part. [Figure 7] FIG. 2 is a diagram showing an example of the configuration of the front side of the editing unit. [Figure 8] FIG. 2 is a diagram showing an example of the configuration of a side surface of an editing unit. [Figure 9] FIG. 13 is a diagram showing an example of a sticker sheet. [Figure 10] FIG. 11 is a diagram showing an example of a flow of generating an edited image. [Figure 11] 1 is a block diagram showing an example of the configuration of a photo sticker creating device; [Figure 12] 2 is a block diagram showing an example of a functional configuration of the photo sticker creating device; [Figure 13] 13 is a block diagram showing an example of the configuration of an image capture processing unit in FIG. 12. [Figure 14] 13A and 13B are diagrams illustrating an example of generation of a close-up image and a coordinated image. [Figure 15] 13 is a block diagram showing an example of the configuration of an edit processing unit in FIG. 12. [Figure 16] FIG. 13 is a diagram showing an example of an image printed on a sticker sheet. [Figure 17] 17 is a diagram showing the graffiti-reflected image and a bonus image in FIG. 16 side by side. [Figure 18] FIG. 13 is a diagram showing an example of a process of reflecting a bonus image. [Figure 19] FIG. 11 is a diagram illustrating reflected and unreflected edit processing. [Figure 20] 13A and 13B are diagrams showing other examples of images printed on a sticker sheet. [Figure 21] 13 is a flowchart illustrating a photo sticker creation game process. [Figure 22] 22 is a flowchart illustrating an edit-related process performed in step S4 of FIG. 21. [Figure 23] FIG. 13 is a diagram illustrating an example of an editing screen. [Figure 24] FIG. 13 is a diagram showing an example of a display of a division number selection screen. [Diagram 25] FIG. 13 is a diagram showing an example of cutting one sticker sheet. [Figure 26] FIG. 13 is a diagram showing an example of a display of a division number selection screen. [Figure 27] FIG. 13 is a diagram showing an example of a combination of two sticker sheets. [Figure 28] FIG. 13 is a diagram showing another example of a combination of two sticker sheets. [Figure 29] 13A and 13B are diagrams showing other examples of images printed on a sticker sheet. [Diagram 30] FIG. 13 is a diagram showing another display example of the division number selection screen. [Diagram 31] FIG. 13 is a diagram showing an example of a design of the main area. [Diagram 32] FIG. 13 is a diagram showing an example of an image printed on a sticker sheet. [Diagram 33] FIG. 13 is a diagram showing an example of an image printed on a sticker sheet. [Diagram 34] FIG. 13 is a diagram showing an example of an image selection screen. [Diagram 35] FIG. 13 is a diagram showing an example of an image selection screen. [Diagram 36] FIG. 13 is a diagram showing an example of an image printed on a sticker sheet. [Figure 37] FIG. 13 is a diagram showing an example of an image printed on a sticker sheet. [Figure 38] FIG. 13 is a diagram showing an example of an image printed on a sticker sheet. [Figure 39] FIG. 13 is a diagram showing an example of an image printed on a sticker sheet. [Diagram 40] FIG. 13 is a diagram showing an example of a screen display of a mobile terminal. [Diagram 41] FIG. 13 is a diagram showing an example of a screen display of a mobile terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] <<Example 1>> <Exterior of the photo sticker creation device> 1 and 2 are perspective views showing an example of the external configuration of a photo sticker creating device 1. FIG.

[0015] The photo sticker creation device 1 is a game machine that provides captured images and edited images. The photo sticker creation device 1 provides images to users by printing the images on sticker paper or making the images viewable on the user's mobile terminal. The photo sticker creation device 1 is installed in amusement facilities such as game arcades and in stores.

[0016] Users of the photo sticker creation device 1 are mainly female high school students and young women. In the photo sticker creation device 1, multiple users, usually two or three people per group, can enjoy the game. Of course, in the photo sticker creation device 1, a single user can also enjoy the game.

[0017] In the photo sticker creation device 1, the user takes a photo of himself / herself as the subject. The user then performs an editing operation to composite an image, such as handwritten characters or a stamp image, with an image selected from the photographed images. This edits the photographed image into a colorful image. The user receives a sticker sheet on which the edited image, which is the edited image, is printed, and ends the series of games.

[0018] The photo sticker creating device 1 can be said to be a photo creating game machine that provides a photo creating game.

[0019] 1, the photo sticker creating device 1 is basically configured by installing a photographing unit 11 and an editing unit 12 in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected to each other.

[0020] The photographing unit 11 has a box-shaped housing large enough for a person to enter, and is composed of a pre-selection section 20, a photographing section 21, and a background section 22. The pre-selection section 20 is installed on the side of the photographing section 21. The space in front of the pre-selection section 20 becomes a pre-selection space where pre-selection processing is performed. In addition, the photographing section 21 and the background section 22 are installed a predetermined distance apart. The space formed between the photographing section 21 and the background section 22 becomes a photographing space where photographing processing is performed.

[0021] As a pre-selection process, the pre-selection unit 20 performs guidance to introduce the game provided by the photo sticker creating device 1 and performs various settings for the photographing process performed in the photographing space. The pre-selection unit 20 is provided with a coin slot through which the user inserts money, a touch panel monitor used for various operations, and the like. The pre-selection unit 20 appropriately guides the user in the pre-selected space to the photographing space according to the availability of the photographing space.

[0022] The photographing unit 21 is a device for photographing a user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the photographing unit 21 facing the photographing space.

[0023] If the left side as viewed from a user facing forward in the photographing space is the left side and the right side is the right side, then the left side of the photographing unit 21 is formed by side panel 41A, and the right side is formed by side panel 41B. Furthermore, the front of the photographing unit 21 is formed by front panel 42. The above-mentioned pre-selection unit 20 is installed on side panel 41A. Note that the pre-selection unit 20 may also be installed on side panel 41B.

[0024] Background section 22 is composed of rear panel 51, side panel 52A, and side panel 52B. Rear panel 51 is a plate-like member located behind a user facing forward. Side panel 52A is attached to the left end of rear panel 51 and is a plate-like member narrower in width than side panel 41A. Side panel 52B is attached to the right end of rear panel 51 and is a plate-like member narrower in width than side panel 41B.

[0025] The side panels 41A and 52A are provided on approximately the same plane. The upper parts of the side panels 41A and 52A are connected by a connecting portion 23A, which is a plate-shaped member. The lower parts of the side panels 41A and 52A are connected by a connecting portion 23A', which is, for example, a metal member provided on the floor surface. The side panels 41B and 52B are similarly provided on approximately the same plane. The upper parts of the side panels 41B and 52B are connected by a connecting portion 23B. The lower parts of the side panels 41B and 52B are connected by a connecting portion 23B'.

[0026] A floor material 27, which is a plate-like member, is laid on the floor of the imaging space.

[0027] For example, a green chromakey sheet is attached to the surface of the rear panel 51 facing the shooting space. The photo sticker creation device 1 performs chromakey compositing in the shooting process and editing process by taking a picture with the chromakey sheet as the background. As a result, the desired background image is composited with the user's background.

[0028] An opening formed by being surrounded by side panel 41A, connecting portion 23A, and side panel 52A serves as an entrance to the photography space. In addition, an opening formed by being surrounded by side panel 41B, connecting portion 23B, and side panel 52B also serves as an entrance to the photography space.

[0029] Above the shooting space, a ceiling is formed, surrounded by the front of shooting unit 21, connecting part 23A, and connecting part 23B. A ceiling strobe unit 24 is provided in a part of the ceiling. One end of ceiling strobe unit 24 is fixed to connecting part 23A, and the other end is fixed to connecting part 23B.

[0030] The ceiling strobe unit 24 has a built-in strobe that irradiates light into the shooting space in accordance with shooting. In addition to the strobe, a fluorescent lamp is provided inside the ceiling strobe unit 24. This allows the ceiling strobe unit 24 to function as an illumination for the shooting space.

[0031] The editing unit 12 is a device for editing the captured image. The editing unit 12 is connected to the photographing unit 11 with one side surface in contact with the front panel 42 of the photographing section 21.

[0032] 1 is the configuration on the front side of the editing unit 12, components used for editing work are provided on both the front side and the rear side of the editing unit 12. With this configuration, two groups of users can perform editing work simultaneously.

[0033] The front side of the editing unit 12 is composed of a surface 61 and an inclined surface 62 formed above the surface 61. The surface 61 is perpendicular to the floor surface and is substantially parallel to the side panel 41A of the imaging section 21. A tablet built-in monitor and a touch pen are provided on the inclined surface 62 as components used for editing work. A columnar support 63A that supports one end of the lighting device 64 is provided on the left side of the inclined surface 62. A columnar support 63B that supports the other end of the lighting device 64 is provided on the right side of the inclined surface 62. A support 65 that supports the curtain rail 26 is provided on the upper surface of the support 63A.

[0034] A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C. The three rails 26A to 26C are combined so that they form a U-shape when viewed from above. One ends of rails 26A and 26B, which are provided in parallel, are fixed to connecting parts 23A and 23B, respectively, and the other ends of rails 26A and 26B are joined to both ends of rail 26C, respectively.

[0035] A curtain is attached to the curtain rail 26 so that the space in front of the front and the space in front of the rear of the editing unit 12 cannot be seen from the outside. The space in front of the front and the space behind the rear of the editing unit 12 surrounded by the curtain become the editing space where the user performs editing work.

[0036] As will be described later, an outlet through which the printed sticker sheet is discharged is provided on the left side of the editing unit 12. The space in front of the left side of the editing unit 12 becomes a print waiting space where the user waits for the printed sticker sheet to be discharged.

[0037] <About user movement> Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described.

[0038] FIG. 3 is a plan view of the photo sticker creating device 1 seen from above.

[0039] The user inserts coins into a coin slot in the pre-selection space A0, which is the space in front of the pre-selection unit 20. Next, the user performs various settings according to the screen displayed on the touch panel monitor. For example, the user performs a pre-selection task such as selecting a course for photography to be performed in the photography space.

[0040] After completing the pre-selection task, the user enters the photographing space A1 formed between the photographing unit 21 and the background unit 22 from the doorway G1 between the side panel 41A and the side panel 52A, as indicated by the outlined arrow #1. The user performs photographing work using the camera and touch panel monitor provided in the photographing unit 21.

[0041] After completing the photo shoot, the user exits the photo shoot space A1 through the entrance G1 as shown by the white arrow #2 and moves to the editing space A2-1, or exits the photo shoot space A1 through the entrance G2 as shown by the white arrow #3 and moves to the editing space A2-2.

[0042] Editing space A2-1 is an editing space on the front side of the editing unit 12. On the other hand, editing space A2-2 is an editing space on the rear side of the editing unit 12. The user is guided as to which of editing space A2-1 and editing space A2-2 to move to by, for example, a screen display on the touch panel monitor of the imaging unit 21. For example, the user is guided to the one of the two editing spaces that is vacant as the destination. The user who moves to editing space A2-1 or editing space A2-2 starts editing work. The user of editing space A2-1 and the user of editing space A2-2 can perform editing work at the same time.

[0043] After the editing work is completed, printing of the edited image begins. When printing begins, a user who has finished editing work in the editing space A2-1 moves from the editing space A2-1 to the print waiting space A3 as shown by the outlined arrow #4. Also, a user who has finished editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as shown by the outlined arrow #5.

[0044] The user moves to the print waiting area A3 and waits for the printing to finish. When the printing is finished, the user receives the sticker sheet that was discharged from the discharge port provided on the right side of the editing unit 12, and the series of photo sticker creation games is completed.

[0045] Next, the configuration of each device will be described.

[0046] <Configuration of pre-selection part> FIG. 4 is a diagram showing an example of the configuration of the pre-selection unit 20. As shown in FIG.

[0047] A touch panel monitor 71 is provided above the pre-selection unit 20. The touch panel monitor 71 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and accepting selection operations by the user. A screen used for selecting the number of users, etc. is displayed on the touch panel monitor 71.

[0048] A speaker 72 is provided below the touch panel monitor 71. The speaker 72 outputs voice guidance for the pre-selection process, background music (BGM), sound effects, etc. A coin insertion / return slot 73 into which a user inserts coins is provided adjacent to the speaker 72.

[0049] <Composition of the shooting team> 5 is a diagram showing an example of the configuration of the front side of the imaging unit 21. The imaging unit 21 is configured so as to be surrounded by a side panel 41A, a side panel 41B, and a front panel .

[0050] A camera unit 81 is provided slightly above the center of the front panel 42. In front of the camera unit 81, a camera 91, a touch panel monitor 92, and a front strobe 93 are provided.

[0051] The camera 91 is, for example, a single-lens reflex camera, and is attached inside the camera unit 81 so that the lens is exposed. The camera 91 has an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and captures an image of a user in the imaging space A1. The camera 91 functions as an imaging unit that captures an image of the user as a subject.

[0052] A moving image (hereinafter also referred to as a live view image) captured by the camera 91 is displayed in real time on the touch panel monitor 92. A still image captured by the camera 91 at a predetermined timing, such as when an instruction to capture is given, is saved as a captured image.

[0053] The touch panel monitor 92 is provided below the camera 91. The touch panel monitor 92 is composed of a monitor such as an LCD and a touch panel laminated on it. The touch panel monitor 92 has a function as a live view monitor that displays moving images captured by the camera 91, and a function of displaying various GUIs and accepting selection operations by the user.

[0054] The front strobe 93 is provided above the camera 91. The front strobe 93 has a crescent-shaped light-emitting surface made of a milky white acrylic plate. The front strobe 93 emits light in synchronization with shooting by the camera 91, thereby illuminating the area around the face of the user as a subject from the front.

[0055] An upper strobe unit 82 with a curved light-emitting surface facing the user is installed above the camera unit 81. The upper strobe unit 82 irradiates light onto the face and upper body of the user from above and in front of the user.

[0056] Below the camera unit 81, a foot strobe unit 83 is provided which irradiates light onto the lower body and feet of the user.

[0057] The upper strobe unit 82 and the foot strobe unit 83 are composed of a fluorescent lamp and a lighting device capable of strobe emission. The upper strobe unit 82 and the foot strobe unit 83 constantly illuminate the shooting space to brighten the shooting space and ensure the operability and safety of the user, and also emit a strobe at the shooting timing to irradiate the user who is the subject with light in order to improve the quality of the captured image.

[0058] A box-shaped portion 84 is provided between the foot strobe unit 83 and the side panel 41A. In addition, a box-shaped portion 85 is provided between the foot strobe unit 83 and the side panel 41B. The upper surfaces of the box-shaped portions 84 and 85 are substantially horizontal with the installation surface of the photo sticker creating device 1, and are used as a luggage storage area for a user performing photography work to place baggage, etc.

[0059] Although not shown, a speaker is provided, for example, near the ceiling of the front panel 42. The speaker outputs voice guidance for the shooting process, background music, sound effects, and the like.

[0060] <Background composition> FIG. 6 is a diagram showing an example of the configuration of the background portion 22 on the side of the shooting space A1.

[0061] An upper rear strobe 101 is installed above the rear panel 51. The upper rear strobe 101 irradiates light to the user from above the rear surface.

[0062] In the drawing, a left rear strobe 102 is installed on the left side of the rear panel 51. The left rear strobe 102 irradiates the user from the right rear side. In the drawing, a right rear strobe 103 is installed on the right side of the rear panel 51. The right rear strobe 103 irradiates the user from the left rear side.

[0063] A chromakey sheet 121 is attached to the surface on the shooting space A1 side (the front side in the figure) of the rear panel 51. The color of the chromakey sheet 121 is, for example, green.

[0064] Although not shown, a chromakey sheet is also attached to the underside (floor side) of the surface of the side panels 52A and 52B facing the shooting space A1, similar to the chromakey sheet 121.

[0065] <Editing unit composition> FIG. 7 is a diagram showing an example of the configuration of the front side (editing space A2-1 side) of the editing unit 12. As shown in FIG.

[0066] A tablet built-in monitor 131 is provided approximately in the center of the inclined surface 62. A touch pen 132A is provided on the left side of the tablet built-in monitor 131. A touch pen 132B is provided on the right side of the tablet built-in monitor 131.

[0067] The tablet built-in monitor 131 is configured by stacking a tablet and a display. The tablet allows operation input using a touch pen 132A or a touch pen 132B. For example, an editing screen used for editing work is displayed on the tablet built-in monitor 131. When two users perform editing work at the same time, the touch pen 132A is used by the user on the left side as viewed from the tablet built-in monitor 131, and the touch pen 132B is used by the user on the right side as viewed from the tablet built-in monitor 131.

[0068] Note that operations using touch pen 132A and operations using touch pen 132B are distinguished. As appropriate, only operations using touch pen 132A are possible for the display on the left side of tablet built-in monitor 131, and only operations using touch pen 132B are possible for the display on the right side. Hereinafter, when there is no need to distinguish between touch pen 132A and touch pen 132B, they will be collectively referred to as touch pen 132.

[0069] FIG. 8 is a diagram showing an example of the configuration of the left side of the editing unit 12. As shown in FIG.

[0070] A sticker paper outlet 161 is provided on the lower left side of the editing unit 12. A printer is provided inside the editing unit 12. The printer prints an image of a user of the editing space A2-1 or an image of a user of the editing space A2-2 on a sticker sheet in a predetermined layout, and the sticker sheet is discharged from the sticker paper outlet 161.

[0071] <Example of sticker sheet> FIG. 9 is a diagram showing an example of a sticker sheet created by the photograph sticker creating device 1. As shown in FIG.

[0072] For example, if there are two users, a sticker sheet with photos (images) printed in a layout such as that shown in Fig. 9 is created and provided to the users. The layout shown in Fig. 9 is one of several layouts available, and the user can select the layout they prefer.

[0073] The sticker sheet 181 is formed with a main area 181A that is approximately the size of a business card and a horizontally elongated bonus area 181B. An edited image 191-1 is printed large in approximately the left half of the main area 181A, and to the right of it, four edited images 191-2 to 191-5 are printed in a 2-row x 2-column arrangement with a size smaller than the edited image 191-1. The edited images 191-1 to 191-5 are vertically elongated rectangular images.

[0074] Edited images 191-1 to 191-5 are images generated by editing close-up images that show the face and upper body of the subject. In practice, a background image of a predetermined color or pattern is appropriately synthesized in the background of the user, and a foreground image such as handwritten characters or a stamp image is synthesized in the foreground of the user.

[0075] In the photographing process, in addition to close-up images, images showing a wide range from the top of the head to around the knees are also photographed. These images are used, for example, to record outfits. Hereinafter, images with a wider range than close-up images, which are used to record outfits, etc., are referred to as coordination images, as appropriate. Images showing the whole body from the top of the head to the soles of the feet may also be referred to as coordination images.

[0076] The close-up image and the coordinate image have different aspect ratios. For example, the ratio of the horizontal length to the vertical length of the close-up image is 1:1.2, and the ratio of the horizontal length to the vertical length of the coordinate image is 1:1.5. In this example, the coordinate image is not to be printed.

[0077] In the bonus area 181B, images in which foreground frames of various shapes different from the shape of the edited image printed in the main area 181A are superimposed are printed side by side as bonus images 192-1 to 192-5. The images printed in the bonus area 181B are used by cutting them out with scissors, for example. Bonus images may be generated by trimming the original images into various shapes, instead of superimposing the foreground frames so that the inner range is visible.

[0078] As will be described in detail later, the bonus image printed in the bonus area 181B is not an image reflecting all of the editing contents performed by the user during editing work, but an image generated using an image in which some editing has not been reflected. An image generated using a photographed image in which no editing has been performed may be printed as a bonus image in the bonus area 181B.

[0079] A sticker ID and the like are printed in the margin of the bonus area 181B. The sticker ID is used when viewing the image transmitted from the photo sticker creating apparatus 1 to the server on a mobile terminal such as a smartphone.

[0080] The transmission of images to the mobile terminal is performed via a server that manages an image acquisition site, which is a website for importing (saving) images transmitted from the photo sticker creating device 1 into the mobile terminal. Users can use the images imported into their mobile terminals by posting them to SNS or setting them as wallpaper. Hereinafter, the server that manages the image acquisition site will be referred to as the image acquisition site management server, where appropriate.

[0081] FIG. 10 is a diagram showing an example of a flow of generating an edited image.

[0082] The original image P1 on the left side is an image output from the camera 91 at the time of shooting. In the example of Fig. 10, substantially the entire bodies of two users from head to toe are captured, but the range (angle of view) captured in the original image P1 is appropriately changed according to the focal length of the lens of the camera 91, etc. In the background of the users captured in the original image P1, objects that were actually around the users at the time of shooting, such as the floor of the shooting space A1, the inner surfaces of each panel surrounding the shooting space A1, and the chromakey sheet 121, are captured.

[0083] The original image P1 is trimmed, and a trimmed image P2 is generated as indicated by the tip of the arrow #11. The trimmed image P2 is an image generated by cutting out a rectangular area shown enclosed by a dashed line from the area captured in the original image P1.

[0084] In the example of Fig. 10, the area from approximately the chest up of two users is captured, and the trimmed image P2 is used as a close-up image. The rectangle indicated by the dashed line on the original image P1 represents the trimming range used when taking the close-up image. The range cut out by trimming is changed as appropriate depending on the type of image with a different angle of view, such as a close-up image or a coordinated image. Although the range is narrower than that of the original image P1, the chromakey sheet 121 and the like are visible in the background of the user in the trimmed image P2.

[0085] Chromakey processing is performed on trimmed image P2, and a person image P3 is generated as indicated by the tip of arrow #12. The chromakey processing is performed, for example, by extracting an area of ​​the same color as the color of chromakey sheet 121 to generate a mask image, and then extracting the person area using the generated mask image.

[0086] In the person image P3, the transparency of the area other than the area in which the user is photographed (the background area) is set to 100%. In Fig. 10, the background area of ​​the person image P3 is filled with black, which indicates that the transparency of that area is 100%.

[0087] A background image P4 is synthesized with the person image P3 as shown by the tips of arrows #13 and #14, and a background synthesized image P5 is generated as shown by the tip of arrow #15. The background image P4 is selected at a predetermined timing from a plurality of types prepared in advance by the user or by the photo sticker creating device 1.

[0088] The person image P3 and the background image P4 are combined by placing the layer of the background image P4 below the layer of the person image P3. The background combined image P5 is an image in which the background image P4 is visible behind the user.

[0089] For example, the background composite image P5 thus generated is used as the subject of editing. The user performs doodling, which is the task of inputting composite images such as handwritten characters and stamp images, into an image in which the background image is visible in the background of the user's image.

[0090] The doodling work is performed by repeatedly selecting a desired tool from among a number of tools provided, and in that state, selecting the position of the image to be composited according to the tool. For example, the tool is selected by pressing a button displayed on the editing screen, and the position of the image to be composited is selected by pressing a position on the image displayed large as the editing target.

[0091] Foreground image P6 is composited with background composite image P5 as indicated by arrows #16 and #17, and edited image P7 is generated as indicated by arrow #18. Foreground image P6 is an image generated in response to doodling by a user, and is constructed by arranging composite images in predetermined positions.

[0092] In the example of Fig. 10, foreground image P6 is an image in which a synthesis image of handwritten characters "Love my friend" is arranged below and a heart-shaped synthesis image is arranged in the upper left. The synthesis image of handwritten characters is a pen image input by the user using a pen tool, and the heart-shaped synthesis image is a stamp image input by the user using a stamp tool. The transparency of the foreground image P6 is set to 100% in the area other than the area where the synthesis images are arranged.

[0093] The background composite image P5 and the foreground image P6 are composited by placing the layer of the foreground image P6 on the layer of the person image P3 that constitutes the background composite image P5. The edited image P7 is an image in which the background image P4 appears in the background of the user and the composite image appears in the foreground of the user. The foreground image P6 is appropriately configured as an image of multiple layers.

[0094] The foreground image P6 may be composed so that the compositing image input by doodling appears as the background of the person. In this case, a predetermined layer constituting the foreground image P6 is placed below the layer of the person image P3 and above the layer of the background image P4.

[0095] This processing is carried out based on each of the multiple original images P1 obtained by multiple shooting operations, and multiple edited images P7 are generated and printed on sticker sheets.

[0096] Note that Fig. 10 shows only the basic processing leading to the generation of edited image P7. Before the generation of edited image P7, image processing other than the processing shown in Fig. 10, such as retouching processing for adjusting the size of the user's face and eyes and adjusting the skin color and brightness, and makeup processing for adjusting the lip color and adding color to the cheeks, may be performed in response to user operations.

[0097] For example, retouching and makeup processing are performed in response to operations by a user in the editing space A2. If the image processing performed on a captured image in response to operations by a user in the editing space A2 is defined as editing processing, then the editing processing includes graffiti processing, retouching processing, and makeup processing.

[0098] An image generated by applying doodling processing, an image generated by applying retouching processing, and an image generated by applying makeup processing are all edited images.

[0099] On the other hand, images that have not been edited are photographed images. The original image P1, the trimmed image P2, the portrait image P3, and the background composite image P5 are all photographed images, as shown in FIG.

[0100] It is possible not only to add other processes to the process shown in FIG. 10, but also to appropriately change the order of the processes up to the generation of edited image P7.

[0101] For example, it is possible to select a background image in the editing space A2. In this case, the synthesis process of the background image is image processing applied to the captured image in response to an operation by a user in the editing space A2, and therefore is an editing process.

[0102] <Internal configuration of the photo sticker creation device> Fig. 11 is a block diagram showing an example of the configuration of the photo sticker creating device 1. In Fig. 11, the same components as those described above are given the same reference numerals, and duplicated explanations will be omitted as appropriate.

[0103] 11, the photo sticker creating device 1 is configured by connecting a pre-selection unit 302, a photographing unit 304, editing units 305A and 305B, and a printing unit 306 to a PC (Personal Computer) unit 301 via an external input / output interface 303. The PC unit 301, which is an information processing unit, is housed inside the housing of the editing unit 12, for example.

[0104] The PC section 301 includes a central processing unit (CPU) 311, a read only memory (ROM) 312, and a random access memory (RAM) 313, which are connected to each other via a bus 314.

[0105] The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating apparatus 1. The ROM 312 stores the programs and data executed by the CPU 311. The RAM 312 temporarily stores the data and programs processed by the CPU 311.

[0106] An input / output interface 315 is further connected to the bus 314. A storage unit 316, a communication unit 317, and a drive 318 are connected to the input / output interface 315.

[0107] The storage unit 316 is a non-volatile storage medium such as a hard disk, a flash memory, etc. The storage unit 316 stores various setting information and the like supplied from the CPU 311. The information stored in the storage unit 316 is read out by the CPU 311 as appropriate.

[0108] The communication unit 317 is an interface for a network such as the Internet. The communication unit 317 communicates with an external device under the control of the CPU 311. The communication unit 317 transmits an image selected by a user to, for example, an image acquisition site management server managed by the manufacturer of the photo sticker creating device 1. The image transmitted from the communication unit 317 is assigned a predetermined memory area and stored, and is displayed on or downloaded to a mobile terminal that has accessed the image acquisition site management server.

[0109] Removable media 319, such as an optical disk or semiconductor memory, is appropriately loaded into the drive 318. Programs and data read from the removable media 319 by the drive 318 are supplied to the CPU 311, and are stored in the storage unit 316 or installed.

[0110] An external input / output interface 303 is connected to the input / output interface 315. The PC unit 301 controls each unit via the external input / output interface 303.

[0111] The pre-selection unit 302 realizes a pre-selection process for users in the pre-selection space A0. The pre-selection unit 302 is composed of a touch panel monitor 71, a speaker 72, and a coin processing unit 321.

[0112] The touch panel monitor 71 displays various selection screens and accepts user operations on the selection screens under the control of the PC unit 301. An input signal representing the content of the user's operation is supplied to the PC unit 301, and various settings are made.

[0113] The coin processing unit 321 detects the insertion of coins into the coin insertion / return slot 73. When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, it outputs a start signal to the PC unit 301 to instruct the start of a game.

[0114] The image capturing unit 304 realizes image capturing processing for capturing an image of a user in the image capturing space A1. The image capturing unit 304 is composed of a lighting device 331, a camera 91, a touch panel monitor 92, and a speaker 332.

[0115] The lighting devices 331 are strobe units in the photographing space A1, and emit light in accordance with a lighting control signal supplied from the PC section 301.

[0116] The camera 91 captures images according to shutter control by the PC section 301 , and outputs the captured images to the PC section 301 .

[0117] Editing unit 305A realizes various processes such as editing processes targeted at users in editing space A2-1. Editing unit 305A is composed of tablet built-in monitor 131, touch pens 132A and 132B, and speaker 341. Editing unit 305B realizes processes targeted at users in editing space A2-2, and has the same configuration as editing unit 305A. In the following, when there is no need to distinguish between editing units 305A and 305B, they will simply be referred to as editing unit 305.

[0118] The tablet built-in monitor 131 displays an editing screen and accepts operations on the editing screen by the user under the control of the PC section 301. An input signal representing the content of the user's operation is supplied to the PC section 301, and the captured image is edited.

[0119] The printing section 306 is configured to include a printer 351. A sticker paper unit 352 is attached to the printer 351.

[0120] Printer 351 drives built-in head 361 and prints an image on rolled sticker paper 363 stored in sticker paper unit 352 based on print data supplied from PC section 301. Printer 351 also cuts sticker paper 363 with the image printed thereon at a predetermined cutting position with cutter 362 and discharges the sticker sheet to sticker paper outlet 161.

[0121] <Example of functional configuration of photo sticker creation device> Fig. 12 is a block diagram showing an example of a functional configuration of the photo sticker creating device 1. At least a part of the functional units shown in Fig. 12 is realized by the CPU 311 executing a predetermined program.

[0122] In the photo sticker creating device 1, a pre-selection processing section 401, a photography processing section 402, an editing processing section 403, and a printing processing section 404 are realized.

[0123] The pre-selection processing unit 401 executes pre-selection processing by controlling each unit of the pre-selection unit 302. The pre-selection processing selects the number of users, a background image, and the like. Information representing the selection made by the user is supplied to the photographing processing unit 402 .

[0124] The shooting processing unit 402 performs shooting processing by controlling each unit of the shooting unit 304. The shooting processing unit 402 outputs data of shot images obtained by performing the shooting processing to the editing processing unit 403. Data of multiple shot images obtained by performing shooting multiple times is supplied from the shooting processing unit 402 to the editing processing unit 403.

[0125] The editing processing unit 403 performs editing-related processes by controlling each unit of the editing unit 305. The editing-related processes are processes performed for a user who has moved to the editing space A2. In addition to the above-mentioned editing processes (image processes in response to operations by a user in the editing space A2, including retouching, doodling, and makeup), the editing-related processes include selection of the number of divisions, selection of images to be sent to a mobile terminal, generation of print data, and transmission of images to an image acquisition site management server. The editing processing unit 403 outputs print data generated by arranging the edited image in a predetermined layout to the print processing unit 404.

[0126] A print processing unit 404 outputs print data to the printer 351, and prints the edited image.

[0127] <Detailed configuration of the imaging processing section> FIG. 13 is a block diagram showing an example of the configuration of the image capture processing unit 402.

[0128] The photographing processing unit 402 is composed of a photographing control unit 411 , a person image generating unit 412 , and a display control unit 413 .

[0129] The photographing control unit 411 controls the camera 91 to photograph the user as a subject. The photographing control unit 411 outputs a moving image for a live view image captured by the camera 91 to the display control unit 413. In addition, the photographing control unit 411 outputs a still image photographed by the camera 91 to the person image generation unit 412 when the photographing timing for the photographed image arrives.

[0130] The shooting control unit 411 shoots still images six times, for example. The first to fifth shoots are close-up images, and the sixth shoot is, for example, a coordinated image. The close-up images and the coordinated images are shot with the lens of the camera 91 having the same focal length of, for example, 24 mm. By changing the trimming range, close-up images and coordinated images with different aspect ratios are generated.

[0131] FIG. 14 is a diagram showing an example of the generation of a close-up image and a coordinated image.

[0132] The image shown in Fig. 14 is an original image (still image) captured with a focal length of 24 mm. The rectangular area indicated by the dashed frame F1 is an area cut out by trimming when capturing a close-up image. The shooting control unit 411 cuts out the rectangular area indicated by the frame F1 by trimming, and generates a close-up image.

[0133] Moreover, the rectangular area indicated by the dashed-dotted line frame F2 is an area that is cut out by trimming when the coordinate image is photographed. The photographing control unit 411 cuts out the rectangular area indicated by the frame F2 by trimming, and generates the coordinate image.

[0134] The live view images before the close-up images and coordinate images are captured are also displayed using images obtained by cutting out the ranges indicated by frames F1 and F2 in FIG. 14 from each frame of the moving image captured by the camera 91.

[0135] It is possible to take a full-body image of the user. In this case, for example, the focal length of the lens of the camera 91 may be changed to 10 mm so that an image longer in height than a close-up image can be obtained.

[0136] The photography control unit 411 outputs the close-up image or coordinated image cut out by trimming to the portrait image generation unit 412.

[0137] The person image generation unit 412 performs chromakey processing on the trimmed image supplied from the shooting control unit 411, extracts the area in which the user is photographed, and generates a person image. The person image generation unit 412 composites the person image and the background image so that the background image can be seen behind the user, and outputs the background composite image to the display control unit 413. The person image generated by the person image generation unit 412 is supplied to the editing processing unit 403 together with the background image and the like.

[0138] The display control unit 413 controls the display of the touch panel monitor 92. For example, the display control unit 413 causes a screen of guidance regarding shooting to be displayed on the touch panel monitor 92. Furthermore, the display control unit 413 causes a live view screen to be displayed on the touch panel monitor 92 based on information supplied from the shooting control unit 411, and when shooting is performed, causes the shooting result to be displayed on the touch panel monitor 92. For example, a background composite image supplied from the person image generation unit 412 is displayed as the shooting result.

[0139] <Detailed configuration of the editing processing section> FIG. 15 is a block diagram showing an example of the configuration of the edit processing unit 403.

[0140] The edit processing unit 403 is made up of a captured image acquisition unit 431 , an edit control unit 432 , a display control unit 433 , a print data generation unit 434 , and a communication control unit 435 .

[0141] The captured image acquisition unit 431 acquires the captured image output from the shooting processing unit 402, and outputs it to the editing control unit 432. For example, a person image generated by chromakey processing is supplied as the captured image from the shooting processing unit 402. In addition, the captured image acquisition unit 431 acquires a background image selected by the user during advance selection processing, etc., and outputs it to the editing control unit 432.

[0142] The edit control unit 432 edits the photographed images in response to operations by the user to generate edited images. That is, the edit control unit 432 performs retouching processing on the five close-up images and one coordinated image of a person.

[0143] Furthermore, the editing control unit 432 generates an edited image by compositing a background image with a portrait image whose appearance has been adjusted by retouching, and by compositing a foreground image with a compositing image showing the content of a user's doodle. The editing control unit 432 outputs information showing the editing result to the display control unit 433, and causes the display to reflect the result on the editing screen.

[0144] The editing control unit 432 generates an image for portable transmission, which is a dedicated image to be sent to a portable terminal, in response to a user's operation as appropriate. The editing screen has buttons that are operated when creating an image for portable transmission. An image for portable transmission is generated by applying various image processes, including trimming and processing for compositing other images such as frame images, to a photographed image selected by the user. An image for portable transmission is transmitted to the user's portable terminal via the image acquisition site management server, and is not printed on a sticker sheet.

[0145] When editing is completed, edit control unit 432 outputs an edited image reflecting all editing processes in accordance with user operations, including doodling, and an edited image not reflecting some of the editing processes to print data generation unit 434. For example, an edited image reflecting retouching and makeup processes but not doodling is generated and output as an edited image not reflecting some of the editing processes.

[0146] Hereinafter, an edited image in which all the contents of the editing processes, including the doodling process, according to the operations of the user in the editing space A2 are reflected will be referred to as a doodling-reflected image, and an edited image in which the contents of the doodling process are not reflected will be referred to as a doodling-unreflected image.

[0147] Moreover, the edit control unit 432 outputs data of the edited image to the communication control unit 435. The edit control unit 432 also supplies the communication control unit 435 with an image for portable transmission.

[0148] The display control unit 433 controls the display of the tablet built-in monitor 131. For example, the display control unit 433 causes the tablet built-in monitor 131 to display an editing screen used for editing a captured image.

[0149] The print data generating unit 434 arranges the doodling reflected image supplied from the edit control unit 432 in a predetermined layout in the main area 181A, generates a bonus image using the doodling unreflected image, arranges it in the bonus area 181B, and generates print data. The print data generating unit 434 outputs the print data to the print processing unit 404, and causes it to be printed on a sticker sheet.

[0150] The communication control unit 435 controls the communication unit 317 to transmit the edited image and the image for mobile transmission supplied from the editing control unit 432 to the image acquisition site management server. Information indicating the layout of the edited image and the like is also transmitted to the image acquisition site management server as appropriate.

[0151] <Image printing example> FIG. 16 is a diagram showing an example of an image printed on a sticker sheet.

[0152] Fig. 16 shows an image similar to the image shown in Fig. 9. Although Fig. 9 does not show the composite image input by doodling, in reality, the image with the composite image input is also printed on the sticker sheet 181. Fig. 16 shows the image printed on the sticker sheet in more detail. Explanations that overlap with the above explanation will be omitted as appropriate.

[0153] 16, the doodling-reflected image 181A-1 is printed large on the left side of the main area 181A, and four doodling-reflected images 181A-2 to 181A-5 are printed to the right of it in a 2-row by 2-column arrangement. The doodling-reflected images 181A-2 to 181A-5 are printed in a size smaller than the doodling-reflected image 181A-1.

[0154] Background images expressing predetermined colors or patterns are arranged in the background of the people appearing in the graffiti-reflected images 181A-1 to 181A-5, and various images for synthesis such as pen images and stamp images are arranged in the foreground. The graffiti-reflected images 181A-1 to 181A-5 are images in which all editing processes, including the graffiti process, have been reflected.

[0155] On the other hand, five bonus images, 181B-1 to 181B-5, are printed side by side in the bonus area 181B. The bonus images 181B-1 to 181B-5 are vertically elongated rectangular (rectangular) images, unlike the bonus images shown in Fig. 9. The bonus images 181B-1 to 181B-5 are printed in a smaller size than the doodling reflected image 181A-2 and the like.

[0156] Bonus images 181B-1 to 181B-5 are printed using the graffiti-unreflected image generated by the editing control unit 432. That is, the same background images as those arranged in the graffiti-reflected images 181A-1 to 181A-5 are arranged in the backgrounds of the people appearing in bonus images 181B-1 to 181B-5, respectively, but no compositing image such as a pen image or stamp image is arranged in the foreground.

[0157] Edited images generated based on the same photographed image, in which all the contents of the editing process according to the user's operations are reflected, and edited images in which some of the contents of the editing process are not reflected, are printed together on one sticker sheet 181.

[0158] FIG. 17 is a diagram showing the doodling reflected image 181A-1 and the bonus image 181B-1 of FIG. 16 side by side.

[0159] As shown in Fig. 17, the doodling reflected image 181A-1 in the upper row and the bonus image 181B-1 in the lower row are both images generated based on the same close-up image. The same background image is placed behind the user, who is photographed in the same composition.

[0160] The eyes of the user in the graffiti-reflected image 181A-1 and the bonus image 181B-1 are larger than their actual size due to retouching, and the color of the lips, etc., is different from the actual color due to makeup.

[0161] In this way, the difference between doodling reflected image 181A-1 and bonus image 181B-1 is whether or not a synthesis image input by doodling processing is arranged.

[0162] Bonus images 181B-1 to 181B-5 are different from doodling-reflected images 181A-1 to 181A-5 only in that doodling processing has not been reflected and no composite image is arranged. As shown in Fig. 18, of the retouching processing, doodling processing, and makeup processing performed as image processing during editing processing, the edited image used to display the bonus image reflects the retouching processing and makeup processing, but does not reflect the doodling processing.

[0163] An edited image with graffiti is an image that is the result of having fun with graffiti, and is thought to be an image that users would like to keep because it allows them to check what kind of graffiti they have done.On the other hand, an edited image without graffiti is an image in which people stand out more than an edited image with graffiti, and is thought to be an image that users would like to keep because it allows them to check how they look in the image.

[0164] In this way, both the edited image with doodles and the edited image without doodles are left on one sticker sheet, so that the user can feel satisfied.

[0165] If too much graffiti is added (if too many composite images are placed), the face may not stand out. If only the edited images in which the face is not prominent were printed, the completeness of the sticker sheet would be reduced, but by printing the edited images without graffiti, it is possible to leave behind images in which the face stands out.

[0166] FIG. 19 is a diagram for explaining whether an edit process is reflected or not reflected.

[0167] In addition to generating an edited image by compositing layers of a foreground image as shown on the left side of Fig. 19A, an edited image without compositing layers of a foreground image as shown on the right side may be used as an image not reflecting graffiti to generate an image not reflecting graffiti. The heart-shaped image shown on the edited image on the left side of Fig. 19A is an image for compositing arranged by graffiti processing.

[0168] Also, as shown in FIG. 19B, after generating an edited image reflecting the graffiti processing, the layer of the foreground image may be deleted and the image to be synthesized may be erased to generate an image without the graffiti processing.

[0169] As shown in Fig. 19C, after generating an edited image reflecting the graffiti processing, the compositing image input by the user may be replaced with a different compositing image to generate an image without graffiti reflected. In the example of Fig. 19C, a heart-shaped compositing image is replaced with a star-shaped compositing image. It may be replaced with a heart-shaped compositing image of a different color. Replacing the compositing image includes not only replacement with an image of a different shape, but also replacement with an image of a different color.

[0170] In this way, not reflecting the doodle includes not only not outputting a compositing image onto the edited image, but also outputting a compositing image different from the compositing image placed by the user.

[0171] "Reflected" means that the contents of the editing process in response to the user's operation are output as is, whereas "not reflected" means that the contents of the editing process in response to the user's operation are not output as is.

[0172] FIG. 20 is a diagram showing another example of an image printed on a sticker sheet.

[0173] The sticker sheet 181 in FIG. 20 is a sticker sheet on which images of various shapes as described with reference to FIG. 9 are printed as bonus images in a bonus area 181B.

[0174] In the example of FIG. 20, bonus image 181B-11 is a rounded square image, and bonus image 181B-12 is a circular image. Bonus image 181B-13 is a rounded hexagonal image, and bonus image 181B-14 is a chrysanthemum flower-shaped image. Bonus image 181B-15 is a rounded square image like bonus image 181B-11. The shapes of the bonus images printed in the bonus area 181B may include the same shape, or may all be different shapes.

[0175] Hereinafter, the bonus images printed in the bonus area 181B in various shapes as shown in Fig. 20 will be referred to as "shape images" to mean images having various shapes. When selecting the number of divisions, you can select whether to print a vertically long rectangular bonus image like the edited image printed in the main area 181A, or to print a shape image.

[0176] For example, the user can select a shape image if the entire bonus area 181B is to be cut off and used as a single sticker with an elaborate design, or select a vertically long rectangular bonus image if each bonus image is to be cut off and used. The vertically long rectangular bonus images are arranged at equal intervals and of the same size, making it easy to cut them off with scissors.

[0177] Bonus images 181B-11 to 181B-15 in Fig. 20 are images generated based on the images not reflecting doodling. The same background images as those arranged in doodling-reflected images 181A-1 to 181A-5 are arranged in the backgrounds of the people in bonus images 181B-11 to 181B-15, respectively, but no various composite images such as pen images or stamp images are arranged in the foreground.

[0178] The shape image is generated, for example, by trimming a vertically long rectangular image without graffiti so as to cut out a square area centered around the face, and then overlaying a frame image of a specified shape on the square image cut out by trimming.

[0179] In this way, even when printing a shape image, the image without graffiti reflected is used. This also allows the user to receive a sticker sheet on which an edited image with doodles and an edited image without doodles are printed.

[0180] The shape image is an image in which a frame image of a predetermined shape is placed in the foreground, and is smaller than the edited image printed in the main area 181A, so even if the contents of the doodling process are reflected, the doodling that the user has worked so hard to input may not be visible. By generating the shape image using an image on which doodling is not reflected, it is possible to prevent an image in which the doodling is difficult to see from being printed.

[0181] <How the photo sticker creation device works> Now, with reference to the flow chart of FIG. 21, the operation of the photograph sticker creating device 1 that provides the photograph sticker creating game will be described.

[0182] In step S1, the pre-selection processing unit 401 determines whether or not a predetermined amount of coins has been inserted based on a start-up signal supplied from the coin processing unit 321, and waits until it is determined that coins have been inserted. If it is determined in step S1 that coins have been inserted, the process proceeds to step S2.

[0183] In step S2, the pre-selection processing unit 401 performs a pre-selection process by controlling the pre-selection unit 302. The pre-selection process includes, for example, selection of the number of users, selection of a background image to be composited with the captured image, etc. All of the selections are performed using a screen displayed on the touch panel monitor 71.

[0184] In step S3, the photographing processing unit 402 performs photographing processing by controlling the photographing unit 304. For example, the photographing processing unit 402 displays a live view screen on the touch panel monitor 92 based on the moving image captured by the camera 91, and photographs the user in the photographing space A1 as a subject. The photographing is repeated a predetermined number of times. Trimming and the like are performed on the original image, and for example, five close-up images and one coordinated image are generated.

[0185] In step S4, the editing processing unit 403 performs editing-related processing by controlling the editing unit 305 corresponding to the editing space A2-1 or A2-2, whichever is the destination of the user who has completed the shooting processing. Details of the editing-related processing will be described later with reference to the flowchart in FIG.

[0186] In step S5, the print processing unit 404 performs print processing by controlling the printer 351. The print processing unit 404 outputs the print data generated by the edit processing unit 403 as a result of the edit-related processing to the printer 351, and causes the printer 351 to print the print data on a sticker sheet.

[0187] When printing is completed, printer 351 discharges the sticker sheet on which the edited image is printed to sticker sheet outlet 161 in step S6.

[0188] A photo sticker creating game consisting of the above-mentioned series of processes is provided to each group of users of the photo sticker creating device 1. When a user of one group starts using the photo sticker creating device 1 followed by a user of another group, the photo sticker creating game of the user who started using the photo sticker creating device 1 first and the photo sticker creating game of the user who started using the device later are appropriately played in parallel. The photo sticker creating game is also appropriately referred to as simply a game.

[0189] <Editing-related processes> Next, the edit-related processing performed in step S4 in FIG. 21 will be described with reference to the flowchart in FIG.

[0190] After the explanatory screen for various editing functions is displayed, in step S31, the display control section 433 (FIG. 15) of the edit processing section 403 causes the tablet built-in monitor 131 to display an eye size / brightness selection screen.

[0191] The eye size / brightness selection screen is a screen used to select the eye size and skin brightness of the user that will appear in the captured image. For example, the eye size / brightness selection screen displays a button for selecting a specific eye size from five different eye sizes, and a button for selecting a specific skin brightness from five different skin brightnesses.

[0192] When the eye size and skin brightness are selected by pressing the buttons displayed on the eye size / brightness selection screen, the edit control unit 432 performs a retouching process in step S32.

[0193] For example, the editing control unit 432 sets a parameter that specifies the size of the eyes, and adjusts the size of the eyes of the user in each captured image to the size selected on the eye size / brightness selection screen. The eye size adjustment is performed, for example, by enlarging the area including the eyes in the person image.

[0194] In addition, the editing control unit 432 sets a parameter that specifies the brightness of the skin, and adjusts the brightness of the skin of the user appearing in each captured image to the selected brightness. The adjustment of the brightness of the skin is performed, for example, by extracting a skin-colored area from the person image and changing the pixel values ​​of the extracted area.

[0195] The photographed image that has been subjected to such retouching processing and has been combined with a background image is then subjected to other editing processing such as doodling.

[0196] In step S33, the display control unit 433 displays an editing screen on the tablet built-in monitor 131. On the editing screen, a captured image to be edited and buttons to be operated when selecting various doodling tools (images to be combined) such as a stamp image or a pen image are displayed.

[0197] FIG. 23 is a diagram showing an example of an editing screen displayed on the tablet built-in monitor 131. As shown in FIG.

[0198] The editing screen is basically configured by providing the main components symmetrically. The left half area is an area used by a user standing on the left side facing the tablet built-in monitor 131. The right half area is an area used by a user standing on the right side facing the tablet built-in monitor 131. This configuration of the editing screen allows two users to mainly perform editing work at the same time. Note that the dashed lines surrounding each area on the editing screen shown in FIG. 23 are not actually displayed on the screen.

[0199] A thumbnail display area 511L is provided in the upper center of the left half area of ​​the editing screen. The thumbnail display area 511L is a display area for thumbnail images that represent captured images. The thumbnail images are generated, for example, by reducing the size of each captured image (background composite image) that has been composited with a background image. The user selects a captured image to be edited by selecting a thumbnail image displayed in the thumbnail display area 511L.

[0200] In the example of FIG. 23, five thumbnail images P51 to P55 of close-up images and one thumbnail image P56 of a coordinated image are displayed side by side in the thumbnail display area 511L.

[0201] An editing area 512L is provided approximately in the center of the left half area. The editing area 512L is a display area for a captured image to be edited, selected using a thumbnail image. The user can select a doodling tool using the touch pen 132A and doodling on the captured image displayed in the editing area 512L.

[0202] Below the editing area 512L, an editing palette 513L, which is a horizontally long rectangular area, is displayed. The editing palette 513L is an area in which buttons used to select doodling tools are displayed. The doodling tools include, for example, a pen tool used to place a pen image and a stamp tool used to place a stamp image.

[0203] Five types of tabs used to select a category of doodling tools are displayed above the editing palette 513L. Six types of tabs used to select a type of doodling tool are displayed to the right of the editing palette 513L. The user can use these tabs to switch the type and category of doodling tools to be displayed in the editing palette 513L.

[0204] A makeup tool area 514L is displayed to the left of the editing area 512L. Buttons used to select the contents of makeup processing are displayed in the makeup tool area 514L. By pressing a button displayed in the makeup tool area 514L, makeup processing such as processing to adjust the color of the lips and cheeks to a predetermined color and processing to composite an image representing mascara onto the eyes is performed on the photographed image to be edited. Various facial features such as the lips, cheeks, and eyes that are subjected to image processing including color adjustment and image composition are recognized by the editing control unit 432 and subjected to specific image processing.

[0205] A correction tool selection area 515L is formed to the right of the editing area 512L. The correction tool selection area 515L is an area in which buttons used to select an eraser tool, a "back" button, a "forward" button, a "start from beginning" button, and the like are displayed vertically.

[0206] The eraser tool is a tool used when erasing an input image to be composited. The "Back" button and the "Forward" button are operated when going back one editing operation or going forward one operation, and the "Start from the beginning" button is operated when canceling all editing operations and returning to a state where no editing has been performed. In addition, the correction tool selection area 515L also displays a "Back 1 set" button. By pressing the "Back 1 set" button, all editing operations performed during a specified period of time can be erased at once.

[0207] To the right of the correction tool selection area 515L, a create button 516L is displayed, which is operated when creating an image for sending to a mobile phone. The characters "Mobile Phone Bonus" displayed on the edit screen in Fig. 23 represent an image for sending to a mobile phone. When the create button 516L is pressed, a creation screen for an image for sending to a mobile phone is displayed superimposed on the edit screen.

[0208] An end button 517L, which is operated when ending the editing process, is displayed above the correction tool selection area 515L.

[0209] The same configuration as the left half area described above is arranged symmetrically in the right half area used by a user on the right side of the tablet built-in monitor 131. Editing of captured images is performed using such an editing screen.

[0210] 22, the editing control unit 432 performs doodling processing in response to a user's operation, and applies doodling to the photographed image to be edited. That is, the editing control unit 432 generates a foreground image in which a synthesis image corresponding to the doodling tool selected by the user is placed at a predetermined position, and synthesizes the foreground image with the photographed image to be edited to generate an edited image (image reflecting doodling).

[0211] In step S35, the edit control unit 432 applies makeup processing, which is an edit process other than doodling, to the photographed image to be edited in response to a user's operation on a button in the makeup tool area 514L, and generates an edited image to which makeup processing has been applied.

[0212] In this example, the makeup process is an editing process that is performed only when the button in the makeup tool area 514L is operated. If the button in the makeup tool area 514L is not operated, the makeup process is not performed. As with the retouching process, the makeup process may be always performed.

[0213] In step S36, the editing control unit 432 generates an image not reflecting graffiti. That is, the editing control unit 432 generates an image not reflecting graffiti based on each captured image by reflecting the contents of the retouching process and the makeup process but not reflecting the contents of the graffiti process.

[0214] The image with and without doodling reflected, generated by the edit control unit 432, are supplied to a print data generation unit 434.

[0215] In step S37, the editing control unit 432 judges whether or not the editing has ended. If it is judged in step S37 that the editing has not ended, the process returns to step S34, and the above processes are repeated.

[0216] For example, if it is determined in step S37 that editing has ended because the end buttons 517L, 517R have been operated, then in step S38 the display control unit 433 displays a division number selection screen on the tablet built-in monitor 131. The division number selection screen is a screen used to select a sticker layout.

[0217] In step S39, print data generation unit 434 arranges the image with and without doodling reflected in a layout selected by the user, such as that described with reference to Fig. 16, and generates print data. The generated print data is supplied to print processing unit 404 and used for printing (step S5 in Fig. 21).

[0218] In step S40, the display control unit 433 displays a transmission image selection screen on the tablet built-in monitor 131. The edited images (five close-up images and one coordinated image) and the image for mobile transmission are transmitted to the image acquisition site management server.

[0219] To use the image acquisition site, users must register as members, and there are paid and free members. Paid members can download all images sent to the image acquisition site management server to their mobile terminals, whereas free members can download only one image to their mobile terminals. The transmission image selection screen is a screen used by free members to select images to download to their mobile terminals. Information on the image selected on the transmission image selection screen is supplied to communication control unit 435.

[0220] After the image to be sent to the mobile terminal is selected, an email address input screen is displayed on the tablet built-in monitor 131. The user operates the keyboard displayed on the input screen to input their email address. An email is sent from the image acquisition site management server to the email address input here, notifying the destination where the image will be saved. It is necessary to input the email address within a time limit.

[0221] In step S41, the communication control unit 435 transmits the edited image and the image for mobile transmission to the image acquisition site management server. The image acquisition site management server also transmits the device ID of the photo sticker creating device 1, the shooting date and time, information indicating which image was selected from the transmission image selection screen, and the like.

[0222] In step S42, the display control unit 433 guides the user who has finished the editing work to move to the print waiting space A3 by displaying a guidance screen on the tablet built-in monitor 131. The guidance to move to the print waiting space A3 is also given by outputting audio from the speaker 341. Then, the process returns to step S4 in FIG. 21, and the subsequent processes are carried out.

[0223] <Example of division number selection screen> FIG. 24 is a diagram showing an example of the division number selection screen.

[0224] A division number selection screen as shown in FIG. 24 is displayed on the tablet built-in monitor 131 after editing using the editing screen (step S38 in FIG. 22).

[0225] A message prompting the selection of the number of divisions (layout) is displayed at the top center of the division number selection screen, and below that, layout selection tabs 601 and 602 are displayed. Layout selection tabs 601 and 602 are tabs used to select the type of layout, and selecting either tab switches the display of the division number selection screen.

[0226] The layout selection tab 601 is a tab operated when selecting a "most recent layout" that is a layout with the bonus area 181B. The layout selection tab 602 is a tab operated when selecting an "other layout" that is a layout without the bonus area 181B.

[0227] In this example, two types of tabs are provided, but more tabs may be provided. In the example of Fig. 24, the layout selection tab 601 is selected.

[0228] A vertical dashed line is displayed between the left side area 601L and the right side area 601R, and a message indicating that one sticker sheet can be divided into two is displayed over the dashed line, along with an icon 603 representing this.

[0229] As shown on the left side of Figure 25, a vertically long rectangular sticker sheet 363-1 provided at the end of the game has a horizontal perforation, so that it can be separated into subdivision stickers 363-1A and 363-1B by tearing it along the perforation.

[0230] Depending on the layout selection, it is possible to print a set of a main area 181A and a bonus area 181B on each of the subdivision stickers 363-1A and 363-1B. The sticker sheet 181 in Fig. 9, Fig. 16, and Fig. 20 corresponds to one subdivision sticker separated by a perforation. The division number selection screen in Fig. 24 is a screen for selecting the layout of the image to be printed on each of the subdivision stickers 363-1A and 363-1B.

[0231] In one game of the photo sticker creation device 1, two sticker sheets that can be divided into subdivision stickers are printed and provided to the user. Note that there is a perforation between the subdivision sticker 363-1A and the subdivision sticker 363-1B, but there is no perforation between the main area 181A and the bonus area 181B. To separate the main area 181A and the bonus area 181B, it is necessary to cut them apart with scissors, as described above.

[0232] This means that if there are two users, each person can receive one sticker sheet.

[0233] Also, if there are three users, one person can receive one sticker sheet, and the other sticker sheet can be divided into small stickers, with two people receiving one each. If there are four users, two sticker sheets can be divided into small stickers, with four people receiving one each.

[0234] Returning to the explanation of Fig. 24, a sample image 611L is displayed in the upper center of the left side area 601L. The sample image 611L is an image that represents an image of a portion of the division label when each image is arranged in a layout selected by the user using the display below it. The user's selection is reflected in real time in the display of the sample image 611L.

[0235] The portion of sample image 611L corresponding to main region 181A may be displayed using a doodling reflected image, and the portion corresponding to bonus region 181B may be displayed using a doodling unreflected image.

[0236] Below sample image 611L, speech bubbles 612L and 613L are displayed.

[0237] Speech bubble 612L is an area used to select the layout of main area 181A, and in the example of Figure 24, selection image 621L that is operated when selecting a recommended division and selection image 622L that is operated when selecting a sub-division are displayed side by side vertically.

[0238] The selection image 621L is an image representing the main area 181A in which five types of images are arranged in a recommended division layout, and the selection image 622L is an image representing the main area 181A in which five types of images are arranged in a small division layout. The selection images 621L and 622L are displayed using, for example, a graffiti-reflected image.

[0239] The recommended division is a layout in which one large image is placed on the left side, and the remaining four images are arranged in two rows and two columns to the right of it, one in each location, as described with reference to Figure 9 etc.

[0240] Small division is a layout in which images of the same size are arranged in a row of three on the top row and four on the bottom row. In the layout of small division, five types of images and two types of images selected from them are arranged in multiple locations. In the example of Fig. 24, small division is selected, and the edge of the selected image 622L is highlighted.

[0241] Speech bubble 613L is an area used to select the layout of bonus area 181B, and by using the display of this area, it is possible to select either a layout in which shape images are arranged, or a layout in which vertically long rectangular bonus images are arranged.

[0242] In balloon 613L, selection image 631L to be operated when selecting a layout in which vertically long rectangular bonus images are arranged, and selection image 632L to be operated when selecting a layout in which shape images are arranged are displayed vertically.

[0243] The selected image 631L is an image representing the bonus area 181B in which a vertically long rectangular bonus image is arranged, and the selected image 632L is an image representing the bonus area 181B in which a shape image is arranged. The selected images 631L and 632L are displayed using, for example, an image not reflecting graffiti.

[0244] In the example of FIG. 24, a layout in which vertically long rectangular bonus images are arranged is selected, and the edge of selected image 631L is highlighted.

[0245] The display of speech bubble 612L is used to select small divisions as the layout of main area 181A, and the display of speech bubble 613L is used to select a layout of bonus area 181B in which vertically elongated rectangular bonus images are arranged, and sample image 611L is displayed as an image representing a combination of these.

[0246] On the other hand, a display similar to that in the left area 601L is prepared in the right area 601R.

[0247] 24, the display of balloon 612R is used to select a recommended division as the layout of main area 181A, and the display of balloon 613R is used to select a layout in which shape images are arranged as the layout of bonus area 181B. The display of sample image 611R is an image that represents the combination of them.

[0248] A user on the left side of the tablet built-in monitor 131 uses the display in the left area 601L to select the layout of the first sticker sheet, and a user on the right side uses the display in the right area 601R to select the layout of the second sticker sheet.

[0249] Below the left area 601L and the right area 601R, OK buttons 614L and 614R, which are operated when completing the selection of the layout, are displayed, respectively.

[0250] In this way, the user can select the layout of main area 181A and the layout of bonus area 181B on one screen in Fig. 24. If the layout of main area 181A and the layout of bonus area 181B were to be selected using different screens, it would be difficult to visualize the layout of one entire sticker sheet, but it becomes possible to select the layout of each of main area 181A and bonus area 181B while checking the layout of one entire sticker sheet.

[0251] In the above, it has been described that there is one type of shape combination of the shape image printed in the main area 181A, but it is also possible to prepare multiple types and allow the user to select a desired shape combination from among them.

[0252] FIG. 26 is a diagram showing an example of the division number selection screen displayed when other layouts are selected.

[0253] By selecting "other layout", it becomes possible to select a layout without the bonus area 181B. The display of the left area 602L will be mainly described below. The display of the right area 602R is basically the same as that of the left area 602L.

[0254] A sample image 641L is displayed on the right side of the left area 602L. The sample image 641L is an image that shows what a sticker sheet will look like when the images are arranged in a layout selected by the user using the display below it. The user's selection is reflected in real time in the display of the sample image 641L.

[0255] In this way, when the latest layout is selected, a sample image showing the image of one individual sticker is displayed, whereas when another layout is selected, a sample image showing the image of an entire sticker sheet is displayed.

[0256] A speech bubble 642L is displayed below the sample image 641L.

[0257] Speech bubble 642L is an area used to select the layout of one entire sticker sheet, and in the example of FIG. 26, selection images 651L to 654L each representing a different layout are displayed side by side.

[0258] Selection image 651L is an image that is operated when selecting a recommended division layout, and selection image 652L is an image that is operated when selecting a small division layout. Selection image 653L is an image that is operated when selecting a large division layout, and selection image 654L is an image that is operated when selecting an anniversary division layout.

[0259] The sample image 641L and the selected images 651L to 654L are displayed using the graffiti reflected image.

[0260] The recommended division in Figure 26 is a layout in which one large image is placed on the left side of each of the small division sticker sections, and the remaining four images are arranged in two rows and two columns to the right, one on each side.

[0261] Small division is a layout in which images of the same size are arranged in 3 rows and 5 columns across a single sticker sheet. The top, middle, and bottom rows contain the first to fifth images, respectively.

[0262] The large division is a layout in which two equal-sized images are arranged in two rows, one above the other, across a single sticker sheet. The top row has two images, and the bottom row has three images.

[0263] The anniversary division is a layout in which one large image is placed in the upper center of one sticker sheet, and the remaining four images are placed in small horizontal rows below it.

[0264] 26, recommended division is selected, and the edges of the selected image 651L are highlighted. Also, an image showing an image in which five types of images are arranged on the respective division stickers in the layout of recommended division is displayed as a sample image 641L.

[0265] In this way, by selecting "other layouts," the user can select a preferred layout from among the four layouts that do not include the bonus area 181B.

[0266] In particular, the recommended division layout prints the same image on each subdivision sticker when the product is divided into subdivision stickers, making it an easy-to-use layout when there are three or more users.

[0267] For example, if there are three users, two sticker sheets can be shared among the three by selecting recommended division in the left area 602L and selecting another layout in the right area 602R. Also, if there are four users, two sticker sheets can be separated into small stickers to be shared among the four by selecting recommended division in both the left area 602L and the right area 602R. The words "recommended for 3 to 4 people" are displayed above the selection image 651L that is operated when selecting the recommended division layout.

[0268] As described above, the user can select a layout for two people to share by using the left and right displays, and can also select a layout for one person by using the left and right displays. In other words, for up to four people, a layout that is easy to share can be selected with a high degree of freedom regardless of the number of people. By allowing the layout to be freely selected, it is possible to increase the satisfaction of the user.

[0269] <Example of sticker sheet> FIG. 27 is a diagram showing an example of a combination of two sticker sheets.

[0270] The sticker sheet 363-1 on the left side and the sticker sheet 363-2 on the right side are sticker sheets that can be obtained in one game. In the example of Fig. 27, it is assumed that the latest layout with the bonus area 181B is selected.

[0271] For example, as shown in sticker sheet 363-1 in FIG. 27, printing in the latest layout is performed in such a direction that bonus area 181B of division sticker 363-1A and bonus area 181B of division sticker 363-1B are adjacent to each other with a perforation in between.

[0272] In other words, based on the orientation in Figure 27, an image arranged in the latest layout selected using the division number selection screen is printed facing up on subdivision sticker 363-1A, and an image arranged in the latest layout selected using the division number selection screen is printed facing down on subdivision sticker 363-1B.

[0273] This makes it possible to prevent the main area 181A, which is the more important part of the sticker sheet 363-1, from being torn off when the sticker sheet is divided into small stickers, even if the perforations are made in a position that is different from the expected position. The user can obtain stickers of the main area 181A with a regular shape by further cutting the small sticker into the main area 181A and the extra area 181B. Although the perforations are made in advance, there is variation in the accuracy of the printing position of each image, and the perforations may be made in a position different from the expected position.

[0274] In addition, since the bonus images printed in the bonus area 181B are printed in a position close to the main area 181A, even if the perforations are placed in a position that is shifted from the expected position, it is possible to prevent the bonus images from being cut off when the stickers are divided into smaller portions.

[0275] 27, a shape image is printed in the bonus area 181B of subdivision sticker 363-1A and the bonus area 181B of subdivision sticker 363-1B, which are adjacent to each other across the perforation, respectively. Meanwhile, in sticker sheet 363-2, a shape image is printed in the bonus area 181B of subdivision sticker 363-2A, and a vertically long rectangular bonus image is printed in the bonus area 181B of subdivision sticker 363-2B.

[0276] In this way, a layout may be selected in which a shape image and a vertically long rectangular bonus image are printed in each of the two bonus areas 181B of one sticker sheet.

[0277] FIG. 28 shows an example of a combination of two sticker sheets when the "other" layout is selected.

[0278] 28, images arranged in a recommended division layout are printed on the division stickers 363-1A and 363-1B of sticker sheet 363-1, respectively, and images arranged in an anniversary division layout are printed on the entire sticker sheet 363-2.

[0279] By dividing sticker sheet 363-1 into subdivision stickers 363-1A and 363-1B, the size of sticker sheet 363-2 is different for the person who receives it, but when three people use photo sticker creation device 1, the sticker sheet can be easily divided. Printing in other layouts is performed by arranging images in the same orientation on subdivision stickers 363-1A and 363-1B.

[0280] The layouts that can be selected on the division number selection screen are not limited to those described above. It is possible to prepare various layouts that can be divided regardless of the number of users.

[0281] <Bonus image variation> FIG. 29 is a diagram showing another example of an image printed on a sticker sheet.

[0282] The sticker sheet 181 shown in Fig. 29 is a substantially square sticker sheet. A main area 181A is formed in substantially the upper half of the sticker sheet 181, and bonus areas 181B and 181C are formed below that. In this example, two areas are formed in which bonus images are printed. In the main area 181A, a graffiti-reflecting image is printed as described with reference to Fig. 16.

[0283] The bonus area 181B and the bonus area 181C are printed with five kinds of bonus images 181B-1 to 181B-5 and 181C-1 to 181C-5, each of which is composed of a circular frame image. The bonus images 181B-1 to 181B-5 printed in the bonus area 181B and the bonus images 181C-1 to 181C-5 printed in the bonus area 181C are the same images.

[0284] Of the circular frame images constituting bonus images 181B-1 to 181B-5, 181C-1 to 181C-5, the lower halves are positioned in the foreground of the person image, similar to the frame images of the shape images described with reference to Figure 20 etc., while the upper halves are positioned in the background of the person image.

[0285] In this way, a bonus image in which a person appears to pop out may be printed. The bonus image shown in Fig. 29 is disclosed in, for example, Japanese Patent Application No. 2016-103916 by the present applicant.

[0286] The bonus image in Fig. 29 is an image in which a frame image of a predetermined shape is placed in the foreground, similar to the shape image, and is smaller than the graffiti reflected image printed in the main area 181A, so even if the contents of the graffiti processing are reflected, the graffiti that the user has worked so hard to input will not be visible. The bonus image in Fig. 29 is also generated using the graffiti unreflected image.

[0287] FIG. 30 is a diagram showing an example of a division number selection screen used to select a layout as shown in FIG.

[0288] Layout selection tabs 701 to 705 are displayed above the division number selection screen. The layout selection tabs 701 to 705 are tabs used to select the type of layout, and the display of the division number selection screen is switched in response to selecting any one of the tabs.

[0289] In the example of FIG. 30, the layout selection tab 701 with the name "Pocket Puri" set is selected. The "Pocket Puri" layout is a layout with bonus areas 181B, 181C. "Pocket Puri" is a layout in which the size of the main area 181A for one person is finished to the size of a business card. By cutting off the main area 181A from the sticker paper printed in the "Pocket Puri" layout, it becomes possible to store it in a commercially available card file or the like. By being able to store the sticker paper in a neatly organized state, it is possible to suggest to the user the fun of "collecting stickers and looking back on them."

[0290] A speech bubble 711L is displayed at the upper center of the left side area 701L. The speech bubble 711L is an area used to select a design for the main area 181A. In the example of Fig. 30, selection images 721L to 724L representing four types of designs are displayed. The selection images 721L to 724L are displayed using, for example, graffiti-reflected images.

[0291] FIG. 31 is a diagram showing an example of the design of the main area 181A.

[0292] Each of the designs 751 to 754 has a plurality of rectangular areas for arranging the edited image, and the other areas are provided with a predetermined pattern and color. As shown in the rectangular areas, a background image is preset for each design.

[0293] 30 is an image operated when selecting design 751, and selected image 722L is an image operated when selecting design 752. Selected image 723L is an image operated when selecting design 753, and selected image 724L is an image operated when selecting design 754.

[0294] A speech bubble 712L is displayed below the speech bubble 711L in FIG.

[0295] The speech bubble 712L is an area used to select the layout of the bonus areas 181B and 181C. By using the display of the speech bubble 712L, it is possible to select either a layout in which bonus images in which people appear to pop out are arranged, or a layout in which vertically long rectangular bonus images are arranged, as described with reference to FIG.

[0296] In speech bubble 712L, selection image 731L that is operated when selecting a layout in which bonus images in which people appear to pop out are arranged, and selection image 732L that is operated when selecting a layout in which vertically long rectangular bonus images are arranged are displayed side by side.

[0297] A display similar to the display in the left area 601L as described above is also provided in the right area 601R.

[0298] Using such a division number selection screen, a layout such as that shown in FIG. 29 may be selected.

[0299] It should be noted that the other layouts selected using the layout selection tabs 702 to 705 are layouts that do not include the bonus areas 181B and 181C.

[0300] The graffiti-unapplied image used as the bonus image is an edited image that has undergone retouching and makeup processing, as described above. Since makeup processing is image processing applied to the face, leaving this image processing unapplied could reduce the completeness of the image.

[0301] When image processing is performed to add an image representing a shadow to a predetermined position, such as around a person, the contents of that image processing may be reflected in the image without graffiti.

[0302] Although images without graffiti applied are used to display the sample images and selected images on the division number selection screen, images without applying makeup processing or processing for adding shadows may also be used.

[0303] The background image of the bonus image may be a uniform background image different from the background image used for the graffiti reflected image printed in the main area 181A. By printing bonus images using background images of a uniform color side by side, the appearance of the bonus area can be improved. The color of the background image of the bonus image is set according to the design. By setting a color that matches the design as the color of the background image, it is possible to improve the completeness of the entire sticker sheet.

[0304] <<Example 2>> The following aspects can be adopted as the printing aspect on the sticker sheet, or as the display aspect of the sample image of the sticker sheet on the division number selection screen.

[0305] <Example 2-1> FIG. 32 is a diagram showing an example of an image printed on a sticker sheet.

[0306] 32 is a layout without a bonus image printing area. Images 801-1 to 801-6 are arranged on the division sticker 363-1A, and images 802-1 to 802-6 are arranged on the division sticker 363-1B.

[0307] Images 801-1 to 801-6 are images with graffiti reflected, and images 802-1 to 802-6 are images without graffiti reflected. Images 801-1 to 801-6 arranged on subdivision sticker 363-1A and images 802-1 to 802-6 arranged on subdivision sticker 363-1B are images generated based on the same six captured images.

[0308] In one sticker sheet 363-1, the portion of subdivision sticker 363-1A is the portion where the doodle is reflected, and the portion of subdivision sticker 363-1B is the portion where the doodle is not reflected.

[0309] In this way, the portion where the doodle is reflected and the portion where the doodle is not reflected may be made the same size, and the image where the doodle is reflected and the image where the doodle is not reflected may be printed in the same size. This makes it possible to provide a sticker sheet that allows easy comparison of an image with doodles and an image without doodles.

[0310] <Example 2-2> FIG. 33 is a diagram showing an example of an image printed on a sticker sheet.

[0311] The layout shown in Fig. 33 is a layout in which six edited images are printed in a 3 row x 2 column format with approximately the same size and horizontal length. Images 811-2 to 811-4 are images with graffiti reflected, generated based on close-up images. Images 811-5 and 811-6 are images with no graffiti reflected, generated based on coordinated images. Note that image 811-1 in the upper left is an image in which image 811-4 with no graffiti reflected has been subjected to filter processing to change the color.

[0312] In one sticker sheet 363-1, the portions of images 811-2 to 811-4 enclosed by dashed lines are portions where doodles are reflected, and the portions of images 811-1, 811-5, and 811-6 enclosed by dashed double-dashed lines are portions where doodles are not reflected.

[0313] In the above example, two edited images (one with graffiti reflected and one without graffiti reflected) are generated and printed based on each of the five captured images, but the number of captured images used to generate the two edited images can be arbitrary, such as printing only two edited images generated based on one captured image.

[0314] <Example 2-3> FIG. 34 is a diagram showing an example of an image selection screen.

[0315] The division number selection screen is provided with a layout in which one image is arranged large, such as an anniversary division. The image selection screen shown in Fig. 34 is a screen used to select an image to be arranged large, and is displayed on the tablet built-in monitor 131 in place of the screen shown in Fig. 24 when, for example, a layout in which one image is arranged large is selected.

[0316] The sample image 821 shown on the left is an image that shows what the sticker sheet will look like when the images are arranged in the anniversary division layout selected by the user. In the sample image 821, the large image 831-1 arranged in the center has graffiti on it, and the remaining four images 831-2 to 831-5 arranged below it have no graffiti on them.

[0317] A selection area 822 is formed to the right of the sample image 821. Thumbnail images of five captured images are displayed in the selection area 822, and an image to be arranged larger can be selected by pressing a thumbnail image.

[0318] When an image to be arranged large is selected using the display of the selection area 822, the display of the sample image 821 is also changed. In the sample image 821, the selected image is displayed large with graffiti applied, and the other four images are displayed small without graffiti applied.

[0319] When an image to be arranged large is selected, each edited image is printed in a layout in which the selected image is arranged large. In this way, only the image to be arranged large may be printed on the sticker sheet with doodles applied.

[0320] <Example 2-4> Contrary to the above embodiment 2-3, only one large image may be printed without doodles, and the remaining four images may be printed with doodles.

[0321] Fig. 35 is a diagram showing an example of an image selection screen. In the sample image 821 of Fig. 35, one selected image 831-1 is displayed large without any graffiti, and the other four images 831-2 to 831-5 are displayed small with graffiti.

[0322] Since the large images are printed without any doodles, it is possible to provide a sticker sheet that makes it easy to check how well people are portrayed.

[0323] <Example 2-5> When a layout in which images of different sizes are arranged is selected, images larger than a certain size may be printed with doodles applied (printed image with doodles applied), and images smaller than a certain size may be printed without doodles applied (printed image without doodles applied). The amount of doodles applied may be changed depending on the size of the image.

[0324] <Example 2-6> If a layout in which images of different sizes are arranged is selected, then, contrary to Examples 2-5 above, images smaller than a specified size may be printed with doodles, and images larger than a specified size may be printed without doodles.

[0325] <Example 2-7> FIG. 36 is a diagram showing an example of an image printed on a sticker sheet.

[0326] 36 is a layout in which six images 841-1 to 841-6 are printed in approximately the same size in a 2 row x 3 column layout. Images 841-2 to 841-4 are doodling-incorporated images generated based on close-up images, and images 841-5 and 841-6 are doodling-incorporated images generated based on coordinated images.

[0327] The image 841-1 in the upper left corner is an image in which the color has been changed by applying filter processing to an image 841-4 that has no graffiti. Images edited by applying filter processing look good in themselves, and it can be said that there is little need to apply graffiti to the images, so in this way, graffiti may be hidden.

[0328] <Example 2-8> Contrary to the above embodiment 2-7, image 841-1 obtained by performing filtering may be printed with scribbles applied, and other images may be printed with scribbles applied.

[0329] The image obtained by applying the filter processing has changed colors, and it can be said that it is an image in which it is difficult to confirm how well the person is photographed. In this way, for images in which it is difficult to confirm how well the person is photographed, it is acceptable to print the image with doodles added.

[0330] <Example 2-9> FIG. 37 is a diagram showing an example of an image printed on a sticker sheet.

[0331] The layout shown in Fig. 37 is a layout in which a collage image is printed. A collage image is an image that is constructed by arranging multiple images at predetermined positions on a template image with various designs.

[0332] In the example of Fig. 37, a collage image 852A is printed on roughly the upper half of the left division sticker 363-1A, and five unreflected images 851A are printed on the lower half. Collage image 852A is formed by arranging an image with graffiti reflected. A collage image 852B formed by arranging five unreflected images 851B and an image with graffiti reflected is also printed on the right division sticker 363-1B.

[0333] In this way, by generating a collage image using images with graffiti, the design quality of the collage image can be improved.

[0334] <Example 2-10> Contrary to the above-mentioned Example 2-9, the edited images constituting the collage image may be images without graffiti. Since the collage image is an image with a high design quality, it can be said that the image looks good even without using the graffitied images.

[0335] <Example 2-11> FIG. 38 is a diagram showing an example of an image printed on a sticker sheet.

[0336] Whether to reflect or not reflect graffiti may be selected depending on the angle of view, such that an image generated based on a close-up image is printed with graffiti added, and an image generated based on a coordinated image is printed without graffiti added.

[0337] The layout shown in Fig. 38 is the same as the layout described with reference to Fig. 33. Images 811-1 to 811-4 generated based on a close-up image are images that reflect graffiti, and images 811-5 and 811-6 generated based on a coordinated image are images that do not reflect graffiti.

[0338] When images with different angles of view, such as a close-up image and a coordinated image, are taken, the coordinated image is taken with the intention of recording the outfit, so graffiti may not be reflected.

[0339] <Example 2-12> Contrary to the above Example 2-11, as shown in FIG. 39, an image generated based on a close-up image may be printed without any doodles, and an image generated based on a coordinated image may be printed with doodles.

[0340] Since close-up images tend to show a large image of a face, by leaving the doodles unreflected, it is possible to provide a sticker sheet that allows the viewer to check how well the face looks in the image.

[0341] <Example 2-13> If the photo sticker creating device 1 has a function for selecting a specific image from images already taken and retaking the image when taking a picture, the image taken using the retaking function may be printed with doodles added, and an image obtained by normal photography rather than by retaking the image may be printed without doodles added.

[0342] Since images taken using the retake function are considered to have higher image value than images obtained by normal photography, it is possible to satisfy users by printing such images with graffiti added.

[0343] <Example 2-14> In contrast to the above embodiment 2-13, images captured using the retake function may be printed without graffiti, and images captured using normal photography may be printed with graffiti.

[0344] <Example 2-15> When a layout for printing a bonus image is prepared, the user may be allowed to select which image to print with doodles applied thereto, between a normal image that is not a bonus image and a bonus image.

[0345] Only one of the normal image and the bonus image may be selected to be printed with doodles applied, or both may be selected to be printed with doodles applied.

[0346] <<Example 3>> The following modes can be adopted for reflecting / not reflecting graffiti.

[0347] <Example 3-1> In the graffiti unreflected image, all compositing images input by the graffiti process are not reflected, but the compositing images to be reflected / not reflected may be selected according to the input position, such that compositing images input on or around the face are reflected and compositing images input in other positions are not reflected.

[0348] For example, if a doodling tool is provided that recognizes the position of the user's face in the captured image and inputs a cat ear-shaped image near the face as a compositing image, the cat ear-shaped compositing image input using the doodling tool may be reflected in the image without doodling reflected, while compositing images input in other positions may not be reflected.

[0349] <Example 3-2> Contrary to the above embodiment 3-1, it is also possible to leave the compositing image input to the face or the area around the face unreflected, and to reflect the compositing image input to other positions.

[0350] <Example 3-3> Images that have been processed by the above-mentioned filter processing may be printed in a state in which scribbles have been applied, and other images may be printed in a state in which scribbles have been applied.

[0351] <<Example 4>> The following modes can be adopted as the output mode of graffiti.

[0352] <Example 4-1> There are two output destinations for edited images: a sticker sheet and the screen of a mobile device. A user can view the edited image on the screen of the mobile device by operating the mobile device to access an image acquisition site. Depending on the output destination, it may be possible to switch between reflecting and not reflecting the doodles.

[0353] For example, an image printed on a sticker sheet with doodles reflected may be displayed on the screen of a mobile device without the doodles reflected, whereas an image printed on a sticker sheet without the doodles reflected may be displayed on the screen of a mobile device with the doodles reflected.

[0354] FIG. 40 is a diagram showing an example of a screen display of a mobile terminal.

[0355] 40, images 911-1 to 911-3 generated by using the photo sticker creating device 1 are displayed on a display 901 of a mobile terminal. Also, image 911-1 is displayed in a state where graffiti is not reflected, and images 911-2 and 911-3 are displayed in a state where graffiti is reflected.

[0356] That is, FIG. 40 shows an example in which image 911-1 is printed on a sticker sheet with the doodle reflected, and images 911-2 and 911-3 are printed on sticker sheets without the doodle reflected.

[0357] <Example 4-2> When the image acquisition site is accessed, the mobile terminal displays a plurality of thumbnail images representing the images uploaded from the photo sticker creation device 1. The above-mentioned various aspects of whether or not to reflect graffiti can be applied to the display of the thumbnail images.

[0358] When displaying a plurality of thumbnail images, thumbnail images showing images on which graffiti has not been reflected may be displayed more than thumbnail images showing images on which graffiti has been reflected.

[0359] By displaying many thumbnail images representing images without graffiti, it becomes easy to select an image without graffiti. A user can doodle on the selected image on the mobile device using an image processing application installed on the mobile device.

[0360] <Example 4-3> For example, if a total of six captured images are generated in one game, consisting of four close-up images and two coordinated images, four images may be printed on the sticker sheet with doodles added and the remaining two images may be printed without the doodles added, whereas on the screen of the mobile device three images may be displayed with doodles added and the remaining three images may be displayed without the doodles added.

[0361] <Example 4-4> FIG. 41 is a diagram showing another example of a screen display of a mobile terminal.

[0362] As shown in FIG. 41, when a thumbnail image displayed on the screen is pressed and the pressed image is enlarged, the thumbnail image may be displayed without the graffiti reflected, whereas the enlarged image may be displayed with the graffiti reflected.

[0363] The six thumbnail images shown on the left side of Fig. 41 are displayed using images without graffiti reflected. For example, when the thumbnail image on the top left is selected, an image with graffiti reflected is displayed on the screen, as shown by the arrow tip in Fig. 41.

[0364] When the thumbnail image is displayed, the image may be displayed with the graffiti reflected, whereas when the enlarged image is displayed, the image may be displayed without the graffiti reflected.

[0365] <<Other examples>> Although a doodling reflected image is printed in the main area 181A, and a bonus image in which only the doodling process among the editing processes is not reflected is printed in the bonus area 181B, an image in which editing processes other than the doodling process, such as a retouching process or a makeup process, are not reflected may be printed as a bonus image. In other words, the bonus image printed in the bonus area 181B can be a photographed image.

[0366] In this case, a plurality of doodling reflected images and the photographed images from which the doodling reflected images were generated are printed on one sticker sheet. The photographed images printed in the bonus area 181B as bonus images are images smaller in size than the doodling reflected images printed in the main area 181A, similar to the bonus images described with reference to FIG. 16, etc., and are images of vertically long rectangles or various shapes (shape images).

[0367] In addition, the edited image printed in the main area 181A is a graffiti-reflected image in which all the edit processing contents are reflected, but an image in which only the graffiti processing is not reflected among the edit processing may be printed. In other words, the edited image printed in the main area 181A can be an image in which graffiti is not reflected.

[0368] In this case, a single sticker sheet is printed with a mixture of a plurality of images not reflecting doodles and the photographed images that were the basis for generating the images not reflecting doodles.

[0369] It is also possible to print an image without doodling reflected in the bonus area 181B, and print an image with doodling reflected or a photographed image in the main area 181A.

[0370] In the above, two types of images, an image with graffiti reflected and an image with graffiti not reflected, an image with graffiti reflected and a photographed image, and an image with graffiti not reflected and a photographed image, are printed on one sticker sheet, but three types of images may also be printed.

[0371] For example, it is possible to print multiple graffiti-reflected images in the main area 181A, print multiple graffiti-unreflected images in one of the two bonus areas 181B, and print multiple photographed images in the other. It is possible to change which types of images are printed in which areas as needed.

[0372] Examples of image processing applied to a photographed image include background image synthesis, retouching, graffiti, makeup, etc., and the combination of which image processing contents are reflected and which are not reflected is arbitrary. In other words, as long as the edited image is generated based on the same photographed image, any combination of image processing may be applied to the edited image to be printed in the main area 181A and the bonus area 181B, respectively.

[0373] In the above, the image processing applied to the photographed image in response to the operation by the user in the editing space A2 is defined as the editing processing, and the editing processing includes, for example, graffiti processing, retouching processing, and makeup processing, but it is also possible to include other image processing applied to the photographed image in the editing processing. For example, if a so-called enhancement image processing in which a filter processing is applied to the photographed image to emphasize facial organs can be selected and performed on the editing screen, it is also possible to include the filter processing in the editing processing.

[0374] As described above, the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology. [Explanation of symbols]

[0375] 1 Photo sticker creation device, 91 camera, 92 touch panel monitor, 131 tablet built-in monitor, 402 photography processing section, 403 editing processing section, 411 photography control section, 431 photographed image acquisition section, 432 editing control section, 433 display control section, 434 print data generation section, 435 communication control section

Claims

1. an editing unit that performs a retouching process including a process of adjusting the size of the eyes, a makeup process including a process of adjusting the color of the lips, and a doodling process including a process of compositing an image to be composited in response to doodling by the user, on each captured image obtained by taking a plurality of images of the user as a subject, to generate a plurality of edited images; an output unit that outputs a plurality of first edited images, which are the edited images in which the contents of the retouching process, the makeup process, and the graffiti process are reflected and a plurality of second edited images, which are the edited images in which the contents of the retouching process and the makeup process are reflected but the contents of the graffiti process are not reflected, so as to be displayed simultaneously on the same screen, the first edited images being generated based on the respective captured images, and the second edited images being the edited images in which the contents of the retouching process and the makeup process are reflected but the contents of the graffiti process are not reflected; An image processing device comprising:

2. The editing unit performs a process of combining the image for synthesis, which includes handwritten characters and a stamp image input by the user, with the photographed image to be edited as the graffiti process. The image processing device according to claim 1 .

3. The editing department performs the makeup process, which includes adjusting the color of the cheeks as well as the color of the lips.

3. The image processing device according to claim 1 or 2.

4. The output unit transmits the first edited image and the second edited image to an external server for display on a screen of the mobile terminal of the user.

4. The image processing device according to claim 1.

5. The image processing device performing a retouching process including a process of adjusting the size of the eyes, a makeup process including a process of adjusting the color of the lips, and a doodling process including a process of compositing an image to be used for composition in response to doodling performed by the user, on each of the photographed images obtained by photographing the user a plurality of times, thereby generating a plurality of edited images; A plurality of first edited images, which are the edited images in which the contents of the retouching process, the makeup process, and the graffiti process are reflected and a plurality of second edited images, which are the edited images in which the contents of the retouching process and the makeup process are reflected but the contents of the graffiti process are not reflected, are output so as to be displayed simultaneously on the same screen. Image processing methods.

6. On the computer, performing a retouching process including a process of adjusting the size of the eyes, a makeup process including a process of adjusting the color of the lips, and a doodling process including a process of compositing an image to be used for composition in response to doodling performed by the user, on each of the photographed images obtained by photographing the user a plurality of times, thereby generating a plurality of edited images; A plurality of first edited images, which are the edited images in which the contents of the retouching process, the makeup process, and the graffiti process are reflected and a plurality of second edited images, which are the edited images in which the contents of the retouching process and the makeup process are reflected but the contents of the graffiti process are not reflected, are output so as to be displayed simultaneously on the same screen. A program that executes a process.

Images