Image processing device, image processing method, and program

Abstract

To provide an image processing apparatus which can be applied to a photo generating game machine for providing a series of games printing a captured image on a seal paper and which can more naturally changes impression of eyes.SOLUTION: An image processing apparatus (photo seal creating apparatus has an edition processing unit 403 which has an iris processing unit 433A that detects an iris of a person in a captured image and can further change thickness of an edge of the iris in response to an operation by a user. The iris processing unit 433A can further change color of the iris.SELECTED DRAWING: Figure 19

Description

[Technical field]

[0001] In particular, the present technology relates to an image processing device, an image processing method, and a program that are capable of changing the impression of the eyes in a more natural manner. [Background technology]

[0002] Conventionally, photo sticker creation devices are known. The photo sticker creation devices take a picture of a user, allow the user to edit the photographed image, and print the edited image on sticker paper for provision. The photo sticker creation devices are installed in amusement facilities and the like.

[0003] The flow of one game provided by the photo sticker creation device is usually to take a photo of the user in the shooting space as the subject, then move the user to the editing space, edit the image according to the operations performed in the editing space, and print the edited image on sticker paper. When taking a photo in the shooting space, a strobe light is irradiated to capture a catch light in the pupil of the user's eye, and the photo is taken.

[0004] For example, Patent Document 1 discloses a technique in which the pupil of a user's eye shown in a captured image is filled with a predetermined color, and an image expressing a catch light is drawn in the pupil where the color has been changed. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2014-182672 A [Patent Document 2] JP 2013-055372 A Summary of the Invention [Problem to be solved by the invention]

[0006] When the color of the pupil is changed by image processing to change the impression of the eyes, the pupil may look unnatural after the change.

[0007] The present technology has been developed in light of these circumstances, and makes it possible to change the impression of the eyes in a more natural way. [Means for solving the problem]

[0008] The image processing device according to one aspect of the present technology includes a detection unit that detects the black eye of a person appearing in a captured image, and a different The camera is provided with an image processing section for changing the color of the iris and the density of the iris edge in response to an operation.

[0009] In one aspect of the present technology, the black eyes of a person appearing in a photographed image are detected, and the black eyes are displayed according to the user's different Depending on the operation, the color of the pupil and the darkness of the iris rim are changed. Effect of the Invention

[0010] According to this technology, it is possible to change the impression of the eyes in a more natural way. [Brief description of the drawings]

[0011] [Figure 1] 1 is a perspective view showing an example of the external configuration of a photo sticker creation device according to the present technology; [Diagram 2] FIG. 2 is a perspective view of the photo sticker creating device as seen from another angle. [Diagram 3] FIG. 1 is a diagram illustrating the movement of a user. [Figure 4] FIG. 13 illustrates an example of the configuration of a pre-selection unit; [Diagram 5] FIG. 2 is a perspective view showing an example of the configuration of an imaging unit. [Figure 6] FIG. 2 is a perspective view showing an example of the configuration of an imaging unit. [Figure 7] FIG. 11 is a diagram showing an example of camera angle adjustment. [Figure 8] FIG. 4 is a diagram illustrating an example of the configuration of a background part. [Figure 9] FIG. 2 is a diagram illustrating an example of the configuration of an operation unit. [Figure 10] FIG. 2 is a diagram showing an example of the configuration of the front side of an editing unit. [Figure 11] FIG. 13 is a diagram showing an example of how curtains are attached. [Figure 12] FIG. 13 is a diagram showing an example of a design for the back side of a curtain. [Figure 13] 11A and 11B are diagrams illustrating examples of use of a mirror surface portion. [Figure 14] FIG. 2 is a diagram showing an example of the configuration of a side surface of an editing unit. [Figure 15] FIG. 13 is a diagram illustrating an example of a layer structure of an edited image. [Figure 16] 1 is a block diagram showing an example of the configuration of a photo sticker creating device; [Figure 17] 2 is a block diagram showing an example of a functional configuration of the photo sticker creating device; [Figure 18] 18 is a block diagram showing an example of the configuration of an image capture processing unit in FIG. 17. [Figure 19] 18 is a block diagram showing an example of the configuration of an edit processing unit in FIG. 17. [Figure 20] 20 is a block diagram showing an example of the configuration of an editing image generating unit in FIG. 19. [Figure 21] FIG. 13 is a diagram illustrating an example of region detection. [Figure 22] 21 is a block diagram showing an example of the configuration of an eyelash processing unit in FIG. 20. [Figure 23] FIG. 13 shows an example of removing inverted eyelashes. [Figure 24] 11A and 11B are diagrams illustrating examples of deformation of an eyelash image. [Diagram 25] FIG. 13 is a diagram showing an example of combining eyelash images. [Figure 26] 10 is a flowchart illustrating an operation of the photo sticker creating device. [Figure 27] 27 is a flowchart illustrating the editing process performed in step S3 of FIG. 26. [Figure 28] FIG. 13 is a diagram showing a display example of a guide screen for taking a selfie before graffiti. [Figure 29] FIG. 13 is a diagram illustrating an example of an editing screen. [Diagram 30] 28 is a flowchart illustrating an editing image generating process performed in step S42 of FIG. 27. [Diagram 31] 31 is a flowchart illustrating the eyelash processing performed in step S64 of FIG. 30. [Diagram 32] FIG. 13 is an enlarged view of an editing palette in which a makeup tool is selected; [Diagram 33] FIG. 13 is a diagram showing an example of an image generated by the eye color tool. [Diagram 34] 13A and 13B are diagrams illustrating examples of mask images used in image processing when an eye color tool is selected. [Diagram 35] FIG. 13 is a diagram showing an example of changing the color of the iris area. [Diagram 36] FIG. 13 is a diagram showing an example of adjusting the darkness of the eye contour. [Figure 37] 13A to 13C are diagrams illustrating another example of adjustment of the darkness of the eye contour. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] <Exterior of the photo sticker creation device> 1 and 2 are perspective views showing an example of the external configuration of a photo sticker creating device 1. FIG.

[0013] The photo sticker creation device 1 is a game machine that provides captured images and edited images. The photo sticker creation device 1 provides images to users by printing the images on sticker paper or making the images viewable on the user's mobile terminal. The photo sticker creation device 1 is installed in amusement facilities such as game arcades and in stores.

[0014] Users of the photo sticker creation device 1 are mainly high school girls and young women. In the photo sticker creation device 1, multiple users, usually two or three people per group, can enjoy the game. Of course, in the photo sticker creation device 1, a single user can also enjoy the game.

[0015] In the photo sticker creation device 1, the user takes a photo of himself / herself as the subject. Through editing, the user selects an image from the photographed images and combines it with a composite image such as handwritten characters or a stamp image. This edits the photographed image into a colorful image. The user receives a sticker paper on which the edited image, which is the edited image, is printed, and the series of games is completed.

[0016] The photo sticker creating device 1 can be said to be a photo creating game machine that provides a photo creating game.

[0017] 1, the photo sticker creating device 1 is basically configured by installing a photographing unit 11 and an editing unit 12 in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected to each other.

[0018] The photographing unit 11 has a box-shaped housing large enough for a person to enter, and is composed of a pre-selection section 20, a photographing section 21, and a background section 22. The pre-selection section 20 is installed on the side of the photographing section 21. The space in front of the pre-selection section 20 becomes a pre-selection space where pre-selection processing is performed. In addition, the photographing section 21 and the background section 22 are installed a predetermined distance apart. The space formed between the photographing section 21 and the background section 22 becomes a photographing space where photographing processing is performed.

[0019] As a pre-selection process, the pre-selection unit 20 performs guidance to introduce the game provided by the photo sticker creating device 1 and performs various settings for the photographing process performed in the photographing space. The pre-selection unit 20 is provided with a coin slot through which the user inserts payment, a touch panel monitor used for various operations, and the like. The pre-selection unit 20 guides the user in the pre-selected space to the photographing space according to the availability of the photographing space.

[0020] The photographing unit 21 is a device for photographing a user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the photographing unit 21 facing the photographing space.

[0021] If the left side as viewed from a user facing forward in the photographing space is the left side and the right side is the right side, then the left side of the photographing unit 21 is formed by side panel 41A, and the right side is formed by side panel 41B. Furthermore, the front of the photographing unit 21 is formed by front panel 42. The above-mentioned pre-selection unit 20 is installed on side panel 41A. Note that the pre-selection unit 20 may also be installed on side panel 41B.

[0022] Background section 22 is composed of rear panel 51, side panel 52A, and a side panel. Rear panel 51 is a plate-like member located behind a user facing forward. Side panel 52A is attached to the left end of rear panel 51 and is a plate-like member narrower in width than side panel 41A. Side panel 52B is attached to the right end of rear panel 51 and is a plate-like member narrower in width than side panel 41B.

[0023] The side panels 41A and 52A are provided on approximately the same plane. The upper parts of the side panels 41A and 52A are connected by a connecting portion 23A, which is a plate-shaped member. The lower parts of the side panels 41A and 52A are connected by a connecting portion 23A', which is, for example, a metal member provided on the floor surface. The side panels 41B and 52B are similarly provided on approximately the same plane. The upper parts of the side panels 41B and 52B are connected by a connecting portion 23B. The lower parts of the side panels 41B and 52B are connected by a connecting portion 23B'.

[0024] The side panel 41A and the side panel 52A are members that surround the left side of the photography space, and the side panel 41B and the side panel 52B are members that surround the right side of the photography space.

[0025] A floor material 27, which is a plate-like member, is laid on the floor of the imaging space.

[0026] An opening formed by being surrounded by side panel 41A, connecting portion 23A, and side panel 52A serves as an entrance to the photography space. In addition, an opening formed by being surrounded by side panel 41B, connecting portion 23B, and side panel 52B also serves as an entrance to the photography space.

[0027] A ceiling sheet 24 made of a vinyl material or a plate-like member is provided on part of the ceiling of the photography space.

[0028] The editing unit 12 is a device for editing the captured image. The editing unit 12 is provided connected to the photographing unit 11 such that one side surface of the editing unit 12 is in contact with the front panel 42 of the photographing section 21.

[0029] 2 is the configuration on the front side of the editing unit 12, components used for editing work are provided on both the front side and the rear side of the editing unit 12. With this configuration, two groups of users can perform editing work simultaneously.

[0030] The front side of the editing unit 12 is composed of a vertical surface 61 and an inclined surface 62 formed above the surface 61. A tablet built-in monitor and a touch pen are provided on the inclined surface 62 as components used for editing work. A columnar support 63A that supports one end of the lighting device 64 is provided on the right side of the inclined surface 62. A columnar support 63B that supports the other end of the lighting device 64 is provided on the left side of the inclined surface 62. A support 65 that supports the curtain rail 26 is provided on the upper surface of the support 63A.

[0031] A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C.

[0032] The three rails 26A to 26C are combined so that the shape when viewed from above is U-shaped. One ends of rails 26A and 26B, which are provided in parallel, are fixed to connecting portions 23A and 23B, respectively, and the other ends of rails 26A and 26B are fixed to both ends of rail 26C, respectively.

[0033] Curtains are attached to the curtain rail 26 to block the view from outside into the space in front of the front and the space in front of the rear of the editing unit 12. The space in front of the front and the space in front of the rear of the editing unit 12, surrounded by the curtains attached to the curtain rail 26, become the editing space where the user performs editing work.

[0034] The editing unit 12 has a side surface provided with an outlet through which the printed sticker paper is discharged. The space on the front side of the editing unit 12 serves as a print waiting space where the user waits for the printed sticker paper to be discharged.

[0035] <About user movement> Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described.

[0036] FIG. 3 is a plan view of the photo sticker creating device 1 seen from above.

[0037] The user inserts coins into a coin slot in the pre-selection space A0, which is the space in front of the pre-selection unit 20. Next, the user performs a pre-selection task according to the screen displayed on the touch panel monitor. For example, the user performs the pre-selection task by selecting a course for photography to be performed in the photography space.

[0038] After completing the pre-selection task, the user enters the photographing space A1 formed between the photographing unit 21 and the background unit 22 from the doorway G1 between the side panel 41A and the side panel 52A, as indicated by the outlined arrow #1. The user performs photographing work using the camera and touch panel monitor provided in the photographing unit 21.

[0039] After completing the photography work, the user either exits the photography space A1 through the entrance G1 as shown by the white arrow #2 and moves to the editing space A2-2, or exits the photography space A1 through the entrance G2 as shown by the white arrow #3 and moves to the editing space A2-1.

[0040] The editing space A2-1 is an editing space on the front side of the editing unit 12. On the other hand, the editing space A2-2 is an editing space on the rear side of the editing unit 12. The user is guided as to which of the editing space A2-1 and the editing space A2-2 to move to by, for example, a screen display on the touch panel monitor of the imaging unit 21. For example, the more empty of the two editing spaces is guided as the destination.

[0041] The user who moves to the editing space A2-1 or A2-2 starts editing work. A user of the editing space A2-1 and a user of the editing space A2-2 can simultaneously perform editing work. When there is no need to distinguish between the editing space A2-1 and the editing space A2-2, they will be collectively referred to as the editing space A2 as appropriate.

[0042] After the editing work is completed, printing of the edited image begins. A user who has finished editing work in the editing space A2-1 moves from the editing space A2-1 to the print waiting space A3 as shown by the outlined arrow #5. A user who has finished editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as shown by the outlined arrow #4.

[0043] The user moves to the print waiting area A3 and waits for the printing to finish. When the printing is finished, the user receives the sticker paper that was discharged from the outlet provided on the side of the editing unit 12, and the series of photo sticker creation games is completed.

[0044] Next, the configuration of each device will be described.

[0045] <Configuration of pre-selection part> FIG. 4 is a diagram showing an example of the configuration of the pre-selection unit 20. As shown in FIG.

[0046] A touch panel monitor 71 is provided above the pre-selection unit 20. The touch panel monitor 71 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and accepting selection operations by the user. The touch panel monitor 71 displays a screen used to select the number of users, etc.

[0047] A speaker 72 is provided below the touch panel monitor 71. The speaker 72 outputs voice guidance for the pre-selection process, background music (BGM), sound effects, etc. A coin insertion / return slot 73 into which a user inserts coins is provided next to the speaker 72.

[0048] <Composition of the shooting team> 5 and 6 are perspective views showing examples of the configuration of the imaging unit 21. FIG.

[0049] The imaging section 21 is configured to be surrounded by a side panel 41A, a side panel 41B, and a front panel .

[0050] A box-shaped camera unit 81 is provided approximately in the center of the front panel 42. A camera 91 and a touch panel monitor 92 are provided in front of the camera unit 81. To the right of the camera 91, a smartphone holder 93 is provided.

[0051] The camera 91 is, for example, a single-lens reflex camera, and is attached inside the camera unit 81 so that the lens is exposed. The camera 91 has an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The camera 91 functions as an imaging unit that captures images of users in the imaging space A1 as subjects.

[0052] Furthermore, the camera 91 has a vertical swivel function (angle adjustment function).

[0053] FIG. 7 is a diagram showing an example of angle adjustment of the camera 91. In FIG.

[0054] As shown in Fig. 7, the direction of the optical axis of camera 91 can be adjusted in the vertical direction by changing the position inside camera unit 81. In Fig. 7, the dashed arrow indicates the direction of the optical axis of the lens.

[0055] As shown in Figures 7A to 7C, for example, the angle of the camera 91 can be adjusted within a range from an upper limit of a direction approximately horizontal to the ground surface of the photo sticker creation device 1 to a specified downward angle as the lower limit.

[0056] Such adjustment of the angle of the camera 91 is performed electrically in accordance with the operation of the user who is taking pictures, as described later. The user can adjust the angle of the camera 91 to a desired angle and take pictures.

[0057] A live view image generated based on the moving images captured by the camera 91 is displayed on the touch panel monitor 92. A still image captured by the camera 91 at a predetermined timing is stored as a captured image.

[0058] The touch panel monitor 92 is provided below the camera 91. The touch panel monitor 92 is composed of a monitor such as an LCD and a touch panel laminated on it. The touch panel monitor 92 has a function as a live view monitor that displays a live view image captured by the camera 91, and a function of displaying various GUIs and accepting selection operations by the user.

[0059] A smartphone holder 93 for placing a smartphone is provided to the right of the camera 91. The smartphone holder 93 is formed to be long enough to place a smartphone in landscape orientation.

[0060] A user can place his or her smartphone in smartphone holder 93 and use the smartphone to capture moving images or still images of himself or herself playing the game.

[0061] Above the camera unit 81, an upper strobe unit 82 is installed offset to the left with respect to the position of the camera unit 81 (the position of the camera 91). The upper strobe unit 82 is provided so as to cover almost the entire upper part and upper left part of the camera unit 81.

[0062] The front of upper strobe unit 82 is composed of a panel that is tilted forward so as to face diagonally downward, and a panel that is provided below that and forms a substantially vertical surface. The front of upper strobe unit 82 is composed as a light-emitting surface using a translucent milky white plate-like member. Upper strobe unit 82 emits light in accordance with shooting by camera 91, and irradiates strobe light mainly onto the user's face and upper body from the upper left in front of the user.

[0063] Below the camera unit 81, a foot strobe unit 83 is provided for irradiating strobe light mainly onto the lower body and feet of the user.

[0064] The foot strobe unit 83 is formed between the side panels 41A and 41B without any gaps so that the entire front surface, which is a horizontally long rectangle when viewed from the front, becomes the light emitting surface. The upper surface of the foot strobe unit 83 is a surface that is approximately horizontal to the installation surface of the photo sticker creation device 1, and is used as a luggage storage area for the user who is taking pictures to place his / her baggage.

[0065] A constantly lit light bulb and a strobe light tube are provided inside upper strobe unit 82 and foot strobe unit 83. Upper strobe unit 82 and foot strobe unit 83 constantly illuminate the shooting space by illuminating the light bulb, and irradiate the user who is the subject with strobe light by illuminating the strobe light tube in accordance with the shooting timing.

[0066] A speaker is provided near the ceiling of the front panel 42. Voice guidance for the shooting process, background music, sound effects, etc. are output from the speaker. The speaker may be provided in the background section 22.

[0067] FIG. 8 is a diagram showing an example of the configuration of the background portion 22 on the side of the shooting space A1.

[0068] A sheet of a predetermined color, such as green, is attached to the inside of rear panel 51. Chromakey processing is performed by detecting green areas in the captured image, and human areas are detected.

[0069] An operation unit 53 is provided on the inside of a side panel 52B attached to the left end of the rear panel 51.

[0070] As shown in FIG. 9, operation unit 53 is made up of angle adjustment button 53A that is pressed to adjust the orientation of camera 91 upward or downward, and shooting stop button 53B that is pressed to stop shooting.

[0071] Camera 91 takes pictures continuously at a predetermined interval, such as every 10 seconds. Stop shooting button 53B is pressed to temporarily stop the continuous shooting. With the continuous shooting temporarily stopped, the user can adjust the angle of camera 91 by pressing angle adjustment button 53A.

[0072] Since operation unit 53 is provided on side panel 52B, the user who is facing camera 91 unconsciously stands slightly to the right in shooting space A1. By ensuring a certain distance from upper strobe unit 82, which is provided on the front left side diagonally opposite operation unit 53 in shooting space A1, to the standing position, it becomes possible for upper strobe unit 82 to irradiate the user with an appropriate amount of light.

[0073] The operation unit 53 provided on the side panel 52B also has the function of unconsciously guiding the user to a proper standing position. The operation unit 53 may be provided on the side panel 52A.

[0074] <Editing unit composition> 10 is a diagram showing an example of the configuration of the front side (the editing space A2-1 side in FIG. 3) of the editing unit 12. A similar configuration is also provided on the rear side (the editing space A2-2 side in FIG. 3).

[0075] A tablet built-in monitor 131 is provided approximately in the center of the inclined surface 62. A touch pen 132A is provided on the left side of the tablet built-in monitor 131. A touch pen 132B is provided on the right side of the tablet built-in monitor 131.

[0076] For example, an editing screen used for editing work is displayed on the tablet built-in monitor 131. When two users perform editing work at the same time, the touch pen 132A is used by the user on the left side as viewed from the tablet built-in monitor 131, and the touch pen 132B is used by the user on the right side as viewed from the tablet built-in monitor 131.

[0077] Note that operations using touch pen 132A and operations using touch pen 132B are distinguished. As appropriate, only operations using touch pen 132A are possible for the display on the left side of tablet built-in monitor 131, and only operations using touch pen 132B are possible for the display on the right side. Hereinafter, when there is no need to distinguish between touch pen 132A and touch pen 132B, they will be collectively referred to as touch pen 132.

[0078] A mirror surface portion 66 made of an acrylic mirror plate or the like is provided below the lighting device 64 and between columnar supporting portions 63A and 63B that support the lighting device 64. The mirror surface portion 66 forms a substantially vertical surface.

[0079] 10, the range of the mirror surface portion 66 that will become the mirror surface is shown in color. The horizontal width of the mirror surface portion 66 is wider than the horizontal width of the tablet built-in monitor 131. The interior of the editing space A2-1, including the vicinity of the face of the user in the editing space A2-1, is reflected in the mirror surface portion 66.

[0080] FIG. 11 is a diagram showing an example of how curtains are attached.

[0081] As shown in Fig. 11, a curtain is attached to the curtain rail 26 above the editing unit 12 to block the editing space A2 from being seen from the outside. In the example of Fig. 11, a curtain 111 is attached to the rail 26C, and a curtain 112 is attached to the rail 26B on the front side of the editing unit 12. A curtain similar to the curtain 112 is also attached to the rail 26A on the rear side of the editing unit 12.

[0082] The vinyl curtains 111 and 112 are provided with a predetermined design on their surfaces so that the photo sticker creating device 1 stands out. Of the curtains 111 and 112, at least the curtain 112 is provided with a predetermined design not only on its surface but also on its back surface (the surface facing the editing space A2-1).

[0083] FIG. 12 is a diagram showing an example of a design for the back side of the curtain 112. As shown in FIG.

[0084] As shown in FIG. 12, the back side of the curtain 112 is designed by printing characters or letters.

[0085] In the example of Fig. 12, the design is made up of an illustration of a bird character and an illustration of a flower. The word "Happy!" surrounded by flowers is printed in a mirror-inverted state on the top of the curtain 112. The design of the back side of the curtain 112 is arbitrary, and may be printed with other illustrations or photographs of landscapes or people.

[0086] A user in the editing space A2-1 stands with his or her back to the curtain 112 having a design as shown in Fig. 12. The design of the curtain 112 is also reflected in the mirror surface 66 in front of the user as the user's background.

[0087] FIG. 13 is a diagram showing an example of how the mirror surface portion 66 is used.

[0088] As shown in FIG. 13, a user in the editing space A2-1 can point the camera of his / her smartphone at the mirror surface 66 and take a picture of himself / herself reflected in the mirror surface 66. Although only one user is shown in the example of FIG. 13, if two people are playing the game, both people can take the photo.

[0089] That is, the mirror surface section 66 is prepared so that the user in the editing space A2-1 can take a so-called selfie (self-portrait) through the mirror.

[0090] Since the design described above is applied to the back side of curtain 112, the user can take a selfie with the design applied to curtain 112 as the background. Furthermore, the characters printed on curtain 112 in a left-right inverted state are reflected in a normal state on mirror surface 66, as shown in Fig. 13. In the image obtained by taking a selfie, the characters printed on curtain 112 are reflected in a normal state.

[0091] Users can upload images they take by taking selfies in the editing space A2-1 to their favorite SNS (Social Networking Service) site and show them to friends and others.

[0092] In this way, the photo sticker creating device 1 is a device that can take pictures not only in the shooting space A1 but also in the editing space A2. As described later, when editing starts, the user is guided to take a selfie. When the user finishes shooting and moves to the editing space A2, time is ensured for the user to take a selfie before editing.

[0093] The design of the back side of the curtain 112 attached to the editing space A2-1 side may be different from the design of the back side of the curtain 112 attached to the editing space A2-2 side. The user can enjoy wondering which design of the curtain 112 is installed in the editing space A2 to be guided to.

[0094] The back of the curtain 112 may be designed to have advertisements for products or services printed thereon.

[0095] FIG. 14 is a diagram showing an example of the configuration of the side surface of the editing unit 12. As shown in FIG.

[0096] A sticker paper outlet 161 is provided on the lower side of the side of the editing unit 12. A printer is provided inside the editing unit 12. The printer prints an image of a user who has performed editing work in the editing space A2-1 or an image of a user who has performed editing work in the editing space A2-2 on sticker paper in a predetermined layout and the printed image is discharged from the sticker paper outlet 161.

[0097] <Layer structure of edited images> FIG. 15 is a diagram showing an example of a layer structure of an edited image.

[0098] The leftmost edited image P1 is an image generated by editing. Edited image P1 is basically composed of images in the layers of a background image P11, a person image P12, and a foreground image P13. Layers that are the subject of various image processes are also set appropriately.

[0099] In the example of Fig. 15, background image P11 is a monochrome image. Foreground image P13 is an image including an image of handwritten characters "Love my friend" and a heart-shaped image. The image of handwritten characters "Love my friend" is a pen image input by the user using a pen tool. The heart-shaped image is a stamp image input by the user using a stamp tool.

[0100] In this way, edited image P1 is generated by overlaying person image P12, which is an image of a person's area extracted from a photographed image by chromakey processing, onto background image P11, and overlaying foreground image P13 on top of that. It is also possible to input a pen image or stamp image onto background image P11 and display it in the background of the subject. Foreground and background images may be composited into the photographed image, or may not be composited depending on the user's operation even if the image has been edited.

[0101] In the example of Fig. 15, an image showing a large area of ​​the user from approximately the chest up is shown as the person image P12. In the photographing process, a close-up image is taken in which the face is shown large like this. The close-up image is taken, for example, multiple times. A whole-body image showing the user's whole body may also be taken.

[0102] <Internal configuration of the photo sticker creation device> Fig. 16 is a block diagram showing an example of the configuration of the photo sticker creating device 1. In Fig. 16, the same components as those described above are given the same reference numerals, and duplicated explanations will be omitted as appropriate.

[0103] 16, the photo sticker creating device 1 is configured by connecting a pre-selection unit 302, a photographing unit 304, editing units 305A and 305B, and a printing unit 306 to a PC (Personal Computer) unit 301 via an external input / output interface 303. The PC unit 301, which is an information processing unit, is mounted inside the housing of the editing unit 12, for example.

[0104] The PC section 301 includes a central processing unit (CPU) 311, a read only memory (ROM) 312, and a random access memory (RAM) 313, which are connected to each other via a bus 314.

[0105] The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating apparatus 1. The ROM 312 stores the programs and data executed by the CPU 311. The RAM 312 temporarily stores the data and programs processed by the CPU 311.

[0106] An input / output interface 315 is further connected to the bus 314. A storage unit 316, a communication unit 317, and a drive 318 are connected to the input / output interface 315.

[0107] The storage unit 316 is a non-volatile storage medium such as a hard disk, a flash memory, etc. The storage unit 316 stores various setting information and the like supplied from the CPU 311. The information stored in the storage unit 316 is read out by the CPU 311 as appropriate.

[0108] The communication unit 317 is an interface for a network such as the Internet. The communication unit 317 communicates with an external device under the control of the CPU 311. The communication unit 317 transmits an image selected by a user to, for example, an image management server managed by the manufacturer of the photo sticker creating device 1. The image transmitted from the communication unit 317 is assigned a predetermined memory area and stored, and is displayed on or downloaded to a mobile terminal that has accessed the image management server.

[0109] Removable media 319, such as an optical disk or semiconductor memory, is appropriately loaded into the drive 318. Programs and data read from the removable media 319 by the drive 318 are supplied to the CPU 311, and are stored in the storage unit 316 or installed.

[0110] An external input / output interface 303 is connected to the input / output interface 315. The PC unit 301 controls each unit via the external input / output interface 303.

[0111] The pre-selection unit 302 performs a pre-selection process for users in the pre-selection space A0. The pre-selection unit 302 is composed of a touch panel monitor 71, a speaker 72, and a coin processing unit 321.

[0112] The touch panel monitor 71 displays various selection screens under the control of the PC unit 301, and accepts operations by the user on the selection screens. An input signal representing the content of the user's operation is supplied to the PC unit 301, and various settings are made.

[0113] The coin processing unit 321 detects the insertion of coins into the coin insertion / return slot 73. When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, it outputs a start signal to the PC unit 301 to instruct the start of a game.

[0114] The image capturing unit 304 performs image capturing processing on a user in the image capturing space A1. The image capturing unit 304 is composed of an operation unit 53, a camera 91, a camera driving unit 91A, a touch panel monitor 92, a lighting device 331, and a speaker 332.

[0115] Operation unit 53 outputs a signal representing the user's operation to PC unit 301 in response to the user's operation of angle adjustment button 53A and shooting stop button 53B.

[0116] The camera 91 captures images according to shutter control by the PC section 301, and outputs the captured images (image data) obtained by the capture to the PC section 301.

[0117] The camera driving unit 91A adjusts the angle of the camera 91 in the vertical direction according to the control by the PC unit 301.

[0118] The lighting devices 331 are strobe units within the photographing space A1, and emit light in accordance with a lighting control signal supplied from the PC section 301. The lighting devices 331 include an upper strobe unit 82 and a foot strobe unit 83.

[0119] The speaker 332 is composed of speakers provided at various positions in the imaging space A1.

[0120] Editing unit 305A performs editing processing for a user in editing space A2-1. Editing unit 305A is composed of tablet built-in monitor 131, touch pens 132A and 132B, and speaker 341. Editing unit 305B performs editing processing for a user in editing space A2-2, and has the same configuration as editing unit 305A. Hereinafter, editing units 305A and 305B will be collectively referred to as editing unit 305 as appropriate.

[0121] The tablet built-in monitor 131 displays an editing screen and accepts operations on the editing screen by the user under the control of the PC section 301. An input signal representing the content of the user's operation is supplied to the PC section 301, and the captured image to be edited is edited.

[0122] The printing section 306 is configured to include a printer 351. A sticker paper unit 352 is attached to the printer 351.

[0123] The printer 351 drives a built-in head 361 and prints an image on a roll of sticker paper 363 stored in a sticker paper unit 352 based on print data supplied from the PC section 301. The printer 351 also cuts the sticker paper 363 with the image printed thereon at a predetermined cutting position using a cutter 362, and discharges the cut sticker paper to the sticker paper discharge port 161.

[0124] <Example of functional configuration of photo sticker creation device> Fig. 17 is a block diagram showing an example of a functional configuration of the photo sticker creating device 1. At least a part of the functional units shown in Fig. 17 is realized by the CPU 311 executing a predetermined program.

[0125] In the photo sticker creating device 1, a pre-selection processing section 401, a photography processing section 402, an editing processing section 403, and a printing processing section 404 are realized.

[0126] The pre-selection processing unit 401 executes pre-selection processing by controlling each unit of the pre-selection unit 302. The pre-selection processing includes selection of the number of users, etc. Information indicating the contents of the selection by the users is supplied to the shooting processing unit 402.

[0127] The shooting processing unit 402 performs shooting processing by controlling each unit of the shooting unit 304. The shooting processing unit 402 outputs data of shot images obtained by performing the shooting processing to the editing processing unit 403. Data of multiple shot images obtained by performing shooting multiple times is supplied from the shooting processing unit 402 to the editing processing unit 403.

[0128] The editing processing unit 403 performs editing processing by controlling each unit of the editing unit 305. The editing processing includes image processing for adjusting the size of the eyes of the user appearing in the captured image, image processing for editing the captured image, and the like.

[0129] After editing the captured image, the edit processing unit 403 displays various screens, such as a screen used to select the number of divisions and a screen used to select images to be sent to the image management server, on the tablet built-in monitor 131. The edit processing unit 403 generates print data by arranging each edited image according to the number of divisions selected by the user, and outputs the print data to the print processing unit 404. The edit processing unit 403 also sends the edited image selected by the user to the image management server.

[0130] A print processing unit 404 outputs print data to the printer 351, and prints the edited image.

[0131] <Detailed configuration of the imaging processing section> FIG. 18 is a block diagram showing an example of the configuration of the image capture processing unit 402.

[0132] The photographing processing unit 402 is composed of a photographing control unit 411 , an image processing unit 412 , a display control unit 413 , and an image storage unit 414 .

[0133] The shooting control unit 411 captures moving images by controlling the camera 91, and outputs the images obtained by capturing images to the image processing unit 412. The moving images output from the shooting control unit 411 are used to generate live view images.

[0134] Furthermore, the shooting control unit 411 shoots still images in sync with the countdown, and outputs the still images obtained by shooting to the image processing unit 412. The still images output from the shooting control unit 411 are used to generate a shot image.

[0135] The image processing unit 412 cuts out a rectangular area by trimming from each frame of the moving image supplied from the shooting control unit 411, and generates a moving image made up of the cut-out images. The moving image generated by the image processing unit 412 is used as a live view image to be displayed on a live view screen.

[0136] Moreover, the image processing unit 412 generates a captured image with a predetermined angle of view by cutting out a rectangular area by trimming from the still image supplied from the shooting control unit 411. The captured image generated by the image processing unit 412 is supplied to the image storage unit 414 and stored therein.

[0137] The display control unit 413 controls the display of various screens on the touch panel monitor 92, such as a live view screen.

[0138] The image storage unit 414 stores the captured image generated by the image processing unit 412. When the capturing process is completed, the captured image stored in the image storage unit 414 is supplied to the edit processing unit 403.

[0139] <Detailed configuration of the editing processing section> FIG. 19 is a block diagram showing an example of the configuration of the edit processing unit 403 in FIG.

[0140] The edit processing unit 403 is made up of a selection receiving unit 431, an edit image generating unit 432, an edit control unit 433, a display control unit 434, a print data generating unit 435, and a communication control unit 436. The edit control unit 433 includes a iris processing unit 433A and a contour adjustment unit 433B.

[0141] The selection receiving unit 431 receives a user's operation on the screen displayed on the tablet built-in monitor 131. Information indicating the content of the user's operation received by the selection receiving unit 431 is supplied to an edit control unit 433 and a display control unit 434.

[0142] The image-for-edit generation unit 432 generates a captured image for editing based on the captured image supplied from the image processing unit 402. For example, the captured image for editing is obtained by performing various processes such as retouching on each image trimmed by the image processing unit 412 (FIG. 18) as an original image. The captured image for editing generated by the image-for-edit generation unit 432 is supplied to the editing control unit 433 and the display control unit 434.

[0143] The editing control unit 433 edits the captured image for editing supplied from the image for editing generation unit 432 based on the information output from the selection receiving unit 431. Editing is image processing for compositing a compositing image such as handwritten characters or a stamp image with the captured image to be edited.

[0144] The retouching process performed by the image-for-edit generation unit 432 is a process in which image processing according to the selection made by the user is performed collectively on each of a plurality of photographed images, whereas editing is a process in which image processing according to the selection made by the user is performed on a single photographed image that is currently being edited. During retouching, the size of the eyes, etc. may be selected for each photographed image.

[0145] The editing control unit 433 outputs information indicating the editing result to the display control unit 434, and causes the information to be reflected in the display on the editing screen.

[0146] When the editing is completed, the editing control unit 433 outputs an edited image, which is a photographed image obtained by performing editing, to the print data generating unit 435 and the communication control unit 436 .

[0147] The iris processing section 433A of the edit control section 433 performs iris processing, which is processing for changing the color of the iris of each user appearing in the photographed image, in response to a user's operation on the edit screen.

[0148] The contour adjustment unit 433B of the editing control unit 433 performs image processing in response to the user's operation on the editing screen, and emphasizes a specific part of the user that appears in the photographed image for editing. For example, the contour adjustment unit 433B performs image processing to emphasize the entire eye or a part of the eye such as the pupil.

[0149] The display control unit 434 displays an operation screen used for operation by the user on the tablet built-in monitor 131, and controls the display of the operation screen in response to the user's operation. The display control unit 434 is supplied with a captured image output from the image-for-edit generation unit 432, an edited image output from the edit control unit 433, and the like. The various images supplied to the display control unit 434 are used to display the operation screen.

[0150] The print data generation unit 435 generates print data by arranging, in a predetermined layout, the edited image supplied from the edit control unit 433. The print data generation unit 435 outputs the print data to the print processing unit 404, which prints the print data on the sticker paper 363.

[0151] The communication control unit 436 controls the communication unit 317 to transmit the edited image supplied from the edit control unit 433 to the image management server.

[0152] FIG. 20 is a block diagram showing an example of the configuration of the edit image generating unit 432. As shown in FIG.

[0153] The edited image generating unit 432 is made up of an area detecting unit 451 , a retouching processing unit 452 , a gender determining unit 453 , an eyelash processing unit 454 , and a reduction unit 455 .

[0154] The photographed image supplied from the photographing and processing unit 402 is input to the area detecting unit 451, the retouching processing unit 452, and the gender determining unit 453. The processing by each unit of the image-for-editing generating unit 432 is performed on each photographed image.

[0155] The area detection unit 451 detects the area of ​​the user, who is a person appearing in the captured image, and also detects the areas of each part of the user. For example, the area of ​​the user's face, the areas of the eyes, eyelids, nose, lips, cheeks, hair, and the like that constitute the face are detected by the area detection unit 451.

[0156] FIG. 21 is a diagram showing an example of region detection.

[0157] When a photographed image P101 showing two women is provided, the face and each part of the face are detected for each user. For example, each area including the left and right eye areas is detected for the user on the left side.

[0158] When attention is focused on the right eye area of ​​the user on the left side, as shown enlarged on the left side of FIG. 21, a iris area A11 and white areas A12 and A13 on either side of the iris area A11 are detected.

[0159] The white of the eye area A12 is the area of ​​the white of the eye that is closer to the nose, and the white of the eye area A13 is the area of ​​the white of the eye that is closer to the ear. Position p1 represents the position of the inner corner of the eye, and position p2 represents the position of the outer corner of the eye. Catch lights according to the shape and size of each are captured in the iris area A11 by the emission of the upper strobe unit 82 and the foot strobe unit 83.

[0160] The detection of the iris and white of the eye is performed based on a prediction model configured by, for example, a neural network, etc. A prediction model for detecting each area of ​​the eye, which is generated in advance by machine learning, is prepared for the area detection unit 451.

[0161] The prediction model prepared in the region detection unit 451 is, for example, a model that inputs a captured image and outputs a mask image of each eye region and a mask image of the skin region around the eye. The mask image output from the prediction model represents the position, size, shape, etc. of each of the iris region and the white region of the eye.

[0162] The detection of the iris and white of the eye may be performed by matching based on the feature amounts of each area extracted by analyzing the image, rather than using a predictive model. In this case, data representing the feature amounts of the iris and white of the eye are prepared in the area detection unit 451 .

[0163] In addition to the eye regions, the entire face and other facial regions may be detected using a predictive model generated by machine learning, or may be detected by matching based on feature amounts.

[0164] 20 outputs information on each area detected as described above to the retouching processing unit 452 and the eyelash processing unit 454. The information output from the area detection unit 451 represents the positions, sizes, shapes, etc. of the pupils and whites of the left and right eyes of each user appearing in the photographed image. Information representing the detection results by the area detection unit 451 is also supplied to the editing control unit 433 at the subsequent stage.

[0165] The retouching processing unit 452 performs retouching processing on the captured image. The retouching processing is image processing for specific parts of the user appearing in the captured image, such as adjusting the contours of the face and the size of the eyes. Each area to be subjected to image processing is specified by information supplied from the area detection unit 451. The captured image that has been retouched is supplied to the eyelash processing unit 454.

[0166] Other processing such as adjustment of skin brightness may be performed as retouching processing. Other image processing such as filtering may be performed on the entire image rather than processing on a specific part.

[0167] The gender determination unit 453 determines the gender of each user appearing in the captured image, and outputs information indicating the determination result to the eyelash processing unit 454. The determination by the gender determination unit 453 may also be based on a predictive model generated by machine learning, or may be performed by matching based on the feature amount of each area extracted by analyzing the image.

[0168] The eyelash processing unit 454 performs eyelash processing, which is image processing for emphasizing the eyelashes of each user appearing in the photographed image supplied from the retouching processing unit 452. The eyelash processing is performed, for example, only on females, based on the determination result by the gender determination unit 453. The photographed image in which the eyelashes have been emphasized by the eyelash processing is supplied to the reduction unit 455. The eyelash processing performed by the eyelash processing unit 454 will be described in detail later.

[0169] The reduction unit 455 generates a captured image for editing by reducing the captured image supplied from the eyelash processing unit 454. The captured image is reduced by, for example, thinning out pixels to reduce the number of pixels constituting the captured image. The captured image for editing generated by the reduction unit 455 is supplied to the editing control unit 433, etc.

[0170] In this way, in the edit image generating unit 432, the retouching process and eyelash processing are performed on the original image before reduction. It is possible to perform detailed processing on a captured image with a large amount of data.

[0171] FIG. 22 is a block diagram showing an example of the configuration of the eyelash processing unit 454 in FIG.

[0172] The eyelash processing unit 454 is made up of an inverted eyelash removal unit 461 , a transformation unit 462 , a synthesis unit 463 , and an eyelash emphasis processing unit 464 .

[0173] The captured image after retouching processing supplied from the retouching processing unit 452 is input to an inverted eyelash removal unit 461. Information on each area detected by the area detection unit 451 is input to each unit of the eyelash processing unit 454. Information indicating the gender determination result by the gender determination unit 453 is input to a transformation unit 462 and a synthesis unit 463.

[0174] The inverted eyelash removal unit 461 removes inverted eyelashes by image processing when the user's eyes shown in the captured image have inverted eyelashes. Inverted eyelashes are upper eyelashes that grow downward and overlap the white of the eye, and lower eyelashes that grow upward and overlap the white of the eye. The position of the white of the eye is identified based on information supplied from the area detection unit 451.

[0175] FIG. 23 is a diagram showing an example of removing inverted eyelashes.

[0176] When eyelashes are visible in the white eye area A13 as shown by the dashed circle C1 on the left side of FIG. 23, the inverted eyelash removal unit 461 replaces (interpolates) the pixels that make up the eyelashes with the surrounding pixels of the white eye area A13, thereby removing the inverted eyelashes as shown on the right side of FIG. 23.

[0177] The presence of eyelashes in the white of the eye region A13 is identified by detecting a pixel in the white of the eye region A13 that is a color other than the white color set as the standard color for the white of the eye as an abnormal pixel. Information indicating the standard color for the white of the eye region is preset in the inverted eyelash remover 461.

[0178] In the inverted eyelash removal unit 461, abnormal pixels, which are pixels of a color other than the standard color, are interpolated with surrounding white pixels, thereby removing inverted eyelashes.

[0179] Pixels of a color other than white are detected as abnormal pixels, and the inverted eyelash removal unit 461 performs a process of interpolating them with white pixels, so that as a result, areas that are bloodshot and red are also removed.

[0180] The photographed image from which the inverted eyelashes have been removed in the above manner is output from the inverted eyelash removal unit 461. If the user's eye shown in the photographed image does not have inverted eyelashes, the photographed image input to the inverted eyelash removal unit 461 is output as is.

[0181] If the user appearing in the photographed image supplied from the inverted eyelash removal unit 461 is a woman, the deformation unit 462 deforms the eyelash image to fit the shape of the upper outline of the user's eyes. An eyelash image, which is a texture image expressing eyelashes, is stored in advance in the transformation unit 462. The eyelash image transformed by the transformation unit 462 is used to composite with the eye portion of the user appearing in the captured image.

[0182] FIG. 24 is a diagram showing an example of deformation of an eyelash image.

[0183] The transformation unit 462 has a default eyelash shape image P111 as shown in the upper left of Fig. 24. R When the shape of the upper outline of eyelash image P111 is represented by a curve from position p1 to position p2 shown in the lower left of Fig. 24, deformation unit 462 deforms eyelash image P111 to match the shape of a specific section of the curve between positions p1 and p2, and generates deformed eyelash image P111' shown on the right side of Fig. 24. The curve between positions p1 and p2 is identified based on information supplied from area detection unit 451.

[0184] The deformation unit 462 outputs the eyelash image deformed as described above to the synthesis unit 463. A plurality of default eyelash images may be prepared, and an eyelash image to be used for deformation may be selected. The selection of the eyelash image may be performed by the user, or may be performed automatically by the eyelash processing unit 454.

[0185] The synthesis unit 463 in FIG. 22 synthesizes the eyelash image deformed by the deformation unit 462 along the upper contour of the eye of the female user appearing in the photographed image supplied from the inverted eyelash removal unit 461.

[0186] FIG. 25 is a diagram showing an example of eyelash image synthesis.

[0187] When a deformed eyelash image P111' as shown in the upper left of FIG. 25 is supplied, the synthesis unit 463 applies the eyelash image P111' to the right eye E as shown on the right side of FIG. R Synthesize along the upper contour of the right eye E R The position of the upper contour is identified based on the information supplied from the area detection unit 451.

[0188] The above-described composition of eyelash images is performed similarly for the left eye. The composition of the eyelash image for the left eye is performed, for example, using the eyelash image P111 prepared for the right eye.

[0189] In this case, the deformation unit 462 reverses the eyelash image P111 horizontally and deforms the shape of the eyelash image P111 after the horizontal reversal to match the shape of the upper part of the left eye. The synthesis unit 463 synthesizes the eyelash image P111 after the deformation by the deformation unit 462 along the contour of the upper part of the left eye.

[0190] In this way, an image that is a mirror image of an eyelash image prepared for the right eye is used to synthesize an eyelash image for the left eye. Since processing for the left eye is performed using an image for the right eye, the number of eyelash images that need to be prepared can be reduced. Conversely, an eyelash image for the left eye may be prepared, and processing for the right eye may be performed using an image for the left eye. Of course, eyelash images for both the right and left eyes may be prepared.

[0191] The above-described composition of eyelash images is performed for each woman appearing in the photographed image. The composition unit 463 outputs the photographed image after composition of the eyelash images to the eyelash emphasis processing unit 464 in FIG.

[0192] The eyelash emphasis processing unit 464 emphasizes the eyelashes in the photographed image supplied from the synthesis unit 463 by image processing. For example, processing is performed to make each upper eyelash and each lower eyelash thicker or to make the color darker. The eyelash emphasis processing unit 464 outputs the photographed image in which the eyelashes are emphasized.

[0193] <How the photo sticker creation device works> Here, the operation of the photo sticker creating device 1 that provides the photo sticker creating game will be described with reference to the flowchart of Fig. 26. The process of Fig. 26 is started, for example, when a predetermined amount of coins is inserted.

[0194] In step S1, the pre-selection processing unit 401 performs a pre-selection process by controlling the pre-selection unit 302. Through the pre-selection process, for example, the number of users, the photography course, etc. are selected. Any of the selections are performed using a selection screen displayed on the touch panel monitor 71.

[0195] In step S2, the image capturing processing unit 402 controls the image capturing unit 304 to perform image capturing processing.

[0196] For example, after guiding the user to a proper standing position, the photography processing unit 402 causes the touch panel monitor 92 to display a live view screen based on the moving image captured by the camera 91. After displaying the live view screen, the photography processing unit 402 continuously captures still images of the user in the photography space A1 as a subject.

[0197] In step S3, the editing processing unit 403 performs editing processing by controlling the editing unit 305 corresponding to either the editing space A2-1 or the editing space A2-2, whichever is the destination of the user who has completed the shooting processing.

[0198] For example, the editing processing unit 403 displays an editing screen on the tablet built-in monitor 131, and allows the user to edit the captured image. On the editing screen, the captured image to be edited and buttons to be operated when selecting a compositing image to be composited with the captured image are displayed. Details of the editing process will be described later with reference to the flowchart of FIG.

[0199] In step S4, the print processing unit 404 performs print processing by controlling the printer 351. The print processing unit 404 outputs the print data generated by the edit processing unit 403 to the printer 351, and causes it to print on the sticker paper 363.

[0200] When printing is completed, the printer 351 discharges the sticker paper 363 cut off by the cutter 362 to the sticker paper discharge port 161 in step S5.

[0201] A photo creation game consisting of a series of processes as described above is provided to each group of users of the photo sticker creating device 1. When a user of one group starts using the photo sticker creating device 1 followed by a user of another group, the photo sticker creating game of the user who started using the photo sticker creating device 1 first and the photo sticker creating game of the user who started using the device later are appropriately played in parallel. The photo sticker creating game may also be simply called a game as appropriate.

[0202] <Editing process> Next, the editing process performed in step S3 in FIG. 26 will be described with reference to the flowchart in FIG.

[0203] In step S41, the display control unit 434 (FIG. 19) of the editing processing unit 403 displays a guide screen for the before-doodle selfie on the tablet built-in monitor 131. Doodle here means editing of the captured image. Editing is performed by using the touch pen 132 as if drawing doodling on the captured image.

[0204] FIG. 28 is a diagram showing a display example of a guide screen for taking a selfie before graffiti.

[0205] As shown in Fig. 28, on the left side of the pre-graffiti selfie guide screen, an image showing a model person taking a selfie through mirror section 66 is displayed. On the right side of the guide screen, sample images of images obtained by selfie are displayed. Under each image, a message explaining the content of the image is displayed.

[0206] By displaying such a guide screen, it is possible to clearly inform the user of the type of self-portrait that can be taken using the mirror surface portion 66.

[0207] A user who has moved to the editing space A2 follows the guide screen, prepares his / her smartphone, and takes a selfie through the mirror unit 66.

[0208] Returning to the explanation of Fig. 27, in step S42, the edit image generating unit 432 performs an edit image generating process. Through the edit image generating process, a photographed image for editing is generated based on each photographed image.

[0209] In the photographing process, for example, a maximum of eight photographed images are taken. Since there are a large number of photographed images, a certain amount of time is required to generate photographed images for editing based on each photographed image. The photographed images for editing are generated using the time reserved for taking a selfie before editing. The user can wait without getting bored while the photographed images for editing are generated.

[0210] The details of the editing image generation process that is performed while the user is taking a selfie will be described later with reference to the flowchart of FIG.

[0211] In step S43, the display control unit 434 causes a selection screen for an image to be kept to be displayed on the tablet built-in monitor 131. As the selection screen for an image to be kept is displayed on the tablet built-in monitor 131 instead of the guide screen of Fig. 28, the user finishes taking the selfie and selects an image to be kept in accordance with the display on the tablet built-in monitor 131.

[0212] The kept images are the photographed images that are actually edited. The number of photographed images that can be selected as kept images is set to, for example, four. The kept image selection screen displays the photographed images that have been subjected to retouching processing side by side. Selection is performed using the selection screen by selecting four photographed images from a maximum of eight photographed images.

[0213] When a predetermined number of images to be kept, such as four images, are selected, in step S44, the display control unit 434 displays an editing screen on the tablet built-in monitor 131. On the editing screen, buttons to be pressed when selecting various editing tools (images to be combined), such as stamp images and pen images, used in editing, are displayed together with the photographed images to be edited.

[0214] FIG. 29 is a diagram showing an example of an editing screen displayed on the tablet built-in monitor 131. As shown in FIG.

[0215] On the editing screen, editing areas 501L and 501R are provided side by side on the left and right. Between the editing areas 501L and 501R, there is provided a thumbnail display area 502 in which a thumbnail of a captured image selected as a keep image is displayed.

[0216] Further, editing palettes 503L and 503R are provided below the editing areas 501L and 501R, respectively. Between the editing palettes 503L and 503R, a group of category selection buttons 504 is provided for selecting a category of editing tools to be displayed in the editing palettes 503L and 503R.

[0217] With this configuration, on the editing screen, editing inputs for the photographed image selected as the editing target are accepted individually by two users.

[0218] In the following description, when there is no need to distinguish between the editing areas 501L, 501R and the editing palettes 503L, 503R, they will simply be referred to as the editing area 501 and the editing palette 503.

[0219] The editing area 501 is a display area for a kept image (image to be edited) selected as an object for editing input. The user selects an editing tool using the touch pen 132 and edits the kept image displayed in the editing area 501.

[0220] The thumbnail display area 502 is a display area for thumbnails representing images to be kept. The user selects a thumbnail displayed in the thumbnail display area 502 to select an image to be kept for editing.

[0221] The editing palette 503 is an area where icons used to select various editing tools such as a pen tool, a sticking tool, a stamp tool, a makeup tool, etc. are displayed. The sticking tool is an editing tool used when synthesizing a predetermined image at a position based on the face recognition result. The makeup tool is an editing tool used when applying image processing that imitates makeup to the eyes, lips, cheeks, etc.

[0222] Category selection button group 504 is made up of buttons that are pressed to switch the category of editing tools to be displayed on editing palette 503.

[0223] 29, the pen button of the category selection button group 504 has been selected by the user on the left side as one faces the tablet built-in monitor 131. An icon for selecting a pen tool and the like are displayed in the editing palette 503L.

[0224] Also, the user on the right has selected the makeup button in category selection button group 504. Edit palette 503R displays buttons for selecting makeup tools and the like.

[0225] Below the thumbnail display area 502, two mobile bonus buttons 505L and 505R that imitate the appearance of a smartphone are displayed side by side. When the mobile bonus buttons 505L and 505R are operated, buttons used for creating mobile bonuses are displayed. Note that mobile bonuses are images that are intended to be used on mobile terminals, such as images displayed on the standby screen of a mobile terminal or uploaded to SNS. The created mobile bonus is sent to the image management server as an image dedicated to sending to mobile terminals.

[0226] A BGM selection area 506 is displayed above the thumbnail display area 502. The BGM selection area 506 is operated when selecting BGM and adjusting the volume during editing.

[0227] 27, in step S45, the edit control unit 433 edits the captured image to be edited in response to a user's operation on the edit screen. The edited image generated by the editing is supplied to the print data generation unit 435.

[0228] When the editing is ended by operating the end button or the like, the display control section 434 causes the tablet built-in monitor 131 to display a division number selection screen in step S46.

[0229] The division number selection screen is a screen used to select a sticker layout. The sticker layout is a layout (arrangement pattern) that determines the number, position, and size of edited images to be arranged on one sticker paper 363. Edited images arranged according to the sticker layout selected by the user are printed on sticker paper 363.

[0230] In step S47, the display control unit 434 causes the tablet built-in monitor 131 to display a transmission image selection screen.

[0231] In order to use the image management service, users must register as members, and there are two types of membership: paid and free. Paid members can obtain all images sent to the image management server and download them to their mobile devices, whereas free members can obtain only one image. The transmission image selection screen is a screen used by free members to select one image to obtain. The image management service is a service that provides users with images that have been created in the game and sent from the photo sticker creation device 1 to the image management server.

[0232] In step S48, the edit processing unit 403 causes the tablet built-in monitor 131 to display an email address input screen.

[0233] The email address input screen is a screen used for inputting the user's email address. The email address input screen displays the alphabets and symbols that can be used in email addresses, as well as buttons for selecting the carrier of a mobile phone such as a smartphone.

[0234] In step S49, the communication control unit 436 transmits the edited image to the image management server. The photographed image is also transmitted to the image management server as appropriate. In other words, not only the edited image but also the photographed image that was the basis of the edited image is transmitted to the image management server.

[0235] Further, the device ID of the photo sticker creating device 1, the shooting date and time, information indicating which image was selected from the transmission image selection screen, and the like are also transmitted to the image management server.

[0236] In step S50, the print data generating unit 435 generates print data by arranging the edited image in a layout selected by the user. The print data is supplied to the print processing unit 404 and used to print the edited image (step S4 in FIG. 26).

[0237] In step S51, the display control unit 434 guides the user who has finished editing work to move to the print waiting space A3 by displaying a guidance screen on the tablet built-in monitor 131. The guidance to move to the print waiting space A3 is also given by outputting sound from the speaker 341.

[0238] Then, the process returns to step S3 in FIG. 26, and the subsequent processes are carried out.

[0239] As described above, in the game of the photo sticker creating device 1, it is possible to take pictures not only in the shooting space A1 but also in the editing space A2. Users can take selfies of themselves playing the game in the editing space A2.

[0240] <Image generation process for editing> Next, the editing image generating process performed in step S42 in FIG. 27 will be described with reference to the flowchart in FIG.

[0241] In step S61, the gender determination unit 453 determines the gender of each user appearing in the captured image.

[0242] In step S62, the retouching processor 452 performs retouching on the captured image. The retouching by the retouching processor 452 is performed in accordance with the content selected using the retouching screen displayed on the touch panel monitor 92 during the capture process.

[0243] For example, the retouching processor 452 detects the eyes of the user appearing in the captured images and performs a process of adjusting the size of the detected eyes on each captured image. The retouching processor 452 performs a plurality of types of image processing other than the adjustment of the eye size on each captured image.

[0244] In step S63, the area detection unit 451 detects the area of ​​the user's eyes appearing in the captured image.

[0245] In step S64, the eyelash processing unit 454 performs eyelash processing, which is image processing for emphasizing eyelashes that appear in the captured image. Details of the eyelash processing will be described later with reference to the flowchart of FIG.

[0246] In step S65, the reduction unit 455 reduces the captured image supplied from the eyelash processing unit 454 to generate a captured image for editing.

[0247] In step S66, the edit image generating unit 432 determines whether or not the processing of all captured images has been completed, and if it determines that there are captured images for which processing has not yet been completed, it repeats the processing from step S61 onwards.

[0248] If it is determined in step S66 that the processing of all captured images has been completed, the process returns to step S42 in FIG. 27, and the subsequent processing is carried out.

[0249] <Eyelash treatment> Next, the eyelash processing performed in step S64 in FIG. 30 will be described with reference to the flowchart in FIG.

[0250] In step S81, eyelash processing unit 454 determines, based on the result of gender determination by gender determination unit 453, whether or not a woman is photographed in the captured image to be processed.

[0251] As described above, eyelash processing, which is image processing for enhancing eyelashes, is performed only on women, not on men. If it is determined in step S81 that the photographed image being processed does not include a woman, that is, that all users in the photographed image are men, the processing from step S82 onward in FIG. 31 is skipped.

[0252] This makes it possible to prevent image processing that emphasizes the eyelashes of men.

[0253] At least a part of the processing from step S82 onward may be performed on males.

[0254] If it is determined in step S81 that a woman appears in the photographed image being processed, the process proceeds to step S82. If multiple women appear, the process proceeds to step S82 and subsequent steps for each of them.

[0255] In step S82, the inverted eyelash remover 461 detects abnormal pixels included in the white area of ​​the eye within the eye area, and removes the inverted eyelashes by performing interpolation using surrounding pixels.

[0256] In step S83, the deformation unit 462 deforms the eyelash image to fit the shape of the upper outline of the eye, as described with reference to FIG.

[0257] In step S84, the synthesis unit 463 synthesizes the eyelash image transformed by the transformation unit 462 along the upper contour of the eye of the woman to be processed that appears in the photographed image.

[0258] Here, if both eyes of the woman to be processed are open, eyelash images are synthesized for both eyes. For example, if the degree of opening of the eyes is lower than a threshold degree (if the eyes are closed), the process of emphasizing the eyelashes, including the synthesis of eyelash images, may not be performed for the closed eyes.

[0259] If eyelashes are emphasized when the eye is closed due to a wink or the like, this may result in an unnatural appearance, but it is possible to prevent this from happening.

[0260] In step S85, the eyelash emphasis processing unit 464 emphasizes the eyelashes by image processing. For example, the eyelashes are emphasized by detecting the upper and lower eyelashes and thickening or darkening each one. The process of thickening or darkening each eyelash is also performed on each eyelash that constitutes the eyelash image synthesized as the upper eyelashes.

[0261] That is, in this example, in addition to combining the eyelash images, the upper eyelashes are processed to thicken each individual eyelash. Also, the upper eyelashes and the lower eyelashes are emphasized by different processes.

[0262] Then, the process returns to step S64 in FIG. 30, and the subsequent processes are carried out.

[0263] As described above, the emphasis on the eyelashes of a woman appearing in a photographed image is performed not by simply synthesizing an eyelash image prepared as a template, but by synthesizing an eyelash image that has been deformed to match the shape of the eye outline.

[0264] The shape of each user's eyes will be different depending on the facial expression at the time of shooting, etc. By synthesizing eyelash images that have been deformed to match the shape of each user's eyes, it is possible to emphasize the eyelashes in a more natural way and make the eyes appear larger.

[0265] In addition, after the eyelash images are combined, each upper and lower eyelash can be emphasized, making it possible for the combined eyelashes to blend in with the user's own eyelashes.

[0266] <Makeup tool function> Eye color tool Here, editing using a makeup tool prepared on the editing screen will be described.

[0267] FIG. 32 is an enlarged view of edit palette 503R of FIG. 29 when the make tool is selected.

[0268] Selection buttons 511-1 to 511-5 used to select a makeup tool are displayed in an array above the editing palette 503R.

[0269] The selection button 511-1 is a button that is pressed when selecting a face-slimming tool for applying makeup to make the face look smaller.

[0270] Selection button 511-2 is a button that is pressed when selecting an eye color tool that changes the color of the iris of the eye. By using the eye color tool, the user can apply makeup as if they were wearing color contact lenses. In the example of Fig. 32, selection button 511-2 is pressed and the eye color tool is selected.

[0271] The selection button 511-3 is a button that is pressed when selecting an outline density adjustment tool for adjusting the darkness of the eye outline.

[0272] The selection button 511-4 is a button that is pressed when selecting a lip tool that changes the color of the lips, and the selection button 511-5 is a button that is pressed when selecting a cheek tool that changes the color of the cheeks.

[0273] When the eye color tool is selected, a face image area 512 is displayed on the left side of the editing palette 503R, as shown in Fig. 32. The face image area 512 is a display area for an image of the user's face captured in a photographed image, which has been extracted by performing face recognition.

[0274] Iris processing, which is processing for changing the color of the iris, is performed by iris processing unit 433A (FIG. 19) for the user whose face is displayed in face image area 512. In the example of FIG. 32, of the two users appearing in the photographed image displayed in editing area 501R in FIG. 29, the user on the right is displayed as the target user of the eye color tool.

[0275] Below the face image area 512, a switch button 513 is displayed which is pressed to switch the user targeted by the eye color tool.

[0276] Color selection buttons 514-1 to 514-4 used to select eye colors are displayed on the right side of the face image area 512. The colors brown, chocolate, gray, and black are assigned to the circular color selection buttons 514-1 to 514-4, respectively.

[0277] For example, when color selection button 514-1 is pressed, the color of the pupil area of ​​the user selected as the target of the eye color tool among the users appearing in the photographed image displayed in editing area 501R is changed to brown.

[0278] Furthermore, when color selection button 514-2 is pressed, the color of the pupil area of ​​the user selected as the target of the eye color tool among the users appearing in the photographed image displayed in editing area 501R is changed to chocolate.

[0279] FIG. 33 is a diagram showing an example of an image generated by the eye color tool.

[0280] When the captured image P101 is selected as the object to be edited and the user on the right is selected as the target of the eye color tool, by pressing color selection buttons 514-1 to 514-4, the captured images in the editing area 501R are switched to the captured images P101-1 to P101-4 in which the color of the pupil area of ​​the user on the right, as shown surrounded by a frame F, has been changed.

[0281] 33, the captured image P101-1 is an image in which the color of the iris of the right user's eye has been changed to brown, the captured image P101-2 is an image in which the color of the iris of the right user's eye has been changed to chocolate, the captured image P101-3 is an image in which the color of the iris of the right user's eye has been changed to gray, and the captured image P101-4 is an image in which the color of the iris of the right user's eye has been changed to black, although they are shown as the same image in the example of FIG.

[0282] Each time the switching button 513 is pressed, the user targeted by the eye color tool is switched in the order of the user on the left, the user on the right, and then the two users.

[0283] For example, when the user targeted by the eye color tool is selected as the user appearing on the left side, by pressing color selection buttons 514-1 to 514-4, the captured image in editing area 501R is switched to a captured image in which the color of the pupil area of ​​the user on the left side has been changed.

[0284] Furthermore, when the users targeted by the eye color tool are all selected as two users, pressing color selection buttons 514-1 to 514-4 switches the captured image in editing area 501R to a captured image in which the color of the iris areas of the two users on the left and right has been changed.

[0285] In this way, by using the eye color tool, a user can change the color of the pupils of each user in each captured image, and can also change the eye color of two users at the same time.

[0286] An OFF button 515, which is pressed to turn off the function of the eye color tool, is displayed to the lower right of the color selection button 514-4 in Fig. 32. When the OFF button 515 is pressed, a captured image without iris processing is displayed in the editing area 501R.

[0287] FIG. 34 is a diagram showing an example of a mask image used in image processing when the eye color tool is selected.

[0288] When generating a captured image for editing, a mask image representing each region of the eyes as shown in Fig. 34B is generated based on a captured image P101 shown in Fig. 34A. As described above, when generating a captured image for editing, a mask image M representing each region of the eyes and the like is generated in the region detection unit 451 (Fig. 20) of the image for editing generation unit 432 by using a prediction model generated by machine learning.

[0289] 34B, the pixels that represent the eye contours, iris contours, and eyelashes of the two users are represented by white pixels among the pixels that make up the mask image M. Using this mask image M, iris processing is performed by the iris processing unit 433A.

[0290] FIG. 35 is a diagram showing an example of changing the color of the iris area.

[0291] When changing the color of the iris using the eye color tool is selected, the iris processing unit 433A extracts the iris area of ​​the user to be targeted by the eye color tool using the mask image M. In the example at the top of FIG. R Black eye area A11 R And, left eye E L Black eye area A11 L is extracted based on the mask image M.

[0292] In addition, the iris processing unit 433A extracts the iris area A11 R ,A11 L The color of the pixels constituting the iris area A11 is changed to a color selected by the user from among brown, chocolate, gray, and black. R ,A11 L The hatched area indicates the iris area A11. R ,A11 L This indicates that the color of the pixel has been changed.

[0293] The color of the pixels constituting the iris area is changed, for example, by changing the hue of the original color by an amount corresponding to the selected color. For each of the colors brown, chocolate, gray, and black, the method of changing the hue, including the degree (amount) of change, is preset.

[0294] That is, instead of changing to the selected color, the color is changed by using the original iris color as a reference color and adjusting the reference color according to the selected color.

[0295] The color of the iris area may be changed by changing other parameters such as brightness and saturation instead of the hue, or by changing a combination of a plurality of parameters.

[0296] The color may be changed by performing a filter process on each pixel that constitutes the iris area, or by adjusting the luminance using a predetermined tone curve.

[0297] In this way, the color of the iris area is changed by changing the color of the pixels of the photographed image itself, rather than by synthesizing a roughly circular image having the same shape as the iris area on the photographed image. Also, the color of the iris area is changed by changing the original color, which differs slightly from person to person.

[0298] Even if the same color is selected from brown, chocolate, gray, and black, the color will be slightly different for each person, so it is possible to change the impression of the iris area in a natural, seamless way.

[0299] If the color of the iris area were to be changed by combining a circular image of a specified color with the iris area, the color of the iris area may change significantly for some people, or differences in appearance depending on the direction of the eyes or the way the strobe light hits the area may be lost; however, it is possible to prevent such unnatural color changes.

[0300] -Contour density adjustment tool Next, adjustment of the darkness of the eye contour using the contour density adjustment tool will be described.

[0301] When selection button 511-3 is pressed, a slide bar used to adjust, for example, the darkness of the eye contour is displayed in editing palette 503R. A face image area 512 is displayed on the left side of editing palette 503R.

[0302] Contour density adjustment processing, which is processing for changing the darkness of the eye contours, is performed by contour adjustment unit 433B (FIG. 19) for a user whose face is displayed in face image area 512. The contour density adjustment processing is also performed using mask image M generated by area detection unit 451.

[0303] FIG. 36 is a diagram showing an example of adjustment of the darkness of the eye contour.

[0304] When darkening the eye contour is selected by the contour density adjustment tool, contour adjustment unit 433B uses mask image M to extract the eye contour, the contour of the iris of the eye, and the eyelashes.

[0305] In addition, the contour adjustment unit 433B adjusts the color of the pixels so that each extracted portion becomes darker. For example, the contour of the eye, the contour of the iris of the eye, and the eyelashes are adjusted by thickening each extracted portion or by darkening the color. In the example in the lower part of Fig. 36, the contour of the eye, the contour of the iris of the eye (left and right edges), and the eyelashes are shown darker than in the state in the upper part of Fig. 36.

[0306] FIG. 37 is a diagram showing another example of adjustment of the darkness of the eye contour.

[0307] When thinning the eye contour is selected by the contour density adjustment tool, contour adjustment unit 433B uses mask image M to extract the eye contour, the contour of the iris of the eye, and the eyelashes.

[0308] In addition, the contour adjustment unit 433B adjusts the color of the pixels so that each extracted part becomes lighter. For example, the contour of the eye, the contour of the iris of the eye, and the eyelashes are adjusted by thinning each extracted part or by lightening the color.

[0309] In this way, the eye contour is adjusted by adjusting the eye contour, the iris of the eye, and the eyelashes as a whole based on the mask image M. A plurality of slide bars may be displayed to allow adjustment of each of the eye contour, the iris of the eye, and the thickness of the eyelashes.

[0310] Such contour density adjustment processing is performed by selecting a user who is a target of the contour density adjustment tool.

[0311] For example, as described with reference to Figure 32, when the user targeted by the contour density adjustment tool is selected as the user appearing on the right side, as the slide bar is operated, the captured image in editing area 501R is switched to a captured image in which the density of the contours of the eyes of the user on the right side has been changed.

[0312] Similarly, when the user targeted by the contour density adjustment tool is selected as the user appearing on the left side, the captured image in editing area 501R is switched to a captured image in which the density of the contours of the eyes of the user on the left side has been changed in response to operation of the slide bar.

[0313] In addition, when two users are selected as the target users of the contour density adjustment tool, the captured image in the editing area 501R is switched to a captured image in which the darkness of the eye contours of the two users on the left and right has been changed in response to the operation of the slide bar.

[0314] In this way, by using the contour density adjustment tool, the user can change the darkness of the eye contour for each captured image and for each user appearing in the captured image. Also, the user can change the darkness of the eye contour for two users at the same time.

[0315] By using the eye color tool and eye contour density adjustment tool together, users can adjust the color of the iris individually for each user, and adjust the darkness of the eye contour etc. for two people together. Also, users can adjust the color of the iris together for two people, and adjust the darkness of the eye contour etc. for each user individually.

[0316] <Modification> Other makeup tool examples The processing using the lip tool and cheek tool prepared as makeup tools may be performed in the same manner as the eye color tool.

[0317] For example, when the selection button 511-4 is pressed and the lip tool is selected, the color of the lips of the user selected as the target of the lip tool is changed according to the color selected using the button displayed in the editing palette 503R. The color of the pixels constituting the lip area extracted using the mask image is changed by adjusting the reference color according to the selected color based on the original lip color.

[0318] -Switching processing according to output destination The iris area, whose color is changed by the eye color tool, is a small area compared to the entire image. If multiple images with changed iris area colors are printed side by side on sticker paper, depending on the layout, the iris in each image may be small, making it difficult to express the difference in color of the iris. Also, the entire iris may appear an unnatural color.

[0319] The change in color of the iris area by the eye color tool may be reflected in the image displayed on the editing screen, but not in the image printed on the sticker paper. In this case, the process for generating the image to be displayed on the editing screen and the process for generating the image to be printed on the sticker paper are performed for each captured image in response to the user's operation.

[0320] In other words, when a photographed image P101 is selected as the object to be edited, if a user instructs changing the color of the iris area using the eye color tool, the photographed image P101 with the color of the iris area changed is generated as the image to be displayed on the editing screen, and the photographed image P101 with the color of the iris area not changed is generated as the image to be printed on a sticker paper.

[0321] This makes it possible to generate an appropriate image depending on the output destination of the image, and makes it possible to prevent an image that looks unnatural from being printed on the sticker paper.

[0322] The photographed image P101 displayed on the editing screen with the color of the iris area changed can be edited using various editing tools in response to user operations. The image that has been edited but has the color of the iris area unchanged will be printed on the sticker paper.

[0323] Although the output destination of the image is assumed to be the editing screen (the tablet built-in monitor 131) or sticker paper, the process may be switched depending on other output destinations. The output destinations include not only the components provided in the photo sticker creating device 1 such as the touch panel monitor 92, but also the monitor of the user's smartphone and the image management server.

[0324] Although the above description is given of a case where the print medium for the image is sticker paper, various media such as printing paper, a resin card, or cloth may be used in place of sticker paper.

[0325] About the Program The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed in a computer incorporated in dedicated hardware or a general-purpose personal computer.

[0326] The program to be installed is provided by being recorded on removable medium 319 shown in FIG. 16, which is made up of an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or a semiconductor memory. Alternatively, the program may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be installed in advance in ROM 312 or storage unit 316.

[0327] In addition, the program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called.

[0328] The effects described herein are merely examples and are not limiting, and other effects may also be present.

[0329] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

[0330] For example, the present technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.

[0331] Furthermore, each step described in the above flow chart can be executed by one device, or can be shared and executed by a plurality of devices.

[0332] Furthermore, when a single step includes multiple processes, the multiple processes included in the single step can be executed by a single device, or can be shared and executed by multiple devices. [Explanation of symbols]

[0333] 1 Photo sticker creation device, 66 mirror surface section, 82 upper strobe unit, 91 camera, 92 touch panel monitor, 131 tablet built-in monitor, 301 PC section, 302 pre-selection section, 304 photography section, 305 editing section, 306 printing section, 401 pre-selection processing section, 402 photography processing section, 403 editing processing section, 404 printing processing section, 411 photography control section, 412 image processing section, 413 display control section, 414 image storage section, 431 selection reception section, 432 image generation section for editing, 433 editing control section, 434 display control section, 435 print data generation section, 436 communication control section, 451 area detection section, 452 retouch processing section, 453 gender determination section, 454 eyelash processing section, 455 Reduced section

Claims

1. A detection unit that detects the black eyes of a person appearing in a photographed image; an image processing unit that changes the color of the iris and the darkness of the iris in response to different operations by a user; An image processing device comprising:

2. The camera further includes a display control unit that displays a button for adjusting the color of the iris and a button for adjusting the darkness of the iris on the same screen as the captured image. The image processing device according to claim 1 .

3. The image processing unit changes the color of the iris of one of the people appearing in the photographed image, and changes the darkness of the iris of the eyes of all of the people.

3. The image processing device according to claim 1 or 2.

4. The image processing unit changes the darkness of the iris of one of the people appearing in the photographed image, and changes the color of the iris of all the people appearing in the photographed image at the same time.

3. The image processing device according to claim 1 or 2.

5. The image processing unit further changes the darkness of the eye contour. The image processing device according to claim 1 .

6. The image processing device Detects the pupils of people in the captured image, Change the color of the iris and the darkness of the iris border according to different user actions Image processing methods.

7. On the computer, Detects the pupils of people in the captured image, Change the color of the iris and the darkness of the iris border according to different user actions A program that executes a process.

Images