Game image photographing device

Abstract

To provide a technique capable of adjusting a degree of decoration of a user's face that is corrected in advance.SOLUTION: A game image photographing device has a photographing section for photographing a user, a face detection section for detecting a user's face included in a photographed image obtained by the photographing section, a face processing section for performing a prescribe retouch to a face, a display section for displaying a retouch adjustment screen including a photographed image subjected to a predetermined retouch, and a reception section for receiving a retouch adjustment instruction on a retouch adjustment screen, and stores a photographed image in a state before a predetermined retouch is performed. When receiving an instruction for thinning a retouch as a retouch adjustment instruction, the face processing section performs retouch processing that is thinner than a predetermined retouch instead of the predetermined retouch to a photographed image in a state before the predetermined retouch is performed.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to image processing of captured images, in particular to pre-correction. [Background technology]

[0002] A playful image capture device called Purikura (registered trademark) is extremely popular, especially among female high school students. Users take pictures of themselves and decorate the captured images in various ways on an editing display. The decorated images are then printed on sticker mounts (see Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-32213 [Patent Document 2] Japanese Patent Application Laid-Open No. 2016-184287 Summary of the Invention [Problem to be solved by the invention]

[0004] The entertainment image capture device decorates the captured image by, for example, modifying the face shape or applying makeup. It is common for the device to automatically apply light decorations to the user's face before the user applies the decorations themselves on the editing display. Hereinafter, this decoration is referred to as pre-editing.

[0005] In pre-retouching, the same processing is performed on the face of every user. However, some users feel that the level of decoration in pre-retouching is too strong. Also, there are some faces, such as men and children, for which makeup processing is not suitable. In the field of amusement image capture devices, pre-retouching, which is decoration on the face, is called "make-up."

[0006] The present invention was completed based on the above-mentioned problem recognition by the inventors, and its main purpose is to provide a technology for adjusting the degree of decoration on a user's face that has been pre-modified. [Means for solving the problem]

[0007] In one aspect of the present invention, a game image capture device has a capture unit that captures a user, a face detection unit that detects the user's face contained in the captured image obtained by the capture unit, a face processing unit that applies a predetermined enhancement to the face, a display unit that displays an enhancement adjustment screen including the captured image with the predetermined enhancement applied before displaying the editing screen, and a reception unit that receives enhancement adjustment instructions on the enhancement adjustment screen, and stores the captured image in its state before the predetermined enhancement is applied, and when an instruction to reduce the enhancement is received as an enhancement adjustment instruction, the face processing unit applies an enhancement process that is lighter than the predetermined enhancement to the captured image in its state before the predetermined enhancement is applied, instead of the predetermined enhancement. [Effects of the Invention]

[0008] According to the present invention, the degree of decoration of the pre-modified user's face can be adjusted. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating the overall configuration of a game image capturing system. [Figure 2] FIG. 2 is a perspective view of the appearance of the game image capturing device. [Figure 3] FIG. [Figure 4] 10 is a flowchart showing the flow of play in the game image capturing device. [Figure 5] FIG. 2 is a plan view of the game image capturing device seen from above. [Figure 6] FIG. 2 is a functional block diagram of the play image capturing device. [Figure 7] 10 is a flowchart showing the process of default embellishment processing. [Figure 8] FIG. 10 is a diagram showing a specific example of default embossing processing. [Figure 9] FIG. 10 is a diagram showing a portion adjustment screen. [Figure 10] 10 is a flowchart showing the process of a buildup adjustment process. [Figure 11] FIG. 10 is a diagram showing a specific example of a thinning process. [Figure 12] FIG. 10 is a diagram illustrating an editing screen. [Figure 13] FIG. 10 is a screen view of the lip palette. [Figure 14] 10A and 10B are diagrams showing a specific example of rip processing in the editing process. [Figure 15] FIG. 10 is a diagram showing a specific example of thickening processing. DETAILED DESCRIPTION OF THE INVENTION

[0010] The game image shooting device in this embodiment is equipped with a photo booth (photography space) and an editing booth (editing space). Users take photos of themselves in the photo booth. Hereinafter, images of the subject (user) taken in the photo booth will be referred to as "photographed images." Before editing, the game image shooting device applies image corrections to the photographed images, such as facial deformation processing, skin whitening, and makeup processing (hereinafter, such image corrections will be referred to as "pre-correction"). Pre-correction will be described in detail later. The game image shooting device in this embodiment takes not only still images but also moving images in the photo booth. Of the photographed images, those acquired as moving images will be referred to as "photographed moving images," and those acquired as still images will be referred to as "photographed still images." In this embodiment, a maximum of seven sets of photographed images (sets of photographed moving images and photographed still images) are acquired.

[0011] In this embodiment, the shooting space and the editing space are described as being separate spaces, but the shooting space and the editing space may be the same space. In this case, a predetermined space may be used as the shooting space during shooting and as the editing space during editing.

[0012] In the editing booth, operations and processing are performed on the captured images that have been previously retouched. In the editing booth, users can decorate the captured images as desired, such as by attaching stamp images or drawing with a stylus pen (hereinafter, such image decoration will be referred to as "editing"). A captured image that is the subject of editing in the editing booth will be called a "target image." Among the target images, a captured moving image that has been edited will be called a "target moving image," and a captured still image that has been edited will be called a "target still image." The target image after editing will be called an "edited image," and among the edited images, an edited target moving image will be called an "edited moving image," and an edited target still image will be called an "edited still image." In this embodiment, a maximum of seven sets of captured images are acquired, and therefore a maximum of seven sets of edited images (seven edited moving images and seven edited still images) will be generated.

[0013] The user selects a mount image that defines the layout and background of the edited still image. The user then composites the edited still image onto the selected mount image. Hereinafter, the final image obtained by embedding the edited still image into the mount image will be referred to as a "layout-completed image."

[0014] The game image capturing device prints the laid-out image onto a sticker mount (external medium). The game image capturing device also uploads edited moving images, edited still images, and laid-out images, which are images in which edited still images are embedded into mount images, to a server (external medium). Users can also download edited images, etc., by accessing the server from a user terminal such as a smartphone. As described above, the game image capturing device in this embodiment has a capturing function, an editing function, a printing function, and a communication function.

[0015] The user selects a "presentation mode" at the reception of the game image capture device. In this embodiment, the presentation modes are assumed to be "purple mode" and "pink mode." In purple mode, purple is the base color, and in pink mode, pink is the base color. The base color here refers to the color that should form the foundation of the overall image, such as the central color in lighting, or the color that occupies the widest area on the screen. The game image photographing device changes the photographing environment, editing environment, completed image, etc. according to the presentation mode, particularly the color associated with the presentation mode.

[0016] FIG. 1 is a diagram showing the overall configuration of a game image capturing system 200. As shown in FIG. In the game image capturing system 200, the game image capturing device 100 is connected to a server 202 and a user terminal 206 (mobile device) via the Internet 204. The user captures a picture of themselves using the game image capturing device 100. The game image capturing device 100 acquires a captured image including the subject (user), applies pre-editing to the captured image as necessary, and accepts editing by the user.

[0017] The edited image and the laid-out image after editing are uploaded to the server 202 together with the user ID from the game image capturing device 100. The server 202 stores the user ID, the capture date and time, the edited image (edited moving image and edited still image), and the laid-out image (a composite image of the edited still image and the mount image) in association with each other. The user can download the edited image, etc. from the server 202 by accessing the server 202 by specifying the user ID.

[0018] FIG. 2 is a perspective view of the appearance of the game image capturing device 100. As shown in FIG. The game image capturing device 100 comprises a reception device 102, a photo booth 104, an editing booth 106, and a printing device 110. A user reserves the use of the game image capturing device 100 at the reception device 102. The user enters a user ID at the reception device 102 and pays a play fee in cash or electronic money. The user selects a presentation mode (purple mode or pink mode) on the reception device 102.

[0019] A user takes a photograph in the photography booth 104. After the photograph is taken, the user moves to the editing booth 106. An editing device 126 is installed in the editing booth 106. The editing device 126 is equipped with an editing monitor 120. A target image (a photographed image to be edited) is displayed on the editing monitor 120. In this embodiment, the editing monitor 120 is formed by a capacitive touch panel. Two stylus pens 122a and 122b are provided for one editing monitor 120. The user performs editing operations on the target image using the stylus pen 122 and their fingers. After editing is completed, the printing device 110 prints the laid-out image on a sticker mount. The editing device 126 also uploads the edited image and the like to the server 202.

[0020] FIG. 3 is a perspective view of the exterior of the photo booth 104. As shown in FIG. The photo booth 104 is shielded from the outside by a curtain 124. A photo taking device 128 is installed in the photo booth 104. The photo taking device 128 includes three lights 116 that illuminate the subject user from three directions, a camera 118 for capturing still images and moving images, a first photo taking monitor 112, and a second photo taking monitor 114.

[0021] In addition, lighting devices are embedded in the ceiling and floor surfaces. The lighting means, light 116, and ceiling and floor lights (not shown), all include R (red), G (green), B (blue), etc. For example, these lighting devices include full-color LEDs (Light Emitting Diodes) and white LEDs. Hereinafter, these three types of lighting devices will be collectively referred to as the "light group." The full-color LEDs can be illuminated with a base color specified by the performance mode. Hereafter, the purple (purple mode) light and pink (pink mode) light that can be set in a full-color LED will be referred to as "colored light."

[0022] The first photographing monitor 112 displays a preview of the user's photographed images (photographed moving images and photographed still images). The second photographing monitor 114 displays photographed images (hereinafter referred to as "sample images") of a person other than the user who is the subject, for example, a model. The user strikes any pose for photography in front of the camera 118 while referring to the sample images displayed on the second photographing monitor 114. Various explanations regarding photographing methods are also displayed on the second photographing monitor 114. As described above, photographed moving images and photographed still images can be acquired in the photographing booth 104. Note that full-color lighting (not shown) that imitates so-called "actress lights" may be provided around the first photographing monitor 112 and the second photographing monitor 114.

[0023] Furthermore, the first capture monitor 112 displays a live view image (full-length mirror image) that allows the user to check his or her own appearance, as well as a countdown image that indicates the timing of capture.

[0024] Fig. 4 is a flowchart showing the flow of play in the game image capturing device 100. Fig. 5 is a plan view of the game image capturing device 100 as seen from above. When a user makes a reservation for use at the reception device 102, the reception device 102 executes reception processing (S10). When receiving the reservation, the user also selects a performance mode. After receiving the reservation, the user enters the photo booth 104. At this time, the light group illuminates the photo booth 104 with colored light based on the color corresponding to the selected performance mode. For example, when the purple mode is selected, the light group illuminates the photo booth 104 with pale purple light. When the pink mode is selected, the photo booth 104 is filled with pale pink light.

[0025] The photographing device 128 acquires photographed images of the user (S12). In the photographing booth 104, the user can acquire a predetermined number of photographed images. Photographed moving images and photographed still images are acquired simultaneously, and a pair of a photographed moving image and a photographed still image is counted as one set of photographed images. In this embodiment, seven sets of photographed images (sets of photographed moving images and photographed still images) are acquired.

[0026] Next, a pre-correction process is performed on the captured image. In this embodiment, the pre-correction process is divided into two stages: a default enhancement process (S13) and an enhancement adjustment process (S14). The photographing device 128 performs the default enhancement process on the photographed image obtained by the photographing device 128 (S13). The photographing device 128 performs the default enhancement process each time it acquires a photographed image. In the default enhancement process, facial decoration is performed according to predefined content. The default enhancement process will be described in detail later. Thereafter, before starting the editing process, an enhancement adjustment process is performed to adjust the degree of facial decoration by the default enhancement process (S14). In this embodiment, an example will be described in which a user operation related to enhancement adjustment is performed in the editing booth 106.

[0027] After shooting, instruction information instructing one of the two editing booths 106 is displayed on the first shooting monitor 112. The user moves to the editing booth 106 specified by the first shooting monitor 112, out of the two editing booths 106a and 106b. The shot image with default enhancement applied is transferred from the shooting device 128 to the editing device 126. An enhancement adjustment process (S14) is performed before the editing process (S15). Therefore, an enhancement adjustment screen is displayed before the editing screen is displayed on the editing device 126. The enhancement adjustment screen includes the shot image with default enhancement applied. If the user thinks that the default enhancement is too strong, that is, the degree of facial decoration is too strong, the user can select a face and instruct the editing device 126 to reduce the degree of facial decoration. The editing device 126 performs a process to reduce the degree of facial decoration so that the selected face appears less emphasized. The user is free to decide whether to reduce the enhancement.

[0028] After the enhancement adjustment process, the user edits the captured image (target image) in the editing device 126 (S15). The target image may remain at the default enhancement level, or may have its enhancement level reduced by enhancement adjustment. The user selects a mount image and creates a laid-out image by laying out the edited image on the mount image.

[0029] After editing, the editing device 126 sends the laid-out image to the printing device 110, which then prints the laid-out image on a sticker mount (S16). The editing device 126 also uploads the edited image and the laid-out image to the server 202 via the Internet 204 (S18). By accessing the server 202, the user can download the edited image, etc. from the server 202 to the user terminal 206.

[0030] Generally, editing takes more time than photographing. In the game image photographing device 100 of this embodiment, two editing booths 106a, 106b (editing devices 126a, 126b) are provided for one photographing booth 104, thereby increasing customer turnover. In this embodiment, the enhancement adjustment process (S14) is performed in the two editing booths 106a, 106b, which distributes the enhancement adjustment operation and smooths the flow of customers.

[0031] FIG. 6 is a functional block diagram of the play image capturing device 100. As shown in FIG. Each component of the game image capture device 100 is realized by hardware including computing units such as a CPU (Central Processing Unit) and various co-processors, storage devices such as memory and storage, and wired or wireless communication lines connecting them, as well as software stored in the storage devices that supplies processing instructions to the computing units. The computer program may be composed of device drivers, an operating system, various application programs located at higher layers than these, and libraries that provide common functions to these programs. As described above, the game image capture device 100 is configured as a collection of the capture device 128, the reception device 102, the editing device 126, and the printing device 110. Each block described below represents a functional block, not a hardware configuration.

[0032] The game image capture device 100 includes a user interface processor 130, a data processor 132, a communication unit 134, and a data storage unit 136. As described above, the game image capture device 100 also includes a camera 118 and a light group 210. The user interface processing unit 130 is responsible for user interface processing via the reception monitor 108, editing monitor 120, etc. The communication unit 134 is responsible for communication processing with the server 202 via the Internet 204. The communication unit 134 can also communicate directly with the user terminal 206 via short-range wireless communication such as Wi-Fi (registered trademark). For example, the communication unit 134 may directly transmit an edited image to the user terminal 206. The data storage unit 136 stores various data. The data processing unit 132 performs various processes based on the data acquired by the communication unit 134 and the data stored in the data storage unit 136.

[0033] The user interface processing unit 130 includes an input unit 140 that accepts operation inputs from the user, and an output unit 142 that presents information to the user.

[0034] The input unit 140 detects user operation inputs on touch panels installed in the reception device 102, the photographing device 128, the editing device 126, etc. The input unit 140 also detects operation inputs using the stylus pen 122. The input unit 140 includes a reception unit 401. The reception unit 401 receives various user operations. For example, the reception unit 401 receives an instruction for height adjustment on an enhancement adjustment screen displayed on the editing monitor 120 of the editing device 126. Specifically, the reception unit 401 receives selection of a target face as a face to be subjected to height adjustment, an instruction to reduce the height, and the like. The reception unit 401 also receives editing operations on a target image on the editing screen displayed on the editing monitor 120 of the editing device 126. The input unit 140 also detects a user ID on the reception device 102.

[0035] The output unit 142 executes various output processes such as image display on the reception device 102, the photographing device 128, the editing device 126, etc., as well as audio output and print output.

[0036] The output unit 142 includes a pause instruction unit 212 , a performance output unit 214 , an audio output unit 216 , and a display processing unit 403 . The pose instruction unit 212 selects a pose to be instructed to the user in the sample image. The performance output unit 214 displays various performance screens, such as sample images, on the second shooting monitor 114 or the first shooting monitor 112. The audio output unit 216 outputs audio and music. The display processing unit 403 displays various screens on the editing monitor 120 of the editing device 126. For example, before displaying the editing screen, the display processing unit 403 displays an enhancement adjustment screen including a photographed image to which default enhancement has been applied on the editing monitor 120. Furthermore, the display processing unit 403 displays a target image (a photographed image to which default enhancement has been applied or a photographed image to which enhancement has been reduced) on the editing monitor 120.

[0037] Additionally, during shooting, the output unit 142 displays a live view image (full-length mirror image) of the user (subject) on the first shooting monitor 112. The user performs shooting while checking their own image in the live view image as if they were looking at a mirror. Also, immediately after shooting, the output unit 142 displays a preview of the shot still image on the first shooting monitor 112.

[0038] The data processing unit 132 includes an illumination control unit 218 , a photography processing unit 144 , a pre-correction unit 145 , an edit processing unit 146 , a reception processing unit 148 , and a print processing unit 150 . The lighting control unit 218 controls the light group 210. Specifically, the lighting control unit 218 controls lighting settings such as turning on / off, light intensity, and color of the light group 210.

[0039] The photography processing unit 144 controls the photography processing in the photography booth 104. If the photography timing is time tX, the photography processing unit 144 records a video from 1.5 seconds before time tX to 0.1 seconds before time tX (hereinafter referred to as the "first half video"), acquires a photographed still image at time tX, and again records a video from 0.1 seconds after time tX to 1.5 seconds after time tX (hereinafter referred to as the "second half video"). The photography processing unit 144 generates a photographed video by connecting the first half video and the second half video. The photography processing unit 144 controls the camera 118 by sending a photography start instruction and a photography stop instruction to the camera 118. The photography processing unit 144 also fires a strobe (not shown) when acquiring a photographed still image. The photographed video does not include a video during the acquisition period of the photographed still image, in other words, a video when the strobe is fired, so the strobe light is not captured.

[0040] The shooting processing unit 144 can also acquire a captured video before the time tX of the shooting timing according to the user's selection, and acquire a captured still image immediately after acquiring the captured video.

[0041] The photography processing unit 144 includes a photography guidance unit 220. The photography guidance unit 220 notifies the user of the photography timing by instructing the output unit 142 to display a countdown and notify by voice.

[0042] The pre-correction unit 145 executes a process of applying pre-correction to each captured image. The pre-correction unit 145 includes a face detection unit 411 and a face processing unit 413. The face detection unit 411 detects the user's face included in the captured image obtained by the camera 118 (an example of a photographing unit). The face processing unit 413 processes the user's face included in the captured image. Specifically, the face processing unit 413 applies a predetermined enhancement to the user's face in default enhancement processing, and adjusts the predetermined enhancement in enhancement adjustment processing.

[0043] The output unit 142 displays the photographed image as a target image on the editing monitor 120 (capacitive touch panel). The editing processing unit 146 edits the target image in accordance with operational input from the user. The reception processing unit 148 manages the payment of play fees by users at the reception device 102. The reception processing unit 148 also accepts the selection of a performance mode by the user. The reception processing unit 148 guides users who have made reservations to the photo booth 104 every time a photo shoot is completed in the photo booth 104. The print processing unit 150 controls the printing of the edited image on the printing device 110.

[0044] The communication unit 134 includes a receiving unit 230 that receives data and a transmitting unit 232 that transmits data.

[0045] The data storage unit 136 includes a captured image storage unit 421 and a pre-corrected image storage unit 423 . The photographed image storage unit 421 stores images photographed in the photography booth 104, that is, photographed images that have not been pre-corrected. Specifically, seven sets of photographed images (photographed still images and photographed moving images) are stored. The pre-corrected image storage unit 423 stores pre-corrected photographed images. When the default enhancement processing is performed, the pre-corrected image storage unit 423 stores the photographed images that have been subjected to default enhancement. Thereafter, when the enhancement adjustment processing is performed, the pre-corrected image storage unit 423 additionally stores the enhanced photographed images.

[0046] This embodiment relates primarily to "enhancement" processing, which is performed in advance. In addition to "enhancement," background processing is also performed. "Enhancement" refers to user decorations included in a captured image. Most enhancement processing involves facial decoration. Enhancement processing includes decorations that mimic makeup, such as lipstick, blush, and eye shadow, as well as facial deformation. Facial deformation includes, for example, contour deformation, such as reducing cheek volume and sharpening facial lines, as well as image processing that changes the size and shape of facial features, such as making eyes larger and more open or sharpening the nose. Head processing, such as changing the shape of hair (hairstyle), is also performed. Decorations that mimic makeup may also include smoothing processing to smooth the surface of skin and lips, whitening processing to make skin paler, and base processing, such as changing the color and luster of hair. Base processing corresponds to applying concealer, foundation, hair styling products, hair color, etc. in actual makeup.

[0047] The default enhancement process and enhancement adjustment process will be described in detail below. Default enhancement process uses predetermined initial values ​​for variables in the enhancement process. Examples of variables in the enhancement process include a value (reduction rate) indicating the degree to which cheek bulges are reduced, a value (magnification rate) indicating the degree to which eyes are enlarged, the transmittance of white color applied for whitening, the type of lipstick color, and the type of blush. Default enhancement process, for example, sharpens the face line at a predetermined reduction rate, enlarges the eyes at a predetermined magnification rate, applies white color to the skin area at a predetermined transmittance, applies a predetermined lipstick color to the lips, and applies a predetermined cheek color to the cheeks. Furthermore, default enhancement process performs internal processing using a predetermined method for internal processing (e.g., image processing filters) that has multiple changeable methods. An example of internal processing that has multiple changeable methods is smoothing process. Known filters that perform smoothing process include smoothing filters such as moving average filters, Gaussian filters, median filters, and bilateral filters. A preselected smoothing filter is used to smooth the surface of the skin or lips. In this way, default enhancement processing includes facial deformation processing and makeup processing. Furthermore, since the variables and methods used in the processing are predetermined, the default enhancement processing can be said to be a predetermined enhancement processing. Note that the smoothing processing is not limited to the above-mentioned filter examples, and any processing that smooths color tone changes in the skin area, etc. may be used.

[0048] The "embellishment" is applied not only to a captured still image but also to a captured moving image. In this embodiment, a captured still image will be used as an example. Therefore, the various captured images referred to below are exemplified as still images.

[0049] FIG. 7 is a flowchart showing the process of default embellishment. The default enhancement processing is performed on all captured images. Here, the default enhancement processing for one captured image will be explained. In reality, the same processing is performed on seven captured images. Below, the captured image obtained by camera 118 (an example of a photographing unit) will be referred to as the "original captured image" to distinguish it from the processed captured image.

[0050] The original captured image contains one or more facial images. In this example, the original captured image contains facial images of user A and user B. The default enhancement process is performed on the faces of all users.

[0051] First, the face detection unit 411 detects all faces included in the original photographed image (S20). The technique for detecting faces included in the image may be the same as that of the conventional technique.

[0052] The face processing unit 413 performs the following process on each detected face (S22). The face processing unit 413 performs face deformation processing on the image of the face detected in the original captured image (S24). As described above, face deformation processing includes processing such as sharpening the facial lines and enlarging the eyes. Enlarging the eyes does not simply enlarge the image of the eyes, but may also change the shape of the eyes to make them larger and more open. In other words, processing may not only enlarge the pupils, but also change the shape of the eyelids to make the eyes appear wider open, or increase or lengthen the eyelashes.

[0053] Next, the face processing unit 413 applies makeup processing to the transformed facial image (S26). Specifically, first, base processing, such as smoothing processing on the skin and lip areas and whitening processing on the skin area, is performed. Then, lip processing, which applies lipstick color to the lip area, and blush processing, which applies cheek color to the cheekbone area, are performed. However, if the degree of smoothing or whitening is too strong, the three-dimensional effect will be lost and the image will appear flat. Furthermore, if the transmittance when applying the lipstick and blush is too low, the three-dimensional effect of the lips and cheeks will be diminished. Therefore, it is desirable to determine the variables (transmittance, type of lipstick color, type of blush color, etc.) and methods (type of filter, etc.) for each processing step so that the final three-dimensional effect is not diminished and roughness and wrinkles are hidden by combining the base processing, lip processing, and blush processing. The lipstick color and blush color used in the default enhancement processing are examples of the "first cosmetic color used in the specified enhancement."

[0054] If there are any facial images that have not yet been processed (N in S28), the process returns to S22, and the face processing unit 413 performs the above-described processing on the remaining facial images. When the face deformation processing and makeup processing have been performed on all facial images (Y in S28), the default enhancement processing ends. The captured image that has undergone the default enhancement processing is stored in the pre-correction image storage unit 423.

[0055] FIG. 8 is a diagram showing a specific example of default embossing. In this example, the faces of user A and user B are detected from the original captured image 601, and a default enhancement process is applied to both of them. The image of the face detected in the original captured image 601 is called the "original face image" to distinguish it from the face image after processing. In this figure, the face image of user A is used as an example for explanation. Hereinafter, the face image of user A included in the original captured image 601 is referred to as the "original face image 501a."

[0056] A facial image obtained after facial deformation processing has been performed on an original facial image is called a "deformed facial image." This figure shows a deformed facial image 503a obtained after facial deformation processing has been performed on an original facial image 501a. In the deformed facial image 503a, user A's facial lines are sharper and his eyes are larger and brighter than in the original facial image 501a. At this stage, the skin and lips remain natural, just like in the original facial image 501a. Although not shown, in the deformed facial image of user B, user B's facial lines are similarly sharper and his eyes are larger and brighter.

[0057] After this, makeup processing is performed, and the default enhancement processing is completed. The face image after makeup processing has been performed on the transformed face image is called the "default enhancement face image." In the default enhancement processing, as described above, smoothing processing is first performed on the skin region and lip region, and whitening processing is performed on the skin region. Next, lip processing and cheek processing are performed. In this example, lip processing and cheek processing are performed together, but they may also be performed separately.

[0058] As the first step in the lip enhancement process in the default enhancement process, user A's lip area is detected from the deformed face image 503a. Next, a default lip image 505a for user A is generated to apply lipstick color to the same area as the lip area. The lipstick color used in the default enhancement process is called the "default lipstick color." The default lipstick color is a standard lipstick color (e.g., pink) that is easily accepted by teenage girls, who are the main users of Purikura. It is desirable that the default lipstick color is a color that does not easily become muddy when layered with lipstick colors that are blended later. Pink is suitable as a default lipstick color because it does not easily become muddy even when lipstick colors such as red or orange are layered on top of it later. As mentioned above, the default lipstick color is an example of a "first cosmetic color used in a predetermined enhancement process."

[0059] In default lip image 505a, the portion that overlaps with user A's lip area in transformed face image 503a is occupied by the default lipstick color and has a semi-transparent attribute. The semi-transparent transmittance is, for example, 20% to 80%. The portion that does not overlap with user A's lip area, that is, the portion that does not have the default lipstick color, has a transparent attribute (transmittance: 100%). Similarly, a lip area is detected from user B's transformed face image, and a default lip image for user B is generated with the same default lipstick color applied to the area that overlaps with user B's lip area.

[0060] As the first step in the blush processing in the default enhancement process, the area around user A's cheekbones is detected from the deformed face image 503a. The area around the cheekbones corresponds to the area where blush is applied in actual makeup. Next, a default blush image 507a for user A is generated to apply blush to the same area as the area around the cheekbones. The blush color used in the default enhancement process is called the "default blush color." The default blush color is a standard blush color (e.g., pink) that is easily accepted by teenage girls, who are the main user group of Purikura. It is desirable that the default blush color is a color that does not easily become muddy when layered with a blush color that will be blended later. Pink is suitable as a default blush color because it does not easily become muddy even when blush colors such as red or orange are layered on top of it later. As described above, the default blush color is an example of a "first makeup color used in a predetermined enhancement process."

[0061] In default cheek image 507a, the portion that overlaps with the area around user A's cheekbones in deformed face image 503a is occupied by a default blush and has a semi-transparent attribute. The semi-transparent transmittance is, for example, 20% to 80%. The portion that does not overlap with the area around user A's cheekbones, that is, the portion that is not given the default blush, has a transparent attribute (transmittance: 100%). Similarly, the area around the cheekbones is also detected from user B's deformed face image, and a default cheek image for user B is generated with the same default blush applied to the area that overlaps with user B's area around the cheekbones.

[0062] The default blush color may be the same color as the default lipstick color, or may be a different color. The default blush color and the default lipstick color may be different colors in the same family (for example, pink). If they are in the same family, it is easier to create a sense of unity in the makeup. The default blush color and the default lipstick color may be different families (for example, pink and orange). If they are different families, it is easier to add variety to the makeup.

[0063] In default enhancement processing, image composition for lip processing and image composition for cheek processing are performed together. A default lip image 505a for user A and a default cheek image 507a for user A are overlaid on a deformed face image 503a of user A to obtain a default enhancement face image 509a of user A. In the lip region of the default enhancement face image 509a, a default lipstick color is overlaid on the lip base, and in the cheekbone region, a default blush color is overlaid on the base around the cheekbone, so this is indicated as "base + default makeup color" in the figure. As shown in the figure, the default lip image 505a corresponds to the top layer, the default cheek image 507a corresponds to the middle layer, and the deformed face image 503a corresponds to the bottom layer. These three layers are composited. The layer composition processing method may be the same as in the prior art. The order of the default lip image 505a and the default cheek image 507a may be reversed. Since the lip area and the cheekbone area are separated, the default lip image 505a and default cheek image 507a may be combined into one layer. Similarly, the default lip image and default cheek image for user B are superimposed on the deformed face image of user B to obtain a default enhanced face image of user B.

[0064] The final captured image obtained by the default enhancement process, that is, the full-size captured image in which the default enhancement process has been applied to the faces of all users, is called the "default enhancement captured image 609." The default enhancement captured image 609 includes the default enhancement face image 509a of user A and the default enhancement face image of user B. There is more than one procedure for including the default enhancement face images in the default enhancement captured image 609. One possible method is to perform face image composition separately from the entire captured image, and then later paste the default enhancement face image 509a of user A and the default enhancement face image of user B onto the original captured image 601. Alternatively, a full-size captured image including the facial deformation image 503a of user A and the facial deformation image of user B may be generated, and the default lip images and default cheek images of user A and user B may be composited together with this captured image. The default lip images of user A and user B may be combined on the same layer, or the default cheek images of user A and user B may be combined on the same layer. As a result, if the same default-exaggerated photographed image 609 as in this example is synthesized, the layer configuration and synthesis procedure in the process do not have to be the same as in this example.

[0065] A default enhancement captured image 609, in which default enhancement processing has been applied to both the facial image of user A and the facial image of user B, is stored in the pre-correction image storage unit 423. Here, an example has been shown in which default enhancement processing is applied to a captured still image, but default enhancement processing may also be applied to a captured video. The default enhancement processing for a captured video may be performed to a lesser degree than that for a captured still image. In other words, the degree of facial deformation for a captured video may be less than that for face deformation processing for a captured still image. Furthermore, the saturation and brightness of lipstick and blush may be lower for a captured video than in makeup processing for a captured still image.

[0066] The default enhancement process explained so far is performed automatically and does not require any user intervention. The results of the default enhancement process can be viewed on the enhancement adjustment screen.

[0067] FIG. 9 is a diagram showing the fill adjustment screen. When the user has finished shooting and moves to the editing booth 106, a boost adjustment screen is displayed on the editing monitor 120 of the editing device 126. That is, before the editing screen is displayed, the boost adjustment screen and a captured image display area (not shown) are displayed simultaneously. The captured image display area displays the captured image that has been subjected to default boost processing (default boost captured image 609), allowing the user to check the user's facial image with the default boost. If the user thinks that the default boost is too strong, the user can issue an instruction to reduce the default boost by operating the boost adjustment screen.

[0068] Let us now consider the intention behind a user wanting to lighten their makeup. Lightening their makeup certainly means wanting to eliminate excessive makeup. However, this does not mean applying only a small amount of lipstick or blush. To create the impression of applying only a small amount of lipstick or blush, a makeup editor would increase the transmittance of the lipstick color in a lip image, or increase the transmittance of the blush color in a cheek image. Doing so would reveal a face with a base effect, defeating the purpose of creating a sense of makeup. Lightening your makeup does not mean reducing the makeup itself, but rather making the makeup color less noticeable. In other words, for a user who wants to lighten their makeup, the correct approach is to change the makeup colors, such as lipstick and blush, to more subdued colors, rather than increasing the transmittance of the lipstick and blush. The process of changing lipstick and blush to more subdued colors will be described later in relation to FIG. 11.

[0069] A photographed image that has been subjected to default enhancement processing is displayed in the face selection receiving image area 701. The user selects a face on the photographed image displayed in the face selection receiving image area 701 that is to be subjected to enhancement adjustment.

[0070] Face frames 703 are displayed to surround faces included in the captured image in the face selection reception image area 701. In this example, face frame 703a is attached to the face of user A, and face frame 703b is attached to the face of user B.

[0071] When user A wants to reduce the amount of enhancement on his or her face, he or she touches his or her face with the stylus pen 122 or a finger. When the inside of the face frame 703a is touched, user A's face is selected. The face frame 703a of the selected user turns a darker color, making it possible to know which user is selected. The selected face frame 703 may be identified by highlighting other than by making the color darker, for example by making the line thicker. The selected face is the target for enhancement adjustment. In other words, the enhancement adjustment screen accepts the selection of a target face as the face to be subjected to enhancement adjustment.

[0072] Next, user A touches the thinning button 705 with the stylus pen 122 or a finger. This operation can thin the makeup of user A's face. The process of thinning the makeup is called "thinning process." Thinning process is a process of changing makeup colors such as lipstick and blush to more subdued colors. User A's face with thinned makeup is displayed in the captured image display area. The face to be thinned does not have to be the user's own face. In other words, a face other than the user's own may be selected. Touching the thinning button 705 is an example of an instruction to adjust makeup. Thinning the makeup of a selected face is an example of makeup adjustment for a selected face.

[0073] If user A wants to restore the original height that has been reduced, he or she touches his or her own face with the stylus pen 122 or a finger, and then touches the restore button 707. This operation returns user A's face to the default height. User A's restored face is displayed in the captured image display area. The same applies to faces other than his or her own.

[0074] The thickness of the highlights can be reduced not only for one person, but also for multiple people. The operation of reducing the thickness of the highlights can be repeated one by one, or the thickness of multiple people can be reduced all at once. If multiple faces are touched in the face selection reception image area 701 to select multiple faces and then the reduce thickness button 705 is touched, the thickness reduction process is applied to the selected multiple faces. Also, if multiple faces are touched in the face selection reception image area 701 to select multiple faces and then the undo button 707 is touched, then the thickness reduction process is cancelled for the selected multiple faces. Of course, the thickness of all faces can be reduced. Alternatively, all faces can remain at the default thickness.

[0075] When the user touches the Confirm button 709, the specified thinning of the enhancement is confirmed. The thinning of the enhancement is applied only to the captured images displayed in the captured image display area and the face selection receiving image area 701. However, the thinning of the enhancement may also be applied to captured images not displayed in the captured image display area and the face selection receiving image area 701. For example, if the enhancement of user A is thinned in the first captured image displayed in the captured image display area and the face selection receiving image area 701, the enhancement of user A's face may be thinned not only in the first captured image but also in the second to seventh captured images. In this case, the face processing unit 413 identifies the face of the same user that is the target of enhancement adjustment by face recognition and performs the enhancement adjustment process on the same user's face in the same way. Alternatively, the Confirm button 709 may not be provided, and the thinning of the enhancement may be confirmed when the enhancement adjustment screen is cleared or when the captured image displayed on the enhancement adjustment screen is switched.

[0076] When user A and user B are shown in the image as in this example, there are four possible patterns for the captured image obtained when the enhancement adjustment screen is completed. First, a pattern in which both user A and user B remain with the default enhancement processing is possible. This pattern of the captured image is the image obtained when the default enhancement captured image 609 ( FIG. 8 ) initially displayed in the captured image display area and face selection receiving image area 701 is confirmed without any changes. Next, a pattern in which only user A reduces the enhancement processing, while user B remains with the default enhancement processing is possible. Conversely, a pattern in which user A remains with the default enhancement processing, while only user B reduces the enhancement processing is possible. Furthermore, a pattern in which both user A and user B reduce the enhancement processing is also possible. In this way, the captured image whose enhancement level has been adjusted according to the user's preference is the target for editing in the next editing process. The editing screen displays seven captured images with the enhancement level adjusted to the user's preference. Note that patterns other than the default enhancement captured image 609 are called "adjusted enhancement captured images" because at least one user's enhancement has been adjusted.

[0077] In this way, if a user feels that the default makeup is too strong, they can tone it down. For example, if a user does not like flashy makeup, they can change it to a more subdued look by toneing down the makeup on their face. Many women do not personally like flashy clothing, but still enjoy wearing makeup. There are many reasons why people prefer subdued makeup, such as feeling that flashy makeup does not balance well with the clothes they are wearing, or that they have a baby face and wearing flashy makeup makes them look like they are trying to act older than they are. Also, for children and men, wearing makeup itself can look unnatural. In such cases, toneing down the makeup can restore a natural look.

[0078] The technology can be applied not only to living human faces but also to printed facial images. For example, a female user may take a printed facial image and include a fan with a photo of her favorite male celebrity attached to it. In this case, not only the female user's face but also the face of the male celebrity in the photo attached to the front of the fan will be made up. A female user can also use the technology to lighten the makeup on the male celebrity to remove his makeup. While taking a photo booth photo with a favorite male celebrity, if the male celebrity still wears makeup, it will not feel like the photo was taken with the usual male celebrity, which can leave the user dissatisfied. Therefore, a function to tone down the makeup on printed facial images is important. In this embodiment, the makeup can be selected for each face and lightened, allowing for flexible adjustment of the makeup to suit each situation, as described above.

[0079] FIG. 10 is a flowchart showing the process of the build-up adjustment process. 9 on the editing monitor 120. At this time, the display processing unit 403 reads the default enhancement photographed image 609 stored in the pre-correction image storage unit 423, and displays the default enhancement photographed image 609 in the face selection receiving image area 701 on the enhancement adjustment screen (S40). The display processing unit 403 attaches a face frame 703 to the image of each face detected by the face detection unit 411.

[0080] When the receiving unit 401 receives the selection of a face by touching within the face frame 703 and the touch of the thinning button 705 (an instruction to thin the height) (S42), the face processing unit 413 applies thinning processing to the selected face (S44). Thinning processing will be described later with reference to FIG. 11. In this way, the receiving unit 401 receives the selection of a target face as a face to be subjected to height adjustment and an instruction for height adjustment on the height adjustment screen. Note that if thinning processing has already been applied to the selected face, no further processing is performed and the face is left as is. Then, returning to S40, the display processing unit 403 displays the height-adjusted captured image to which thinning processing has been applied in the face selection receiving image area 701 on the height adjustment screen.

[0081] When the receiving unit 401 receives a touch within the face frame 703 to select a face and a touch on the undo button 707 (an instruction to cancel the thinning of the enhancement process) (Y in S46), the face processing unit 413 cancels the thinning of the enhancement process of the selected face (S48). That is, it returns to the default enhancement face image. Note that if thinning of the enhancement process has not been performed on the selected face, no particular processing is performed and the face is left as is. Then, the process returns to S40, and the captured image from which the thinning of the enhancement process has been canceled is displayed on the enhancement adjustment screen. If thinning of the enhancement process has not been performed on any of the faces, the default enhancement captured image 609 is displayed in the face selection receiving image area 701 on the enhancement adjustment screen. If thinning of the enhancement process has been performed on any of the faces, the enhanced adjusted captured image is displayed in the face selection receiving image area 701 on the enhancement adjustment screen.

[0082] When the reception unit 401 receives a touch on the Confirm button 709 (S50), the pre-correction process (FIG. 4) is completed, and the face processing unit 413 confirms the pre-corrected photographed image (S52). The face processing unit 413 adds the enhancement-adjusted photographed image displayed in the photographed image display area 701 at the time the Confirm button 709 is touched to the pre-corrected image storage unit 423 for storage. The default enhancement image is left as is, as it will be used in later editing processes. If the enhancement-thinning process has not been performed, the image is not added to the pre-corrected image storage unit 423. The pre-corrected photographed image may be confirmed when a predetermined time has elapsed since the enhancement adjustment screen was displayed, in the same way as when the Confirm button 709 was touched.

[0083] The face processing unit 413 also applies the enhancement thinning process to the remaining photographed images that are not displayed in the photographed image display area 701. That is, the face processing unit 413 recognizes the face of the same person as the face of the user who is the target of the enhancement thinning process in each photographed image, and applies the enhancement thinning process to that face. All of the enhancement-adjusted photographed images from the first to the seventh are stored in the pre-correction image storage unit 423. If no one has thinned the enhancement, all of the default enhancement photographed images 609 from the first to the seventh are stored in the pre-correction image storage unit 423.

[0084] FIG. 11 is a diagram showing a specific example of the build-up thinning process. In this example, it is assumed that the face of user A is selected on the enhancement adjustment screen (FIG. 9), and the thinning button 705 is touched to apply thinning makeup to user A's face. The thinning makeup process is performed on the default enhanced photographed image 609. The process is not redone on the original photographed image 601. The default enhanced photographed image 609, which already has default lipstick and blush added, is thinned by adding a more subdued lipstick and blush.

[0085] A muted lipstick color and a muted blush are examples of "a second makeup color different from the first makeup color used in a specified buildup (default buildup processing)." In this example, both the muted lipstick color and the muted blush are beige. A muted lipstick color is a color that is evaluated as more muted than the default lipstick color (pink in this example) in sensory evaluations of lipstick colors in the cosmetics industry. You can make your judgment by referring to literature and advertisements in the cosmetics industry. Generally, lipstick colors that are close to skin tones are considered to be muted lipstick colors. This is because the color difference between the lipstick and the skin around it is smaller.

[0086] "Skin color" here refers to a type of color specified as a color, for example, in the JIS common color name. It is a color that is defined as a color, not a color that is influenced by individual differences or race. Skin color can be specified by the luminance composition indicated by the three RGB primary colors in the RGB color model. By comparing the luminance composition indicated by the three primary colors, a color that has a composition similar to the luminance composition indicated by the three primary colors of skin color can be said to be a color close to skin color. Color differences can be determined using conventional methods in color science, or by sensory evaluation. Sensory evaluation is performed by an evaluator (called a "panel"), and the evaluation method can be an existing method based on ISO (International Organization for Standardization) standards, etc. In this example, beige has a yellowish tinge, so it is closer to skin color than pink.

[0087] The same is true for blush. A subdued blush is a color that is evaluated as more subdued than the default blush (pink in this example) in sensory evaluations of blush in the cosmetics industry. Generally, a blush that is close to the skin color is considered to be subdued as a blush. This is because the difference in color between the blush and the skin surrounding it is smaller. Evaluation of blush is done in the same way as with lipstick color.

[0088] The subdued lipstick color and the subdued blush color may be the same color or different colors. The subdued blush color and the subdued lipstick color may be different colors in the same family (for example, beige). If they are in the same family, it is easy to create a sense of unity in the makeup. The subdued blush color and the subdued lipstick color may be different family colors (for example, beige and yellow). If they are different family colors, it is easy to add variety to the makeup.

[0089] Here, a typical Japanese person is assumed as the user model. For a user whose skin color differs from that of a typical Japanese person, the default lipstick color, default blush, muted lipstick color, and muted blush may be set to colors different from those in the above example. The face processing unit 413 may determine the user's actual skin color from the captured image and determine the default lipstick color, default blush, muted lipstick color, and muted blush according to the actual skin color. The face processing unit 413 may use makeup color data that corresponds to a sample color of skin color and defines default lipstick color, default blush, muted lipstick color, and muted blush appropriate for the sample color to identify default lipstick color, default blush, muted lipstick color, and muted blush appropriate for the actual skin color of each user appearing in the captured image. Even among Japanese people, individual differences exist, and actual skin color varies from person to person. Skin color also varies depending on factors such as the degree of tanning. Therefore, it is considered that the suitable default lipstick color, default blush color, modest lipstick color, and modest blush color differ for each user. In order to use a default lipstick color, default blush color, modest lipstick color, and modest blush color that is more suitable for each user, it is meaningful to use a default lipstick color, default blush color, modest lipstick color, and modest blush color that matches the actual skin color of the individual.

[0090] In the thinning-up process, only the makeup is applied, and no processing is done on the face shape. The face shape in the default face image 509a is left as it is. In other words, whether thinning-up is performed or not, the face shape, such as the sharpened face line and enlarged eyes, achieved by the face deformation processing of the default face enhancement process, remains the same. If the face deformation is not performed in the thinning-up process, the atmosphere of the face shape is unified and balanced between users who have thinned the makeup and users who have not thinned the makeup.

[0091] As the first step in lip processing in the lightening process, user A's lip area is detected from the transformed face image 503a. Next, a subtle lip image 511a for user A is generated for applying lipstick color to the same area as the lip area. In the lightening process, the above-mentioned subtle lipstick color (for example, beige) is used. It is desirable that the subtle lipstick color is a color that does not easily become cloudy when layered over a default lipstick color. Beige is suitable for a subtle lipstick color because it does not easily become cloudy when layered over lipstick colors such as pink or orange. As mentioned above, a subtle lipstick color is an example of a "second makeup color that is different from the first makeup color used in the specified building (default building) process."

[0092] In the modest lip image 511a, the portion that overlaps with the lip area of ​​user A in the default enhanced face image 509a is occupied by the modest lipstick color and has a semi-transparent attribute. The semi-transparent transmittance is, for example, 20% to 80%. The portion that does not overlap with the lip area of ​​user A, that is, the portion that does not have the modest lipstick color, has a transparent attribute (transmittance: 100%). When the face of user B is selected, the lip area is similarly detected from the transformed face image of user B, and a default lip image for user B is generated with the same modest lipstick color applied to the area that overlaps with the lip area of ​​user B.

[0093] Furthermore, as the first step in the blush processing in the lightening process, the area around user A's cheekbones is detected from deformed face image 503a. Next, a subtle blush image 513a for user A is generated to apply blush to the same area as the cheekbones. In the lightening process, the above-mentioned subtle blush (for example, beige) is used. It is desirable that the subtle blush is a color that does not easily become muddy when layered over a default blush. Beige is suitable for a subtle blush because it does not easily become muddy when layered over blushes such as pink or orange. As described above, a subtle blush is an example of a "second makeup color that is different from the first makeup color used in the specified enhancement (default enhancement)."

[0094] In the modest cheek image 513a, the portion that overlaps with the area around the cheekbones of user A in the default enhanced face image 509a is covered with a modest blush and has a semi-transparent attribute. The semi-transparent transmittance is, for example, 20% to 80%. The portion that does not overlap with the area around user A's cheekbones, that is, the portion that does not have a modest blush, has a transparent attribute (transmittance: 100%). When user B's face is selected, the area around the cheekbones is similarly detected from the transformed face image of user B, and a default lip image for user B is generated with the same modest blush applied to the area that overlaps with the area around user B's cheekbones.

[0095] In the lightening / de-embedding process, image composition for lip processing and image composition for cheek processing are performed simultaneously. User A's default enhanced face image 509a is overlaid with user A's subdued lip image 511a and subdued cheek image 513a to obtain user A's lightly enhanced face image 515a. The face image obtained by the lightening / de-embedding process is called a "lightly enhanced face image." In the lip area of ​​the lightly enhanced face image 515a, a default lipstick color and a subdued lipstick color are overlaid on the lip base, and in the cheekbone area, a default blush color and a subdued blush color are overlaid on the base around the cheekbone; therefore, the result is labeled "base + default makeup color + subdued makeup color" in the figure. This method does not replace the default makeup color with a subdued makeup color, so there is no need to worry about reducing coverage and revealing roughness or wrinkles in the base by changing a default makeup color (e.g., pink) to a subdued makeup color (e.g., beige). As shown in the figure, the subdued lip image 511a corresponds to the top layer, the subdued cheek image 513a corresponds to the middle layer, and the default enhanced face image 509a corresponds to the bottom layer. These three layers are composited. The layer composite processing method may be the same as that of the conventional technology. The order of the subdued lip image 511a and the subdued cheek image 513a may be reversed. Because the lip area and the cheekbone area are separated, the subdued lip image 511a and the subdued cheek image 513a may be combined into one layer. Similarly, when user B's face is selected, the subdued lip image and subdued cheek image for user B are superimposed on the default enhanced face image for user B to obtain a lightly enhanced face image for user B.

[0096] The default boost face image 509a, which serves as the base (bottom layer) in the boost thinning process, has already been subjected to smoothing and whitening processes in the default boost thinning process. Therefore, there is no need to perform smoothing and whitening processes again in the boost thinning process. Alternatively, the smoothing and whitening processes may be performed using a method that places a low processing load. Because there is no need to perform the same smoothing process as in the default boost thinning process again in the boost adjustment process, the amount of processing can be reduced compared to the default boost thinning process.

[0097] When the undo button 707 is touched to cancel the face enhancement process for user A, the default face enhancement image 509a is used as is. In other words, the above-described synthesis of the modest lip image 511a and the modest cheek image 513a is not performed.

[0098] The lightly enhanced face image 515a of user A is included in the enhanced adjusted photographed image 615, which is the result of the enhanced and reduced processing. The enhanced adjusted photographed image 615 is based on the default enhanced photographed image 609, and the lightly enhanced face image 515a of user A is pasted onto the default enhanced photographed image 609. When the face of user B is selected, the lightly enhanced face image of user B is included in the enhanced adjusted photographed image 615.

[0099] The default enhancement image and the enhancement-adjusted photographed image obtained by the pre-correction process are stored in the pre-correction image storage unit 423. When only the default enhancement image is stored in the pre-correction image storage unit 423, the default enhancement image is displayed on the editing screen as the target image. When the default enhancement image and the enhancement-adjusted photographed image are stored in the pre-correction image storage unit 423, the enhancement-adjusted photographed image is displayed on the editing screen as the target image.

[0100] FIG. 12 is a diagram showing the edit screen. When the editing process (S15) begins, the display processing unit 403 displays an editing screen on the editing monitor 120. The editing screen is a screen on which the user can perform editing operations on the target image and view and confirm the results of the editing. This diagram shows the editing screen operated by the left-hand user. On the right-hand side, an editing screen operated by the right-hand user is displayed. The editing screen operated by the right-hand user is omitted, but it has a similar layout to this diagram and similarly accepts user operations and displays the target image. From the moment the editing screen is displayed, measurement of the time the user is playing the editing game (hereinafter referred to as "editing time") begins. When the editing time reaches a predetermined time limit, the editing processing unit 146 ends the display of the editing screen and ends the editing process. In other words, a time limit is set for the display of the editing screen, and the user's allotted time for editing play is determined. Note that the time spent on the enhancement adjustment process, during which the enhancement adjustment screen is displayed, is not included in the editing time. Therefore, adjusting the enhancement does not affect the time available for editing play. Even if the enhancement is reduced, the user can still enjoy the editing play to the fullest.

[0101] In this example, there are seven target images. Image tabs 300a to 300g (hereinafter collectively referred to as "image tabs 300" when referring to them collectively or when no particular distinction is made) correspond to the target images that have been pre-corrected. When user A touches an image tab 300, the target image corresponding to the image tab 300 is displayed in the image display area 302.

[0102] The background of the target image has been replaced by pre-correction. In the figure, the replaced background is shown as a checkerboard pattern, but in reality it is painted with a predetermined color.

[0103] The lip palette 304 is used to specify the degree of modification to the user's lips included in the target image. When the user operates the lip palette 304, the updated target image is displayed in the image display area 302.

[0104] FIG. 13 is a screen view of the lip palette. Large tabs 306a to 306d (hereinafter collectively referred to as "large tabs 306" when referring to them collectively or when no distinction is made) are used to select a palette. In this example, it is assumed that the "Makeup" large tab 306d is selected. Palettes other than "Makeup," such as "Stamp," "Pen," and "Letter," are omitted.

[0105] The small tabs 308a and 308b are used to select the "lip" or "cheek" palette. In this example, it is assumed that the "lip" small tab 308a is selected. The "cheek" palette will be omitted.

[0106] The face selection window 310 is used to select a user who will be the target of lip processing. A reduced image of the target image is displayed in the face selection window 310. When user A slides the selection frame 312 to align it with user A's own face, the lip processing on user A's face is adjusted.

[0107] Texture buttons 314a to 314c (hereinafter collectively referred to as "texture buttons 314" when referring to them collectively or when no particular distinction is made) are used to specify the texture of the lips, that is, the shine of the lipstick. When the "gloss" texture button 314a is selected, the finish emphasizes the gloss of the lipstick. This gives a glamorous impression, as if lip gloss had been applied. Specifically, a large, standard highlight image prepared in advance is placed on the lips. This highlight image has a shape that appears due to the strong reflection of a standard lip.

[0108] On the other hand, when the "Matte" texture button 314b is selected, the lipstick finish is reduced in gloss. This creates a calm impression, as if you had applied matte lipstick. Specifically, a small, pre-prepared, fixed-shape highlight image is placed on the lips. This highlight image has a shape that appears due to the weak reflection of standard lips.

[0109] On the other hand, when the "Original Texture" texture button 314c is selected, the original gloss of the user's lips is reproduced. This allows the user's individuality to be fully utilized, resulting in a natural impression. A highlight image is extracted from the target image. The highlight image extracted from the target image has a shape that appears as a reflection on the user's lips.

[0110] In this way, the shape of the highlight image is determined by selecting the texture button 314, and the glossiness of the lipstick can be adjusted. Note that pre-correction is processed using the "original texture." Therefore, the original glossiness of user A is reproduced on user A's lips, and the original glossiness of user B is reproduced on user B's lips.

[0111] Lipstick color buttons 316a-316d (hereinafter collectively referred to as "lipstick color buttons 316" when referring to them collectively or when no distinction is made) are used to specify a lipstick color. Lipstick color buttons 316a-316d correspond to different lipstick colors. Lipstick colors vary, for example, red, orange, yellow, and beige. Original color button 318 corresponds to a default lipstick color (for example, pink).

[0112] The lipstick eraser button 320 is used to correct the lip area where lipstick is applied. The lip area is extracted automatically, but if the extracted lip area is too large, the user can correct it using the lipstick eraser. Specifically, by sliding the lipstick eraser cursor displayed by selecting the lipstick eraser button 320, the part that the lipstick eraser cursor passes over can be excluded from the lip area. This makes it possible to erase the lipstick that extends beyond the lip area.

[0113] In this way, the receiving unit 401 receives an editing operation for the photographed image (target image) for which enhancement adjustment has been performed. The editing processing unit 146 processes the photographed image (target image) in accordance with the content of the editing operation.

[0114] FIG. 14 is a diagram showing a specific example of rip processing in the editing process. The target image in this example is the enhanced photographed image 615 shown in the lower part of Fig. 11. The illustrated thin-enhanced face image 515a of user A is the same as that shown in the upper part of Fig. 11. In other words, it is assumed that user A's face has been thin-enhanced.

[0115] Here, it is assumed that user A's face is selected in the lip palette face selection window 310, and then the red lipstick color button 316 is selected. In image synthesis for lip processing in the editing process, the default enhanced face image 509a is used as the base. This is not to use the lightly enhanced face image 515a displayed in the image display area 302 and face selection window 310 as the base. This is because if the lightly enhanced face image 515a were used as the base, the number of makeup colors to be blended would increase, resulting in a muddy color. This point will be discussed later.

[0116] The layer configuration in the editing process is based on the layer configuration in the case of light lip enhancement shown in FIG. 11. When the red lipstick color button 316 is selected, the modest lip image 511a is replaced with a red selected lip image 517a. The selected lip image 517a has red lipstick added to the area that overlaps the lip area of ​​the default enhanced face image 509a. The transparency is the same as that of the modest lip image 511a. The area that does not overlap the lip area is also the same as that of the modest lip image 511a. In this way, images are synthesized with the layer configuration in which the lip image has been replaced, and a new face image is generated. The face image generated in the editing process is called an "edited face image."

[0117] The edited facial image 519a of user A generated in this example will be described. In the lip area of ​​edited facial image 519a, a default lipstick color (e.g., pink) and a selected lipstick color (red) are overlaid on the lip base. This is indicated in the figure as "base + default lipstick + selected lipstick." As a result, a pink and red composite lip color is applied. This color is displayed on the red lipstick color button 316. In other words, the lipstick color button 316 displays a composite color that incorporates the default lipstick color, matching the appearance of edited facial image 519a. Meanwhile, the area around the cheekbones of edited facial image 519a is the same as that of lightly blushed facial image 515a. In other words, the appearance of the blush remains the same, and a default blush color (e.g., pink) and a subdued blush color (e.g., beige) are overlaid on the base around the cheekbones. Therefore, it appears as if only the lipstick color has been changed. The edited facial image 519a is replaced with the lightly enhanced facial image 515a of the enhanced photographed image 615, and a new whole image is generated. The whole image newly generated by the editing process is called an "edited photographed image." In the edited photographed image 619 in this example, only the facial image of user A is replaced, and the facial image of user B remains unchanged. The edited photographed image 619 is displayed in the image display area 302 and the face selection window 310. User A can check the editing results by looking at the edited photographed image 619 displayed in the image display area 302 and the face selection window 310.

[0118] If the original color button 318 is touched, the image is composited without a lip image layer, so only the default lipstick color is added to the base.

[0119] Here is a supplementary explanation of why the lightly enhanced facial image 515a is not used as the base (bottom layer) in the image composition of the editing process. If the lightly enhanced facial image 515a is used as the base, the above-described operation will result in a default lipstick color (e.g., pink), a subdued lipstick color (e.g., beige), and the selected lipstick color (red) being overlaid on the lip base in the lip area of ​​the edited facial image 519a. Overlaying the three lipstick colors of pink, beige, and red will result in the colors becoming muddy and losing their vividness. Furthermore, the selected red will also be less striking. In this embodiment, since the default enhanced facial image 509a is used as the base, the default lipstick color (e.g., pink) and the selected lipstick color (red) are overlaid on the lip base. Overlaying only the two lipstick colors of pink and red will prevent the colors from becoming muddy and maintain their vividness. Furthermore, the selected red will also be more striking. In this way, in order to make the effect of the selected lipstick more vivid, the default enhanced face image 509a is used as the base, rather than the lightly enhanced face image 515a.

[0120] [Variation 1] In the embodiment, an example has been described in which the default build can be made lighter by touching the light build button 705 on the build adjustment screen (FIG. 9). Making the build lighter is an example of adjusting the default build. The default build may also be adjusted to make the build darker. If the user is not satisfied with the default build and wants to make the build more eye-catching, they can change the build darker for all target images at once.

[0121] In Modification 1, an Increase Enrichment button (not shown) is included in the enhancement adjustment screen (FIG. 9). When the reception unit 401 receives the selection of a face by touching within the face frame 703 and the touch of the Increase Enrichment button (an instruction to increase the enhancement), the face processing unit 413 applies an enhancement process to the selected face.

[0122] FIG. 15 is a diagram showing a specific example of thickening processing. The default enhanced face image 509a and default enhanced photographed image 609 shown at the top are the same as those in Fig. 11. The layer structure is different from that in Fig. 11. A flashy lip image 521a is used instead of the modest lip image 511a shown in Fig. 11, and a flashy cheek image 523a is used instead of the modest cheek image 513a shown in Fig. 11. As in Fig. 11, the default enhanced face image 509a is used as the base.

[0123] In the flashy lip image 521a, a flashy lipstick color is applied to the area that overlaps with the lip region of the default face enhancement image 509a. An example of a flashy lipstick color is red. A flashy lipstick color is a color that is evaluated as flashier than a default lipstick color (pink in this example) in sensory evaluations of lipstick colors in the cosmetics industry. Generally, lipstick colors that are far from skin color are considered to be flashy lipstick colors. This is because there is a greater difference in color between the lipstick and the skin surrounding it. Lipstick colors that are lighter in brightness than the default lipstick color can also be considered flashy lipstick colors. This is because there is a greater difference in brightness between the lipstick and the skin surrounding it. Even within the same pink-based lipstick color, a low-brightness pink gives a richer impression and can therefore be considered flashy.

[0124] In the flashy blush image 523a, a flashy blush is applied in an area that overlaps with the cheekbone area of ​​the default boosted face image 509a. An example of a flashy lipstick color is red. A flashy blush is a color that is evaluated as flashier than a default blush (pink in this example) in sensory evaluations of lipstick colors in the cosmetics industry. Generally, a blush that is far from flesh color is considered to be a flashy blush. This is because there is a greater difference in color between the blush and the skin surrounding it. A blush that is lower in brightness than the default blush can also be considered a flashy blush. This is because there is a greater difference in brightness between the blush and the skin surrounding it. Even if the blush is the same pink type, a lower brightness pink gives a richer impression and can therefore be considered flashy.

[0125] The layer synthesis method may be a conventional technique, as in the case of Fig. 11. The heavily enhanced face image 525a of user A obtained by image synthesis is included in an enhanced adjusted photographed image 625, which is the result of the heavily enhanced processing. When the face of user B is selected, the heavily enhanced face image of user B is included in the enhanced adjusted photographed image 625. The enhanced adjusted photographed image 615 is based on the default enhanced photographed image 609, as in the case of Fig. 11.

[0126] [Variation 2] In the embodiment, an example has been shown in which face deformation is not performed in the thinning of the embossing process. However, face deformation processing may be performed in the thinning of the embossing process. For example, the face processing unit 413 redoes face deformation processing in the thinning of the embossing process. Specifically, the face processing unit 413 sharpens the face line of the original face image at a reduction rate smaller than in the case of default enhancement processing, and enlarges the eyes at a magnification rate smaller than in the case of default enhancement processing. In other words, changes to the face are suppressed. Makeup processing is the same as in the embodiment.

[0127] Furthermore, in the case of thickening the face, the face processing unit 413 may redo the face transformation processing. Specifically, the face processing unit 413 sharpens the face line of the original face image at a reduction rate greater than that in the case of default enhancement processing, and enlarges the eyes at a magnification rate greater than that in the case of default enhancement processing. In other words, the change in the face is emphasized. The makeup processing is the same as in the case of the first modification.

[0128] Furthermore, in the enhancement adjustment, the face processing unit 413 may adjust the deformation of the face and the makeup so that the degree of adjustment of the deformation of the face is smaller than the degree of adjustment of the makeup. In this way, the facial shape of a user who has adjusted the enhancement and a user who has not adjusted the enhancement will have a similar appearance, and balance will be maintained.

[0129] The degree of makeup adjustment can be calculated using, for example, Equation 1. Makeup adjustment level = (lipstick adjustment level + blush adjustment level) / 2 (Equation 1)

[0130] The degree of lipstick adjustment can be calculated using the following formulas 2 and 3. Lipstick adjustment level = Color difference between default lipstick color and synthetic lipstick color / Color difference between default lipstick color and skin color (Equation 2) Composite lipstick color = Composite color of default lipstick color and adjusted lipstick color (Equation 3) The adjusted lipstick color may be a subdued lipstick color or a bold lipstick color. The composite lipstick color shall be synthesized according to the transmittances mentioned above.

[0131] For example, if the muted lipstick color is close to the default lipstick color, the composite lipstick color will also be relatively close to the default lipstick color. Therefore, the value of the numerator in Equation 2 will be small, and the degree of lipstick adjustment will be small. Conversely, if the muted lipstick color is close to a skin tone, the composite lipstick color will also be relatively close to a skin tone. Therefore, the value of the numerator in Equation 2 will be large, and the degree of lipstick adjustment will be large.

[0132] The degree of blush adjustment can be calculated using the following equations 4 and 5. Blush adjustment level = color difference between default blush and synthetic blush / Default blush and skin color difference (Equation 4) Composite blush = Composite color of default blush and adjusted blush (Formula 5) The adjusted blush may be a muted blush or a bold blush. The composite blush shall be composited according to the transmittances described above.

[0133] For example, if the muted blush is close to the default blush, the composite blush will also be relatively close to the default blush. Therefore, the value of the numerator in Equation 4 will be small, and the degree of blush adjustment will be small. Conversely, if the muted blush is close to a skin tone, the composite blush will also be relatively close to a skin tone. Therefore, the value of the numerator in Equation 4 will be large, and the degree of blush adjustment will be large.

[0134] The degree of adjustment of the facial deformation can be calculated using the following equation 6. Facial deformation adjustment level = (Adjustment degree of face line + adjustment degree of eyes) / 2 (Equation 6)

[0135] The degree of adjustment of the face line can be calculated using the following formulas 7 and 8. Face line adjustment level = |Default cheek bulge reduction rate for boost processing - cheek bulge reduction rate for boost adjustment| / Default cheek bulge reduction rate (Equation 7) Cheek bulge reduction rate = (cheek area before reduction - cheek area after reduction) / Cheek area before reduction (Equation 8)

[0136] For example, expressing it as an area ratio, let's say the area of ​​the cheek before reduction is 100, the area of ​​the cheek after default fill processing is 80, and the area of ​​the cheek after fill adjustment is 90. It is calculated as follows. Default cheek bulge reduction rate = (100-80) / 100 =0.2 Cheek bulge reduction rate for face lift adjustment = (100-90) / 100 =0.1 Face line adjustment level = |0.2-0.1| / 0.2 =0.5

[0137] For example, suppose the cheek area before reduction is 100, the cheek area after default fill processing is 80, and the cheek area after fill adjustment is 85. The calculation is as follows: Default cheek bulge reduction rate = (100-80) / 100 =0.2 Cheek bulge reduction rate for face lift adjustment = (100-85) / 100 =0.15 Face line adjustment level = |0.2-0.15| / 0.2 =0.25

[0138] The example where the cheek area after adjustment is 85 is the example where the cheek area after adjustment is 90. The degree of adjustment of the face line is smaller than in the example, because it is closer to the cheek area after default enhancement, which is 80%.

[0139] The degree of eye adjustment can be calculated using the following equations 9 and 10. Eye adjustment level = |Default eye magnification ratio - Eye magnification ratio for adjusting the height| / Default magnification ratio (Equation 9) Eye magnification ratio = eye area after magnification / eye area before magnification (Equation 10)

[0140] For example, if the area of ​​the eye before enlargement is 10, the area of ​​the eye after default fill processing is 20, and the area of ​​the eye after fill adjustment is 15, it is calculated as follows: Default eye magnification ratio = 20 / 10 = 2 Eye magnification ratio for eye adjustment = 15 / 10 = 1.5 Eye adjustment = |2-1.5| / 2 = 0.25

[0141] For example, suppose the area of ​​the eye before enlargement is 10, the area of ​​the eye after default fill processing is 20, and the area of ​​the eye after fill adjustment is 18. The calculation is as follows: Default eye magnification ratio = 20 / 10 = 2 Eye magnification ratio for eye enhancement = 18 / 10 = 1.8 Eye adjustment = |2-1.8| / 2 = 0.1

[0142] The example where the eye area after the build-up adjustment is 18 has a smaller degree of adjustment than the example where the eye area after the build-up adjustment is 15. This is because it is closer to the eye area after the default build-up processing, which is 20.

[0143] [Variation 3] In the embodiment, an example of image synthesis (FIG. 11) is shown in which the default enhanced facial image is used as the base (lowest layer) in the enhanced thinning process. However, the default enhanced process may be redone without performing image synthesis on the default enhanced facial image in the enhanced thinning process. The remade default enhanced photographed image is then used as the result of the enhancement adjustment process. In this case, the photographed image or facial image in the state before the default enhanced process is performed is stored as history information in a storage device such as the data storage unit 136 or a memory.

[0144] When the receiving unit 401 receives the selection of a face by touching within the face frame 703 and the touch of the thin fill button 705 (an instruction to thin the fill), the face processing unit 413 returns the face to the state before the default fill processing based on the history information stored in the storage device, and then redoes the default fill processing. In the redo of the default fill processing, the lip image used in image synthesis is changed from the default lip image 505a shown in FIG. 8 to the subdued lip image 511a. Also, the cheek image used in image synthesis is changed from the default cheek image 507a shown in FIG. 8 to the subdued cheek image 513a. The image synthesis method is the same as in the embodiment.

[0145] As a result, in the lip area of ​​the remade default enhance face image 509a, a subdued lipstick color is overlaid on the lip base, and similarly in the eye bone area, a subdued eye lip color is overlaid on the eye bone base.

[0146] When redoing the default enhancement process, the deformed face image 503a generated by the initial default enhancement process can be used, so the face deformation process can be omitted. Also, since a face image that has already been whitened and smoothed is already available, the whitening and smoothing processes can be omitted.

[0147] To prevent chapped lips or wrinkles from becoming more noticeable when changing from a default lipstick color (e.g., pink) to a more subdued lipstick color (e.g., beige), the transparency of the subdued lipstick color may be set lower than the transparency of the default lipstick color. Alternatively, the face processing unit 413 may perform smoothing processing using a smoothing method that provides a higher degree of smoothing.

[0148] Furthermore, the default enhancement process may be redone without performing image synthesis on the default enhancement face image in the heavy enhancement process of Modification Example 1. In the lip area of ​​the redone default enhancement face image 509a, a vibrant lipstick color is superimposed on the lip base, and in the eye bone area, a vibrant eye lip color is superimposed on the base around the eye bone.

[0149] [Variation 4] In the embodiment, an example has been shown in which the enhancement adjustment process (S14) is performed by the editing device 126 in the editing booth 106, but the enhancement adjustment process (S14) may also be performed by the photographing device 128 in the photographing booth 104.

[0150] In this modified example, the display processing unit 403 displays a fill adjustment screen on the first photographing monitor 112 or the second photographing monitor 114 of the photographing device 128. The receiving unit 401 receives a fill adjustment instruction on the fill adjustment screen displayed on the first photographing monitor 112 or the second photographing monitor 114 of the photographing device 128.

[0151] [Variation 5] In the embodiment and the above-described modified examples, lip and cheek makeup are shown as examples of makeup application, but makeup other than lip and cheek may be applied. For example, eye shadow may be applied. In this case, the makeup area is the upper eyelid instead of the lips and eye bones. Also, the makeup color is eye shadow instead of lipstick and eye blush.

[0152] [Variation 6] In the embodiment and the above-described modified examples, an example has been shown in which the default enhancement processing (S13 in FIG. 4) and enhancement adjustment processing (S14 in FIG. 4) are performed on a captured still image. However, the default enhancement processing (S13 in FIG. 4) and enhancement adjustment processing (S14 in FIG. 4) may also be performed on a captured video. In other words, the face detection unit 411 and the face processing unit 413 may process each frame image of the captured video as the captured image to be processed in the above-described example.

[0153] When applying the thickening process to the captured video, the face processing unit 413 may recognize the face of the user to be adjusted in each frame image of the captured video and apply the thickening process to the face. The same applies to the thickening process of the first modification.

[0154] The present invention is not limited to the above-described embodiments and modifications, and the components can be modified without departing from the spirit of the invention. Various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments and modifications. Furthermore, some components can be omitted from all the components shown in the above-described embodiments and modifications.

[0155] In the above description, the game image capturing system 200 is configured by the game image capturing device 100, the server 202, and the user terminal 206, and in particular the game image capturing device 100 and the server 202. However, some of the functions of the game image capturing device 100 may be realized by the server 202, or some of the functions of the server 202 may be assigned to the game image capturing device 100. Also, some of the functions of these devices may be performed by a third device other than the game image capturing device 100 and the server 202. How the multiple functions required to realize the present invention are allocated to one or more pieces of hardware may be determined in consideration of the processing capabilities of each piece of hardware and the specifications required for the game image capturing system 200. [Explanation of symbols]

[0156] 100 game image photographing device, 102 reception device, 104 photographing booth, 106 editing booth, 108 reception monitor, 110 printing device, 112 first photographing monitor, 114 second photographing monitor, 116 light, 118 camera, 120 editing monitor, 122 stylus pen, 124 curtain, 126 editing device, 128 photographing device, 130 user interface processing unit, 132 data processing unit, 134 communication unit, 136 data storage unit, 140 input unit, 142 output unit, 144 photographing processing unit, 145 pre-correction unit, 146 editing processing unit, 148 reception processing unit, 150 print processing unit, 162a first editing area, 162b second editing area, 166 image display area, 166a first image display area, 166b second image display area, 168 tab, 170a User, 170b User, 172a Conductive cord, 172b Conductive cord, 174 Remaining time display area, 176 End button, 180 Decoration button, 182 Decoration selection area, 190 Play button, 200 Game image shooting system, 202 Server, 204 Internet, 206 User terminal, 210 Light group, 212 Pose instruction unit, 214 Performance output unit, 216 Audio output unit, 218 Lighting control unit, 220 Shooting guide unit, 230 Receiving unit, 232 Transmitting unit, 240 Editing screen, 300 Image tab, 302 Image display area, 304 Lip palette, 306 Large tab, 308 Small tab, 310 Face selection window, 312 Selection frame, 314 Texture button, 316 Lipstick color button, 318 Original color button, 320 Lipstick eraser button, 401 reception unit, 403 display processing unit, 411 face detection unit, 413 face processing unit, 421 captured image storage unit, 423 pre-corrected image storage unit, 501 original captured image, 505a default lip image, 507a default blush image, 509a default full-face image, 511a modest lip image, 513a modest blush image, 515a lightly full-face captured image, 601a original face image, 603a transformed face image, 609 default full-face captured image, 615 lightly full-face captured image, 701 captured image display area, 703a face frame, 703b face frame, 705 lightly full-face button, 707 undo button, 709 confirm button

Claims

1. an imaging unit that images a user; a face detection unit that detects the face of the user included in the captured image obtained by the imaging unit; a face processing unit that applies a predetermined amount of fill to the face; a display unit that displays a build adjustment screen including the photographed image to which the predetermined build has been applied before displaying the editing screen; a reception unit that receives a fill adjustment instruction on the fill adjustment screen, The photographed image of the state before the predetermined buildup is applied is stored, This game image capturing device is characterized in that when an instruction to thin the buildup is received as the buildup adjustment instruction, the face processing unit performs buildup processing that is thinner than the specified buildup instead of the specified buildup on the captured image in its state before the specified buildup was applied.

2. 2. The game image capturing device according to claim 1, wherein the face processing unit overlays a semi-transparent second makeup color, which is different from the first makeup color used in the predetermined makeup, in the light makeup processing.

3. The face processing unit performs a smoothing process on the skin area and the lip area, and in the light build-up processing, a second makeup color that is common to the skin area and the lip area or that is separate to the skin area and the lip area is overlaid semi-transparently on the skin area and the lip area that have been smoothed.

4. The game image capturing device described in claim 1, characterized in that the face processing unit performs deformation processing and makeup processing on the face as the specified enhancement processing, and in the light enhancement processing, maintains the deformed shape of the face and adjusts the makeup.

5. The game image capturing device described in claim 1, characterized in that the face processing unit performs deformation processing and makeup processing on the face as the specified enhancement processing, and in the light enhancement processing, adjusts the deformation and makeup of the face, and the degree of adjustment of the deformation of the face is smaller than the degree of adjustment of the makeup.

Images