Game image capture device

Abstract

To assist with the editing work in a game image capture device.SOLUTION: A game image capture device includes: an imaging processing unit which images a user; an editing processing unit which receives the editing input from the user for a photographed image; and an image output unit which outputs an edited image being the photographed image after editing to an external medium. On an editing screen, one or more digital makeups can be specified for each portion with respect to multiple portions of a subject included in the photographed image. The editing processing unit collectively displays a makeup set being a combination of the digital makeups specified with respect to each of the multiple parts of the subject in a makeup state area 250.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to editing of play images, and in particular to a technique for managing the editing contents of a subject. [Background technology]

[0002] A playful image capture device called Purikura (registered trademark) is extremely popular, especially among high school girls. Users take a picture of themselves and decorate the captured image in various ways on an editing display. The decorated image is then printed on a sticker mount (see Patent Documents 1 and 2).

[0003] In the photographed image, the user can decorate the subject in various ways. For example, the user can adjust the image of the subject (themselves) in various parts of the photographed image by applying mascara, hair color, color contact lenses, etc. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5782873 [Patent Document 2] Patent No. 6436368 Summary of the Invention [Problem to be solved by the invention]

[0005] By applying various decorations to the subject, the user can finish the photographed image to be more satisfactory. On the other hand, particularly when applying individual decorations to each of a plurality of photographed images, it may be difficult to understand what decorations have been applied to the subject of each of the plurality of photographed images, in other words, what editing work the user has performed.

[0006] The present invention was completed based on the inventors' recognition of the above problems, and its main object is to provide a technique for supporting editing work in a game image shooting device. [Means for solving the problem]

[0007] In one aspect of the present invention, a game image capturing device includes a capturing processing unit that captures a user, an editing processing unit that accepts editing input from the user regarding the captured image, and an image output unit that outputs an edited image, which is the captured image after editing, to an external medium. On the editing screen, one or more decoration methods can be specified for each of multiple parts of the subject included in the captured image, and the editing processing unit displays all of the decoration methods specified for each of the multiple parts of the subject in a decoration status area on the editing screen. Effect of the Invention

[0008] According to the present invention, in the game image capturing device, the user can easily understand the editing work that he or she has performed. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is an overall configuration diagram of a game image capturing system. [Diagram 2] FIG. 2 is a perspective view of the appearance of the game image capturing device. [Diagram 3] FIG. [Figure 4] 13 is a flowchart showing the flow of play in the game image capturing device. [Diagram 5] FIG. 2 is a plan view of the game image capturing device seen from above. [Figure 6] FIG. 2 is a functional block diagram of the game image capturing device. [Figure 7] FIG. 13 is a data structure diagram of a makeup classification table. [Figure 8] FIG. 13 is a screen diagram of an editing screen. [Figure 9] FIG. 11 is a first screen view of a first editing area. [Figure 10]This is an enlarged view of the first palette area (mascara). [Figure 11] FIG. 13 is a second screen view of the first editing area. [Figure 12] FIG. 2 is a schematic diagram showing the relationship between a photographed image, a subject, and a makeup set. [Figure 13] FIG. 11 is a schematic diagram for explaining the relationship between an editing area and a makeup set. [Figure 14] FIG. 11 is a schematic diagram for explaining a method of applying a makeup set. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] The game image photographing device in this embodiment includes a photographing booth (photographing space) and an editing booth (editing space). The user photographs himself / herself in the photographing booth. Hereinafter, an image photographed of a subject (user) in the photographing booth is referred to as a "photographed image". In the photographing booth, the game image photographing device applies image correction such as whitening the skin and making the hair shiny to the photographed image (hereinafter, such image correction is referred to as "pre-correction"). In this embodiment, the game image photographing device photographs not only still images but also moving images in the photographing booth. Of the photographed images, those acquired as moving images are referred to as "photographed moving images", and those acquired as still images are referred to as "photographed still images". In this embodiment, a maximum of six sets of photographed images (sets of photographed moving images and photographed still images) are acquired.

[0011] The photographed image that has been subjected to the pre-correction is transmitted to the editing booth. In the editing booth, the user can apply any decoration and image correction to the photographed image, such as digital makeup described later, pasting a stamp image, or doodling with a stylus pen (hereinafter, such image decoration is called "decoration processing" or "editing"). The photographed image that is the subject of editing in the editing booth is called the "target image". Among the target images, those that have been edited from a photographed moving image are called the "target moving image", and those that have been edited from a photographed still image are called the "target still image". The target image after editing is called the "edited image", and among the edited images, those that have been edited from a target moving image are called the "edited moving image", and those that have been edited from a target still image are called the "edited still image". In this embodiment, a maximum of six sets of photographed images are acquired, and therefore a maximum of six sets of edited images (six edited moving images and six edited still images) are generated. Note that six or more sets, for example, a maximum of eight sets of captured images (captured still images and captured moving images) may be acquired, and the user may select a predetermined number (for example, six sets) of captured images to be edited. In the following description, it is assumed that six sets of captured images are acquired and six sets of edited images are generated.

[0012] The user selects a mount image that defines the layout and background of the edited still image. The user then composites the edited still image onto the selected mount image. Hereinafter, the image obtained as the final product by embedding the edited still image into the mount image is referred to as a "layout-completed image."

[0013] The game image capture device prints the laid-out image on a sticker mount (external medium). The game image capture device also uploads edited moving images, edited still images, and laid-out images in which the edited still images are fitted into a mount image to a server (external medium). Users can also download edited images, etc. by accessing the server from a user terminal such as a smartphone. As described above, the game image capture device in this embodiment has a capture function, an editing function (decoration processing function), a printing function, and a communication function.

[0014] The user applies makeup (decoration) to multiple parts of the image of himself / herself that appears in the six target images (hereinafter, the image area corresponding to the person in the target image is called the "subject") in each of the six target images. The parts here refer to specific parts of the body such as hair, eyes, and under-eye bags.

[0015] For example, the user can change the hair color of the subject's "hair" part (details will be described later). A variety of hair colors are available, including gray and brown. For the "eyes" part, image correction can be applied to imitate colored contact lenses (hereinafter referred to as "colored contact lenses"). In this manner, in this embodiment, one of multiple types of makeup (decoration methods) can be selected for one part of the subject.

[0016] Furthermore, makeup is classified into categories (themes) called seasons. For example, the multiple types of eye shadows associated with the area "around the eyes" are classified into any one of spring, summer, autumn, winter, and all (common to all seasons). In other words, makeup is prepared for each seasonal image (atmosphere). For example, "clear, vivid, yellow-based" makeup is associated with spring, and "moderate, slightly cloudy, blue-based" makeup is associated with summer.

[0017] When applying makeup to a subject in a target image, the user selects makeup for each part of the body while considering the season (theme). This allows users to coordinate their makeup, for example, by choosing summer makeup for some parts of the body to add accents while unifying the overall image with a spring theme.

[0018] In the following, the makeup that the user applies to the subject in the image as an editing task is called "digital makeup," and the makeup that the user applies to the body of the user is called "real makeup." When simply referring to "makeup," it means digital makeup. Furthermore, makeup in this embodiment is not limited to makeup in the narrow sense, such as foundation and lipstick, but refers to any task that changes the impression of appearance, such as hair coloring and colored contact lenses. The following description will focus on managing digital makeup.

[0019] FIG. 1 is a diagram showing the overall configuration of a game image capturing system 200. As shown in FIG. In the game image photographing system 200, the game image photographing device 100 is connected to a server 202 and a user terminal 206 (mobile device) via the Internet 204. A user photographs himself / herself using the game image photographing device 100. The game image photographing device 100 obtains a photographed image including a subject (user), applies advance correction to the photographed image as necessary, and accepts decorative processing by the user.

[0020] The edited image and the laid-out image after the decorative processing are uploaded to the server 202 from the game image photographing device 100 together with the user ID. The server 202 stores the user ID, the photographing date and time, the edited image (edited moving image and edited still image), and the laid-out image (a composite image of the edited still image and the mount image) in association with each other. The user can download the edited image, etc. from the server 202 by accessing the server 202 by specifying the user ID.

[0021] FIG. 2 is a perspective view of the appearance of the game image capturing device 100. As shown in FIG. The game image capturing device 100 comprises a reception device 102, a photography booth 104, an editing booth 106, and a printing device 110. The reception device 102 comprises a reception monitor 108. A user makes a reservation for use of the game image capturing device 100 by following the guidance displayed on the reception monitor 108 of the reception device 102. The user inputs a user ID into the reception device 102 and pays a play fee in cash or electronic money.

[0022] In the photography booth 104, the user takes a photograph. After the photographing is completed, the user moves to the editing booth 106. An editing device 126 is installed in the editing booth 106. The editing device 126 includes an editing monitor 120. A target image (a photographed image to be subjected to decorative processing) is displayed on the editing monitor 120. In this embodiment, the editing monitor 120 is formed by a capacitive touch panel. Two stylus pens 122a and 122b are provided for one editing monitor 120. The user applies decorative processing to the target image using the stylus pen 122 and his / her finger. After the editing is completed, the printing device 110 prints the laid-out image on a sticker mount. In addition, the editing device 126 uploads the edited image and the like to the server 202.

[0023] FIG. 3 is a perspective view showing the appearance of the photography booth 104. As shown in FIG. The photographing booth 104 is shielded from the outside by a curtain 124. A photographing device 128 is installed in the photographing booth 104. The photographing device 128 includes three lights 116 that illuminate the subject user from three directions, a camera 118 for acquiring photographed still images and photographed moving images, a first photographing monitor 112, and a second photographing monitor 114.

[0024] In addition, lighting devices are embedded in the ceiling and floor as well. The light 116 and the ceiling and floor lights (not shown) each include a full-color LED (Light Emitting Diode) and a white LED.

[0025] The first photographing monitor 112 displays a preview of the photographed images (photographed moving images and photographed still images) of the user. The second photographing monitor 114 displays photographed images (hereinafter referred to as "sample images") of a person other than the user who is the subject, for example, a model. The user takes a pose of their choice in front of the camera 118 while referring to the sample images displayed on the second photographing monitor 114. Various explanations regarding the photographing method are also displayed on the second photographing monitor 114. As described above, photographed moving images and photographed still images can be acquired in the photographing booth 104.

[0026] Furthermore, the first capture monitor 112 displays a live view image (full-length mirror image) that allows the user to check his or her own appearance, as well as a countdown image that indicates the timing of capture.

[0027] Fig. 4 is a flow chart showing the flow of play in the game image photographing device 100. Fig. 5 is a plan view of the game image photographing device 100 as seen from above. When the user makes a reservation for use at the reception device 102, the reception device 102 executes reception processing (S10). After reception, the user enters the photography booth 104.

[0028] The photographing device 128 acquires photographed images of the user (S12). In the photographing booth 104, the user can acquire a predetermined number of photographed images. A photographed video and a photographed still image are acquired simultaneously, and a pair of a photographed video and a photographed still image is counted as one set of photographed images. In this embodiment, six sets of photographed images (sets of photographed video and photographed still images) are acquired. The photographing device 128 applies pre-correction to the photographed images. The photographing device 128 performs pre-correction every time a photographed image is acquired.

[0029] After shooting, instruction information instructing one of the two editing booths 106 is displayed on the first shooting monitor 112. The user moves to one of the two editing booths 106a, 106b that is specified by the first shooting monitor 112. The shot image (target image) is transferred from the shooting device 128 to the editing device 126. The user applies decorative processing to the shot image (target image) transferred in the editing device 126 (S14). The user selects a mount image and creates a laid-out image by laying out the edited image on the mount image.

[0030] After editing, the editing device 126 sends the laid-out image to the printing device 110, which then prints the laid-out image on a sticker mount (S16). The editing device 126 also uploads the edited image and the laid-out image to the server 202 via the Internet 204 (S18). By accessing the server 202, a user can download the edited image, etc. from the server 202 to a user terminal 206.

[0031] In general, editing takes longer than photographing. In the game image photographing device 100 of this embodiment, two editing booths 106a and 106b (editing devices 126a and 126b) are provided for one photographing booth 104, thereby increasing the customer turnover rate.

[0032] FIG. 6 is a functional block diagram of the game image capturing device 100. As shown in FIG. Each component of the game image capture device 100 is realized by hardware including computing units such as a CPU (Central Processing Unit) and various co-processors, storage devices such as memory and storage, and wired or wireless communication lines connecting them, and software stored in the storage devices and supplying processing instructions to the computing units. The computer program may be composed of device drivers, an operating system, various application programs located at higher layers than these, and libraries that provide common functions to these programs. As described above, the game image capture device 100 is configured as a collection of the capture device 128, the reception device 102, the editing device 126, and the printing device 110. Each block described below represents a functional block, not a hardware configuration.

[0033] The game image capturing device 100 includes a user interface processing unit 130, a data processing unit 132, a communication unit 134, and a data storage unit 136. In addition, the game image capturing device 100 includes a camera 118. The user interface processing unit 130 is responsible for user interface processing via the reception monitor 108, the editing monitor 120, etc. The communication unit 134 is responsible for communication processing with the server 202 via the Internet 204. The communication unit 134 can also directly communicate with the user terminal 206 by short-range wireless communication such as Wi-Fi (registered trademark). For example, the communication unit 134 may directly transmit an edited image to the user terminal 206. The data storage unit 136 stores various data. The data processing unit 132 executes various processes based on the data acquired by the communication unit 134 and the data stored in the data storage unit 136.

[0034] The user interface processing unit 130 includes an input unit 140 that accepts operational inputs from the user, and an output unit 142 that presents information to the user.

[0035] The input unit 140 detects a user's operation input to a touch panel installed in the reception device 102, the photographing device 128, the editing device 126, etc. The input unit 140 also detects an operation input by the stylus pen 122. The input unit 140 also detects a user ID in the reception device 102.

[0036] The output unit 142 executes various output processes such as image display on the reception device 102, the photographing device 128, the editing device 126, etc., as well as audio output and print output.

[0037] During shooting, the output unit 142 displays a live view image (full-length mirror image) of the user on the first shooting monitor 112. The user performs shooting while checking his / her own image in the live view image as if looking at a mirror. In addition, the output unit 142 displays a preview of the shot still image on the first shooting monitor 112 immediately after shooting.

[0038] The data processing unit 132 includes a photographing processing unit 144 , an editing processing unit 146 , a reception processing unit 148 , and a printing processing unit 150 . The photographing processing unit 144 controls the photographing processing in the photographing booth 104. If the photographing timing is time tX, the photographing processing unit 144 records a moving image (hereinafter referred to as a "first half moving image") from 1.5 seconds before the time tX to 0.1 seconds before the time tX, acquires a photographed still image at the time tX, and again records a moving image (hereinafter referred to as a "second half moving image") from 0.1 seconds after the time tX to 1.5 seconds after the time tX. The photographing processing unit 144 generates a photographed moving image by connecting the first half moving image and the second half moving image. The photographing processing unit 144 controls the camera 118 by sending a photographing start instruction and a photographing stop instruction to the camera 118. In addition, the photographing processing unit 144 causes a strobe (not shown) to emit light when the photographed still image is acquired. The photographed moving image does not include a moving image during the acquisition period of the photographed still image, in other words, a moving image during the strobe emission, so that the strobe emission is not reflected.

[0039] The photographing processing unit 144 can also obtain a photographed video before the time tX of the photographing timing according to the user's selection, and obtain a photographed still image after obtaining the photographed video. The photographing processing unit 144 also notifies the user of the photographing timing by instructing the output unit 142 to display a countdown and notify by voice.

[0040] The output unit 142 displays the photographed image as a target image on the editing monitor 120 (a capacitive touch panel). The editing processing unit 146 decorates the target image according to operational input from the user. The reception processing unit 148 manages the payment of play fees by users at the reception device 102. The reception processing unit 148 guides users who have made reservations to the photography booth 104 every time photography work is completed in the photography booth 104. The print processing unit 150 controls printing of the edited image in the printing device 110.

[0041] The communication unit 134 includes a receiving unit 230 that receives data and a transmitting unit 232 that transmits data.

[0042] FIG. 7 is a data structure diagram of the makeup classification table 160. The makeup classification table 160 is stored in the data storage unit 136. The makeup classification table 160 indicates the relationship between body parts, digital makeup (decoration methods), and seasons (themes).

[0043] Ten hair colors, H1 to H10, are available for digital makeup on the "hair" body part. Hair colors H1 and H2 are classified as "spring," while hair colors H3 and H4 are classified as "summer." Additionally, hair colors H9 and H10 are classified as "all seasons." Hair colors H1 to H8 are hair colors that correspond to the atmosphere specific to the season (first type of decoration method), while hair colors H9 and H10 are standard hair colors that do not have a seasonal image (second type of decoration method).

[0044] When applying digital makeup to "hair", the user selects one of four seasons. For example, when the user selects "spring", the user selects the hair color to be applied from four types: hair colors H1 and H2 corresponding to spring, and hair colors H9 and H10 corresponding to all seasons. When the hair color H1 is "pink" and the user selects hair color H1, the editing processor 146 adds "pink" to the subject's hair. How to select makeup will be described in more detail with reference to FIG. 10.

[0045] According to the makeup classification table 160, there are no color contact lenses that are classified as "all." That is, the color contact lenses in this embodiment are digital makeup that correspond to any one of the seasons of spring, summer, autumn, and winter.

[0046] In the following, a description will be given assuming a situation in which two users P1 and P2 enjoy editing work together.

[0047] FIG. 8 is a diagram showing the edit screen 210. As shown in FIG. The editing processor 146 creates graphic data for the editing screen 210 and displays the editing screen 210 on the output unit 142. The editing screen 210 is displayed on the editing monitor 120. In FIG. 8, the target image including two users P1 and P2 is the editing target. The editing processor 146 divides the editing screen 210 into a first editing area 242a (first editing screen) and a second editing area 242b (second editing screen). A first image display area 244a and a second image display area 244b are set in the first editing area 242a and the second editing area 242b, respectively. Note that two editing monitors 120 may be provided separately corresponding to the first editing area 242a and the second editing area 242b. The target images are displayed individually in the first image display area 244a and the second image display area 244b. In the editing screen 210, the two users P1 and P2 can decorate the two target images individually.

[0048] In FIG. 8, user P1 decorates the target image displayed in the first image display area 244a (left side). User P2 decorates the target image displayed in the second image display area 244b (right side). Since the editing monitor 120 is a capacitive touch panel, the user performs various operation inputs with the stylus pen 122 or a finger in a manner similar to that of a smartphone. User P1 uses the stylus pen 122a placed to the left of the first editing area 242a (see FIG. 2). User P2 uses the stylus pen 122b placed to the right of the second editing area 242b. The stylus pens 122a and 122b are connected to the editing device 126 via conductive cords (not shown).

[0049] As described above, a maximum of six sets of captured images are acquired. One captured image includes a captured still image and a captured video image. The output unit 142 displays the captured still images as target images (target still images) in the image display area 244 (first image display area 244a and second image display area 244b). The user can select the target still image to be edited using the switching buttons 246 (first switching button 246a and second switching button 246b). More specifically, the switching buttons 246 (first switching button 246a and second switching button 246b) include a "forward button" for proceeding with switching the target image and a "back button" for going back.

[0050] A first thumbnail area 248a is displayed above the first image display area 244a, and a second thumbnail area 248b is displayed above the second image display area 244b. User P1 selects a target image to be edited from the six reduced target images arranged in the first thumbnail area 248a. In FIG. 8, the first target image (K1) is selected. The same is true for user P2. In FIG. 8, the second target image (K2) is selected in the second image display area 244b. As described above, the user selects a target image to be edited from the six target images by specifying the thumbnail area 248 or by using the switching button 246.

[0051] When the user touches the play button 190 (the first play button 190a or the second play button 190b), the output unit 142 plays and displays about 3 seconds of the target moving image corresponding to the target still image. The edit processing unit 146 may also reflect the result of the decorative processing applied to the target still image in the target moving image.

[0052] The editing processing unit 146 manages the editing time limit. The output unit 142 displays the remaining time limit as a countdown in the remaining time display area 174. When the time limit expires, the editing processing unit 146 forcibly ends the editing work. Even if the time limit has not yet expired, the user can forcibly end the editing process by touching the end button 176.

[0053] The first makeup state area 250a (decoration state area) displays a list of the digital makeup applied to each part of the person (hereinafter referred to as "subject P1") corresponding to user P1 in the target image (hereinafter, the combination data of the digital makeup applied to the subject is referred to as "makeup set (decoration information)"). The second makeup state area 250b displays a list of makeup sets for subject P2. Details of the makeup state area 250 (first makeup state area 250a and second makeup state area 250b) will be described later.

[0054] The palette area 252 (first palette area 252a and second palette area 252b) provides a user interface for selecting digital makeup that can be applied to a subject. The user applies digital makeup to each part of the subject by referring to the palette area 252. The palette area 252 will be described later in relation to FIG. 10.

[0055] In addition, when editing, the user can add a stamp image, a line image, a text image, etc. to the target image by selecting a button (not shown) for specifying "stamp," "pen," "text," etc. Touching the erase button 254 turns the stylus pen 122 into an "eraser," and digital makeup, stamp images, line images, text images, etc. added to the image display area 244 can be erased in the manner of an eraser.

[0056] Although the details will be described later, the user can select a subject to be edited in the user-specified area 256 (first user-specified area 256a and second user-specified area 256b). Usually, the user P1 who performs editing work in the first editing area 242a touches the subject P1 in the first user-specified area 256a. At this time, the editing processing unit 146 displays the makeup set of the subject P1 in the selected target image in the first makeup state area 250a. Similarly, the user P2 who performs editing work in the second editing area 242b touches the subject P2 in the second user-specified area 256b. When the target image includes multiple subjects, the editing processing unit 146 detects a face by a known face image identification technology and identifies the face part as the subject. As shown in the user-specified area 256 in FIG. 8, the user selects one of the identified faces. The editing processing unit 146 displays a frame superimposed on the face part of the selected subject. In FIG. 8, subject P1 is selected in first user-designated area 256a, and subject P2 is selected in second user-designated area 256b. Hereinafter, the subject designated as the subject to be edited in user designated area 256 will be referred to as the "target subject".

[0057] The editing processor 146 may select, as an initial setting, subject P1 as the target subject in the first editing area 242a, and may select subject P2 as the target subject in the second editing area 242b. More specifically, the editing processor 146 may initially select the left subject P1 of the two subjects appearing in the target image as the target subject in the left first editing area 242a, and may select the right subject P2 of the two subjects appearing in the target image as the target subject in the right second editing area 242b.

[0058] FIG. 9 is a first screen view of the first editing area 242a. The following description focuses on the first editing area 242a, but the user interface in the second editing area 242b is similar to that in the first editing area 242a. A user P1 performs editing work in the first editing area 242a. In FIG. 9, the user P1 selects the first target image (K1) of six target images in the first thumbnail area 248a. At this time, the editing processing unit 146 displays the target image (K1) in the first image display area 244a.

[0059] User P1 selects a target subject in first user designation area 256a. In Fig. 9, user P1 selects subject P1 (himself) as the target subject. At this time, edit processing unit 146 displays a list of makeup sets, which are combinations of digital makeup applied to target subject P1, in first makeup status area 250a.

[0060] The first makeup status area 250a includes a plurality of makeup buttons 260 (input interfaces). As shown in FIG. 9, the makeup button 260 corresponding to the hair color (hereinafter, referred to as "makeup button 260 (hair color)") is labeled with "H1" and "spring". In other words, it can be seen that the part "hair" of the target subject P1 is digitally made up with hair color H1 (pink) classified as spring. The makeup button 260 (eye bag) is labeled with "B6" and "winter". This shows that the part "around the eyes" of the target subject P1 is applied with eye bag makeup B6 classified as winter. In addition, the part "facial skin" of the target subject P1 is applied with foundation F9 classified as "all". The additional display here may be displayed superimposed on the makeup button 260 as shown in FIG. 9, or may be additionally displayed in the outer area of ​​the makeup button 260.

[0061] A character string "Try it out" is displayed on the makeup buttons 260 corresponding to the parts of the target subject P1 that have not been applied with digital makeup. The edit processing unit 146 instructs the output unit 142 to display the makeup buttons 260 for which digital makeup has been applied and the makeup buttons 260 for which digital makeup has not been applied in different colors (for example, white and flesh color). In FIG. 9, the makeup button 260 (colored contact lenses) corresponding to the part "eyes" of the target subject P1 is labeled "Try it out." By referring to the first makeup status area 250a, the user P1 can check at a glance what kind of digital makeup has been applied to each part of the target subject P1, or whether digital makeup has not been applied to each part.

[0062] 9, the digital makeup is generally unified as “winter.” By referring to the first makeup condition area 250a, the user P1 can also confirm the theme of the makeup set.

[0063] When user P1 selects subject P2 in first user designation area 256a, edit processing unit 146 displays a list of makeup sets for subject P2 in first makeup status area 250a. User P1 can check the makeup sets for each of multiple subjects by selecting a subject in first user designation area 256a.

[0064] When user P1 selects a target image (K2) and subject P1, edit processing unit 146 displays a list of makeup sets for target subject P1 appearing in target image (K2) in first makeup state area 250a. In this manner, a makeup set is set for each combination of target image and subject. The relationship between the makeup sets, target image, and subject will be described later with reference to FIG. 12.

[0065] When the user touches any of the makeup buttons 260, the edit processing unit 146 switches the first palette area 252a according to the touched makeup button 260. For example, when the user P1 touches the makeup button 260 (mascara), the edit processing unit 146 displays the first palette area 252a for applying mascara, as shown in Fig. 9. The makeup button 260 (mascara) is labeled "Try it," so no mascara is set for the target subject P1.

[0066] Two types of buttons, an apply button 264 and a save button 262, are arranged under the first makeup state area 250a. The user P1 can save a makeup set by touching the save button 262. When the user P1 selects a target subject P1 while the target image (K1) is being displayed and then touches the save button 262, the makeup set for the target subject P1 is saved. In addition, the user P1 can apply the saved makeup set to the target subject by touching the apply button 264. Saving and applying makeup states will be described later with reference to FIG. 13 and subsequent figures.

[0067] FIG. 10 is an enlarged view of the first palette area 252a (mascara). 9, when the user P1 touches the makeup button 260 (mascara), the edit processing unit 146 displays a first palette area 252a corresponding to mascara. The first palette area 252a (mascara) includes a first user designation area 256a for selecting a target subject, as well as a first slider 280, a second slider 282, a color selection area 284, and a season selection area 270.

[0068] The first slider 280 is a slider for adjusting the length of the upper eyelashes of the subject. When the subject P1 is selected, the user P1 can adjust the length of the upper eyelashes of the subject P1 by adjusting the first slider 280. The editing processing unit 146 performs image recognition of the eyes of the target subject P1 displayed in the first image display area 244a, and changes the length of the upper eyelashes displayed on the eyes of the target subject P1 according to the setting value of the first slider 280.

[0069] The second slider 282 is a slider for adjusting the length of the subject's lower eyelashes. The edit processing unit 146 adjusts the length of the subject P1's lower eyelashes in the same manner as the upper eyelashes according to the setting value of the second slider 282. The upper eyelashes and the lower eyelashes are also a type of digital makeup.

[0070] The color selection area 284 is an area for selecting a mascara color. The color selection area 284 includes an all area 266 and a personal area 268. In the season selection area 270, four season buttons 272 are arranged corresponding to four seasons. The user P1 selects a season with the season button 272. In FIG. 10, "Spring" is selected.

[0071] The edit processing unit 146 displays the mascara color corresponding to the selected season in the personal area 268. According to the makeup classification table 160 shown in FIG. 7, the mascaras corresponding to spring are mascaras M1 and M2. Assume that the mascara M1 is "pink" and the mascara M2 is "orange." Meanwhile, the all area 266 displays the mascara color corresponding to all (season). According to the makeup classification table 160 in FIG. 7, the mascaras corresponding to all are mascaras M9 and M10. Assume that the mascara M9 is "black" and the mascara M10 is "brown." The mascara for all is always displayed in the all area 266 regardless of which season selection area 270 is selected. When the season is changed in the season selection area 270, the edit processing unit 146 changes the display of the personal area 268 based on the makeup classification table 160.

[0072] The user selects one of the four mascara colors displayed in color selection area 284. Edit processing unit 146 changes the mascara color of target subject P1 to the specified color.

[0073] As described above, the first palette area 252a allows the user P1 to set three types of digital makeup for the upper eyelashes, the lower eyelashes, and the mascara color.

[0074] FIG. 11 is a second screen view of the first editing area 242a. In the first makeup status area 250a of FIG. 9, the makeup button 260 (mascara) displays "Try it out." After that, assume that the user P1 applies digital makeup to the target subject P1 using the mascara M3 corresponding to summer in the first palette area 252a (mascara). At this time, the editing processor 146 changes the display color of the makeup button 260 (mascara) in the first makeup status area 250a and also displays "M3" and "summer." By referring to the first makeup status area 250a, the user P1 can confirm that mascara (M3: summer) has been applied to the target subject P1.

[0075] FIG. 12 is a schematic diagram showing the relationship between a photographed image, a subject, and a makeup set. The target image (K1) includes subjects P1 and P2. A makeup set M(P1:K1) is associated with the subject P1 in the target image (K1). According to the makeup set M(P1:K1), the subject P1 in the target image (K1) is wearing hair color H3, colored contact lenses C11, etc.

[0076] A makeup set M(P2:K1) is associated with a subject P2 in a target image (K1). When a user P1 changes the selection from subject P1 to subject P2 while the captured image (K1) is being displayed, the edit processing unit 146 changes the display in the first makeup status area 250a from the makeup set (P1:K1) to the makeup set M(P2:K1).

[0077] As described above, a makeup set is defined for each combination of target image and subject. Edit processing unit 146 recognizes the subject by detecting a face image from the target image.

[0078] FIG. 13 is a schematic diagram for explaining the relationship between the editing area 242 and the make set. 13, a target image (K3) and subject P1 are selected by user P1 in first editing area 242a, and a captured image (K6) and subject P2 are selected in second editing area 242b. Therefore, makeup set M (P1:K3) is displayed in first makeup condition area 250a, and makeup set M (P2:K6) is displayed in second makeup condition area 250b.

[0079] Here, it is assumed that the user P1 touches the save button 262. At this time, the edit processing unit 146 saves the makeup set M (P1:K3) in association with the first edit area 242a. The term "save" here means that only one makeup set is associated with each edit area 242. The makeup set saved in association with the edit area 242 is called a "saved set." There is only one type of saved set that corresponds to the first edit area 242a. When saving is completed, the edit processing unit 146 changes the display color of the save button 262 from pink, which indicates that the makeup set is not saved, to gray, which indicates that the makeup set has been saved. In addition, the edit processing unit 146 changes the display color of the apply button 264 from gray, which indicates that the makeup set is not applicable, to blue, which indicates that the makeup set is applicable. The user can recognize the presence or absence of a saved set from the display colors of the save button 262 and the apply button 264.

[0080] When the user P2 touches the save button 262 in the second editing area 242b, the edit processing unit 146 saves the makeup set M(P2:K6) in the second editing area 242b. At this time, the edit processing unit 146 also changes the display color of the save button 262 in the second editing area 242b to gray, and changes the display color of the apply button 264 to blue.

[0081] When user P1 changes the target image or target subject and touches save button 262 again, edit processing unit 146 updates the saved set. For example, assume that user P1 selects target image (K2) and subject P1 and touches save button 262 in a situation where makeup set M(P1:K3) is saved. At this time, edit processing unit 146 deletes saved set M(P1:K3) and saves new makeup set M(P1:K2).

[0082] FIG. 14 is a schematic diagram for explaining a method of applying a make set. In the play image photographing device 100 of this embodiment, the user can apply a makeup set of a subject appearing in a certain target image to another target image or another subject as is.

[0083] <Application to other captured images (T1)> It is assumed that user P1 has saved makeup set M(P1:K1) for subject P1 in target image (K1). Next, user P1 changes the display from target image (K1) to target image (K2) in first thumbnail area 248a. User P1 selects subject P1 in target image (K2) and touches apply button 264. At this time, edit processing unit 146 applies saved set M(P1:K1) to subject P1 in target image (K2). For example, if subject P1 in target image (K1) has hair color H1 applied, hair color H1 is also set for subject P1 in target image (K2) in response to the save instruction and apply instruction described above.

[0084] By sequentially selecting multiple target images, user P1 can reflect the makeup set in target image (K1) on other target images. Suppose that user P1 is applying digital makeup sequentially from target image (K1) to target image (K6) and thinks that the makeup on target image (K2) is the best. In this case, user P1 can save the makeup set for subject P1 in target image (K2) once, and then instruct to apply the saved set to other target images, allowing the makeup set (P1:K2) that gives high satisfaction to user P1 to be easily applied to other target images.

[0085] <Application to another subject (T2)> The user P1 can also apply the makeup set of the subject P2 to another subject P1. The user P1 first selects the subject P2 in the target image (K1) and saves the makeup set M(P2:K1). Next, the user P1 selects the subject P1 in the target image (K1) and touches the apply button 264. At this time, the editing processor 146 applies the makeup set M(P2:K1) to the subject P1 in the target image (K1).

[0086] User P1 may want to wear the same makeup (subject P1) because the makeup of subject P2 in the target image (K1) is cute. According to this control method, the makeup set of a friend (user P2) who is good at makeup can be applied to user P1 (subject P1) as is, so even a user who is not familiar with digital makeup can easily be satisfied with the finished edited image.

[0087] In addition, it is also possible to apply the makeup set of the subject P1 in the photographed image (K1) to another subject P2 in another photographed image (K2). Note that when there is no saved set, the application instruction is not accepted.

[0088] [Summary] The game image capturing device 100, the server 202, and the game image capturing system 200 have been described above based on the embodiments. In the game image shooting device 100 of this embodiment, various digital makeups are prepared for each of a plurality of body parts. This allows the user to enjoy more detailed editing (makeup) than with real makeup. On the other hand, as the number of types of digital makeup increases, it becomes difficult for the user to grasp what kind of makeup has been applied to the subject. In this embodiment, by displaying a list of makeup sets in the makeup status area 250, the user can check the makeup sets for each target image (captured image) and each subject together.

[0089] By referring to the makeup status area 250, the user can recognize which parts of the body have digital makeup applied and which parts do not. Users usually apply real makeup before taking a photograph. For this reason, it can be difficult to tell just by looking at the target image whether only real makeup or digital makeup has been applied as well. According to this embodiment, the display mode (display color and additional text) of the makeup button 260 is changed depending on whether digital makeup is applied, so that the user can correctly recognize which parts of the body do not have digital makeup applied.

[0090] In this embodiment, the digital makeup is classified into one of five categories in total: four seasons and all. The digital makeup is classified according to the image or atmosphere of the season. The user can check the overall image of the makeup set by referring to the "season" of each part in the makeup status area 250. The makeup status area 250 may display only the digital makeup, or may display only the season. Furthermore, the digital makeup or the season may be displayed as text information, or may be displayed as an image such as an icon.

[0091] The user can check the makeup set for each target subject. The user can also check the makeup set for each target image. This makes it easier to manage a variety of makeup sets even when many users are taking many images. Also, by simply touching the makeup button 260 in the makeup status area 250, the corresponding palette area 252 is displayed, allowing the user to quickly adjust the makeup on any part of the body that is of concern while viewing the image display area 244.

[0092] The present invention is not limited to the above-mentioned embodiment and modified examples, and the components can be modified without departing from the gist of the present invention. Various inventions can be formed by appropriately combining multiple components disclosed in the above-mentioned embodiment and modified examples. In addition, some components can be deleted from all the components shown in the above-mentioned embodiment and modified examples.

[0093] Although the play image capturing system 200 has been described as being configured by the play image capturing device 100, the server 202, and the user terminal 206, particularly the play image capturing device 100 and the server 202, some of the functions of the play image capturing device 100 may be realized by the server 202, or some of the functions of the server 202 may be assigned to the play image capturing device 100. Also, a third device other than the play image capturing device 100 and the server 202 may assume some of the functions of these devices. How to allocate a plurality of functions required to realize the present invention to one or more pieces of hardware may be determined in consideration of the processing capacity of each piece of hardware, the specifications required for the play image capturing system 200, and the like.

[0094] [Variations] In this embodiment, digital makeup is applied to each part of the subject, but the digital makeup does not need to be associated with the part of the subject. For example, a stamp image or the like superimposed on the subject P1 in the target image may be managed as a type of digital makeup for the subject P1. As an example, it is assumed that a stamp image X1 is added to the subject P1 in the target image (K1). At this time, the editing processing unit 146 includes the stamp image X1 as a part of the makeup set (P1:K1) of the subject P1 in the target image (K1). It is assumed that the user P1 saves this makeup set and then applies the saved set (P1:K1) to the subject P1 in the target image (K2). At this time, the editing processing unit 146 may also add the stamp image X1 to the subject P1 in the captured image (K2).

[0095] In the present embodiment, it has been described that the user selects the target subject in a "small window-type image area" called the user designation area 256. As a modified example, the user may directly select the target subject in the image display area 244.

[0096] The editing device 126 may also include a camera (not shown). The editing processing unit 146 recognizes the faces of the users located in front of the first palette area 252a and the second palette area 252b from the images captured by the camera of the editing device 126. When it is determined that the user in front of the first palette area 252a is "user P1," the editing processing unit 146 may automatically select the subject P1 as the target subject in the first editing area 242a. More specifically, the editing processing unit 146 compares the similarity between the captured image of the user and the facial images of the two subjects included in the image display area 244 to determine whether the user located in front of the first editing area 242a is user P1 or user P2.

[0097] Digital makeup includes various image settings for applying makeup to a subject, such as color (e.g., color of colored contact lenses), size (e.g., range of eyeshadow), darkness (e.g., darkness of eyeshadow), type (e.g., balm-type lipstick and oil-type lipstick), shape (e.g., length of mascara), etc. As described above, digital makeup may also include decorative images such as stamps and line drawings.

[0098] The user may save the makeup set in the server 202. When the user P1 touches the save button 262, the transmission unit 232 transmits the makeup set designated as the one to be saved to the server 202 together with the user ID. The server stores the makeup set in association with the user ID. At a later date, the user P1 instructs the server 202 to download the makeup set while editing. The transmission unit 232 transmits a download instruction including the user ID to the server 202, and the server 202 transmits the saved set associated with the user ID to the game image capturing device 100.

[0099] The edit processing unit 146 applies the downloaded makeup set to the target image and target subject designated by the user. In this way, if the user saves a favorite makeup set in the server 202, the user can apply the favorite makeup set whenever playing with the game image shooting device 100.

[0100] When a user ID is entered on the reception monitor 108, the transmission unit 232 may transmit the user ID to the server 202 and instruct the server 202 to download a makeup set. Alternatively, the transmission unit 232 may transmit a facial image of the user detected during shooting to the server 202. The server 202 may identify the user ID by comparing the received facial image with facial images of pre-registered member users, and transmit to the game image shooting device 100 a makeup set corresponding to the identified user ID.

[0101] The saved set may be applied to multiple target images all at once. For example, when the edit processing unit 146 is instructed by the user P1 to apply the makeup set (K1:P1) all at once, the edit processing unit 146 may apply the makeup set (K1:P1) to the subject P1 in all remaining target images (K2) to (K6) all at once. The edit processing unit 146 may select only the subject P1 among the multiple subjects appearing in the target images and apply the makeup set (K1:P1) to the subject P1, or may apply the makeup set (K1:P1) to all subjects including the subject P2 all at once. The edit processing unit 146 may also check the subjects to which the makeup set is to be applied to the user P1 before applying the makeup set all at once.

[0102] It may be possible to apply other people's makeup sets to the subject, regardless of the players playing at the same time. For example, assume that the server 202 manages a makeup set (X) of a certain celebrity X. The makeup set (X) may reflect the celebrity X's real makeup, or may be a makeup set created by the celebrity X as a recommended makeup set.

[0103] When the user designates celebrity X, the server 202 transmits the makeup set (X) to the game image shooting device 100. After this, the user can apply the makeup set (X) to the target subject. With this control method, the user can apply digital makeup to himself that reflects the atmosphere of celebrity X. Also, celebrity X can appeal to many users his / her sense by providing various users with makeup sets that he / she has thought up. In this case, for celebrity X, the makeup set (X) becomes his / her intellectual property. Also, by applying a makeup set of a celebrity such as an entertainer or anime character to a subject, the user can enjoy the joy of getting closer to the celebrity he / she admires.

[0104] The server 202 may associate a face image of a celebrity with a makeup set. The game image shooting device 100 transmits a face image of the user to the server 202, and a similarity determination unit (not shown) of the server 202 identifies a celebrity who has a high similarity to the face image of the user. Next, the server 202 transmits a makeup set associated with the identified celebrity to the game image shooting device 100, and the user applies this to the subject. According to such a control method, even a user who is not familiar with makeup can easily select makeup that suits his or her face.

[0105] In this embodiment, the photographing booth 104 and the editing booth 106 are described as being configured separately, but the photographing booth 104 and the editing booth 106 may be configured as an integrated unit.

[0106] [Note] A1. A photographing processing unit that photographs a user; an editing processing unit that accepts editing input for the captured image from a user; an image output unit that outputs an edited image, which is a photographed image after editing, to an external medium; The editing processing unit includes: When a save instruction is received from a user on an editing screen of a first captured image, a decoration method designated for a subject appearing in the first captured image is saved as decoration information; A game image capture device that applies a decoration method specified in the stored decoration information to a subject appearing in a second captured image when an application instruction is received from a user on an editing screen of a second captured image different from the first captured image.

[0107] A2. In the editing screen, one or more decoration methods can be specified for each of a plurality of parts of a subject included in a photographed image; The editing processing unit includes: when a save instruction is received for the first photographed image, a decoration method designated for each of a plurality of parts of the subject is saved as decoration information; The game image capturing device according to A1, wherein when an application instruction is received for the second captured image, a decoration method specified in the decoration information is applied to each of a plurality of parts of the subject.

[0108] A3. The editing processing unit: when a save instruction is received from a user in a captured image in which a first subject and a second subject are captured and the first subject is selected, a decoration method designated for the first subject is saved as the decoration information; A game image capture device as described in A1, which applies a decoration method specified in the stored decoration information to the second subject when an application instruction is received from a user while the second subject is selected.

[0109] A4. The editing processing unit: When decoration information is saved in response to a save instruction from a user in a state in which a first captured image is selected from among three or more captured images, The game image capture device described in A1, when an application instruction is received from a user, applies the decoration method specified in the stored decoration information to the subjects appearing in the remaining captured images of the three or more captured images at once.

[0110] A5. The editing processing unit: when a save instruction is received from a user in a state in which a third captured image and the first subject are selected from among a plurality of captured images showing a first subject and a second subject, a decoration method designated for the first subject in the third captured image is saved as the decoration information; A game image capture device as described in A1, which, when an application instruction is received from a user, applies a decoration method specified in the stored decoration information to the first subject appearing in the remaining captured images among the plurality of captured images.

[0111] A6. The game image capturing device described in A1, wherein the editing processing unit displays a first input interface for a save instruction and a second input interface for an application instruction on the editing screen, and changes the display mode of both or one of the first input interface and the second input interface depending on whether the decorative information has been saved or not. [Explanation of symbols]

[0112] 100 game image photographing device, 102 reception device, 104 photographing booth, 106 editing booth, 108 reception monitor, 110 printing device, 112 first photographing monitor, 114 second photographing monitor, 116 light, 118 camera, 120 editing monitor, 122 stylus pen, 124 curtain, 126 editing device, 128 photographing device, 130 user interface processing unit, 132 data processing unit, 134 communication unit, 136 data storage unit, 140 input unit, 142 output unit, 144 photographing processing unit, 146 editing processing unit, 148 reception processing unit, 150 print processing unit, 160 makeup classification table, 174 remaining time display area, 176 end button, 190 play button, 200 game image photographing system, 202 server, 204 internet, 206 user terminal, 210 Editing screen, 230 receiving section, 232 transmitting section, 242 editing area, 244 image display area, 246 switching button, 248 thumbnail area, 250 makeup status area, 252 palette area, 254 erase button, 256 user designation area, 260 makeup button, 262 save button, 264 apply button, 266 all area, 268 personal area, 270 season selection area, 272 season button, 280 first slider, 282 second slider, 284 color selection area

Claims

1. an image capturing processing unit that captures an image of a user; an editing processing unit that accepts editing input for the captured image from a user; an image output unit that outputs an edited image, which is a photographed image after editing, to an external medium; In the editing screen, one or more decoration methods can be designated for each of a plurality of parts of the subject included in the photographed image; The editing processing unit displays, in a single display, the decoration methods specified for each of the plurality of body parts of the subject in a decoration state area on the editing screen.

2. the plurality of decoration methods corresponding to the plurality of body parts in advance are classified into a plurality of themes, 2. The game image capturing device according to claim 1, wherein the editing processing section displays, in the decoration state area, a theme corresponding to the selected decoration method together with the decoration method selected for each of the plurality of parts of the subject.

3. The plurality of decoration methods includes a first type of decoration method specific to any one of the plurality of themes and a second type of decoration method common to the plurality of themes; The game image capturing device of claim 1, wherein the editing processing unit displays in the decoration state area, together with the decoration method selected for each of the multiple parts of the subject, whether the selected decoration method is a first type of decoration method or a second type of decoration method.

4. In the decoration state area, an input interface corresponding to each of the plurality of body parts is displayed, The editing processing unit includes: when any one of the plurality of input interfaces displayed in the decoration state area is selected, a palette area for designating a decoration method for a portion corresponding to the selected input interface is displayed on the editing screen; 2. The game image capturing device according to claim 1, wherein said decoration state area is updated when a decoration method is changed in said palette area.

5. 5. The game image capturing device according to claim 4, wherein said edit processing section causes a decoration method designated for a portion corresponding to an input interface in said decoration state area to be additionally displayed in a display area of ​​said input interface.

6. The game image capturing device of claim 1 , wherein the editing processing unit displays in the decoration state area, among the multiple parts of the subject, parts for which a decoration method has been specified and parts for which a decoration method has not been specified in different display modes.

7. The game image capturing device of claim 1, wherein the editing processing unit, when any one of a plurality of subjects appearing in the captured image is selected, causes the decoration method specified for each of a plurality of parts of the selected subject to be displayed collectively in the decoration status area.

8. The game image capturing device of claim 1, wherein when one of a plurality of captured images is selected, the editing processing unit causes the decoration method specified for each of a plurality of parts of the subject appearing in the selected captured image to be displayed collectively in the decoration status area.

Images