Image processing device, information processing method, program

Abstract

To edit a captured image using an editing screen according to the purpose.SOLUTION: An image processing device according to the present technology displays a first edit screen on which a captured image of an editing target is displayed with an image expressing a design of a printing image in an editing input area, and displays a second edit screen which is used for editing the captured image to transmit to an external device and on which the captured image of the editing target is displayed without the image expressing the design in the editing input area. The present technology can be applied to a photo-creating game machine that provides a series of games for printing the captured image on sticker paper.SELECTED DRAWING: Figure 12

Description

Technical Field

[0001] This technology particularly relates to an image processing apparatus and a program that enable editing of a photographed image using an editing screen according to the application. Information processing methods 、and a program.

Background Art

[0002] Conventionally, a photo sticker creating device is known. The photo sticker creating device photographs a user, allows the user to edit the photographed image, and prints the edited image on sticker paper for providing. The photo sticker creating device is installed in a play facility or the like.

[0003] The flow of one game provided by the photo sticker creating device usually involves photographing a user in the photographing space as a subject, then moving the user to the editing space, editing the image according to the operations performed in the editing space, and printing the edited image on sticker paper.

[0004] Editing of the image obtained by photographing is performed using an editing screen displayed on a display provided in the editing space after moving from the photographing space to the editing space. On the editing screen, buttons used for selecting various editing tools are displayed together with the image to be edited.

[0005] Patent Document 1 discloses a technique for performing two types of photographing, namely photographing a photographed image called a so-called pre-image that is an object of editing including a process of synthesizing a synthetic image, and photographing an identification photo, and displaying editing screens corresponding to each photographing.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0007] If you can edit with the intended use in mind, you can improve the quality of the final edit.

[0008] This technology was developed in light of these circumstances, and it enables users to edit captured images using editing screens tailored to their specific needs. [Means for solving the problem]

[0009] This technology one aspect The image processing device is Used to create images for printing. Display the first editing screen. After creating the print image using the first editing screen, a selection screen used to select the print layout is displayed. Display Control Unit The printing unit prints the image for printing created using the first editing screen based on the layout selected using the selection screen. It is equipped with. The display control unit displays a second editing screen, used for creating an image to be transmitted to an external device, after the selection of a layout using the selection screen has been completed. This technology one aspect In that case, Used to create images for printing. The first editing screen is displayed. After creating the print image using the first editing screen, a selection screen for selecting the print layout is displayed. A second editing screen, used for creating an image for transmission to an external device, is displayed after the layout selection using the selection screen is complete, and the print image created using the first editing screen is printed based on the layout selected using the selection screen. . [Effects of the Invention]

[0011] This technology allows users to edit captured images using editing screens tailored to their specific needs. [Brief explanation of the drawing]

[0012] [Figure 1] A perspective view showing an example of the external configuration of the photo sticker creation device of this technology. [Figure 2] This is a perspective view of the photo sticker creation device from a different angle. [Figure 3] This is a diagram illustrating the movement of users. [Figure 4] This is a diagram showing an example of the configuration of the pre-selection section. [Figure 5] This is a diagram showing an example of the configuration of the camera unit. [Figure 6] This figure shows an example of the front configuration of the editing unit. [Figure 7] This is a block diagram showing an example configuration of a photo sticker creation device. [Figure 8]It is a block diagram showing a functional configuration example of a photo sticker creation device. [Figure 9] It is a flowchart for explaining a photo sticker creation game providing process. [Figure 10] It is a flowchart for explaining an editing process performed in step S4 of FIG. 9. [Figure 11] It is a diagram showing an example of a display of an image selection screen for scribbling on a sticker. [Figure 12] It is a diagram showing an example of a display of a dedicated scribbling screen for a sticker. [Figure 13] It is a diagram showing an example of a display when a tool tab is pressed. [Figure 14] It is a diagram showing an enlarged display of a scribbling input area. [Figure 15] It is a diagram showing an example of an input of scribbling. [Figure 16] It is a diagram showing an example of a display of a sticker layout selection screen. [Figure 17] It is a diagram showing a state at the start of display of a dedicated scribbling screen for a mobile device. [Figure 18] It is a diagram showing an example of a display of a dedicated scribbling screen for a mobile device. [Figure 19] It is a diagram showing an example of a sticker sheet on which a dedicated sticker image is printed. [Figure 20] It is a diagram showing an example of information uploaded from a photo sticker creation device.

Embodiments for Carrying Out the Invention

[0013] <<Regarding the Photo Sticker Creation Game>> <Appearance of the Photo Sticker Creation Device> FIG. 1 and FIG. 2 are perspective views showing a configuration example of the appearance of a photo sticker creation device 1.

[0014] The photo sticker creation device 1 is a photo creation game machine that provides images of the user. The photo sticker creation device 1 provides images to the user by printing them on sticker paper or making them viewable on the user's mobile device. The photo sticker creation device 1 is installed in amusement facilities such as game centers and stores.

[0015] The users of the photo sticker creation device 1 are mainly high school girls and young women. The photo sticker creation device 1 allows multiple users, typically two or three people per group, to enjoy the game.

[0016] In the photo sticker creation device 1, the user takes a photograph of themselves. Through editing, the user selects an image from the captured images and combines it with other images such as handwritten text or stamp images. This edits the captured image into a colorful image. The user receives a sticker sheet printed with the edited image and completes the game.

[0017] The photo sticker creation device 1 can be described as a photo creation game machine that provides a photo creation game.

[0018] As shown in Figure 1, the photo sticker creation device 1 is basically configured by installing the shooting unit 11 and the editing unit 12 in contact with each other. The shooting unit 11 and the editing unit 12 are electrically connected.

[0019] The shooting unit 11 has a box-shaped housing large enough for a person to enter, and consists of a pre-selection unit 20, a shooting unit 21, and a background unit 22. The pre-selection unit 20 is installed on the side of the shooting unit 21. The space in front of the pre-selection unit 20 becomes the pre-selection space where the pre-selection process is performed. The shooting unit 21 and the background unit 22 are installed at a predetermined distance apart. The space formed between the shooting unit 21 and the background unit 22 becomes the shooting space where the shooting process is performed.

[0020] The pre-selection unit 20 performs pre-selection processing, such as providing guidance introducing games offered by the photo sticker creation device 1 and setting various parameters for the shooting process that takes place in the shooting space. The pre-selection unit 20 is equipped with a coin slot for the user to insert money and a touch panel monitor used for various operations.

[0021] The shooting unit 21 is a device for photographing the user as the subject. The shooting unit 21 is positioned directly in front of the user as they enter the shooting space. On the front of the shooting unit 21, facing the shooting space, are a camera and a touch panel monitor used for various operations.

[0022] If we define the left side as the left side and the right side as the right side from the perspective of a user facing forward in the shooting space, then the left side of the shooting unit 21 is composed of side panel 41A, and the right side is composed of side panel 41B. Furthermore, the front of the shooting unit 21 is composed of front panel 42. The aforementioned pre-selection unit 20 is installed on side panel 41A.

[0023] The background section 22 consists of a rear panel 51, a side panel 52A, and a side panel 52B. The rear panel 51 is a plate-shaped member located on the back side of the user facing forward. The side panel 52A is attached to the left end of the rear panel 51. The side panel 52B is attached to the right end of the rear panel 51.

[0024] The upper parts of side panel 41A and side panel 52A are connected by a plate-shaped connecting part 23A, and the upper parts of side panel 41B and side panel 52B are connected by a connecting part 23B.

[0025] The opening formed by the side panel 41A, the connecting section 23A, and the side panel 52A serves as an entrance and exit to the shooting space. Additionally, the opening formed by the side panel 41B, the connecting section 23B, and the side panel 52B also serves as an entrance and exit to the shooting space.

[0026] Above the shooting space, a ceiling is formed, surrounded by the front of the shooting unit 21, the connecting section 23A, and the connecting section 23B. A ceiling strobe unit 24 is installed in part of the ceiling. One end of the ceiling strobe unit 24 is fixed to the connecting section 23A, and the other end is fixed to the connecting section 23B.

[0027] The ceiling strobe unit 24 incorporates a strobe that illuminates the shooting space in accordance with the shooting conditions. In addition to the strobe, the ceiling strobe unit 24 also has a fluorescent light inside. By emitting the fluorescent light, the ceiling strobe unit 24 also functions as lighting for the shooting space.

[0028] The editing unit 12 is a device for editing captured images. The editing unit 12 is connected to the shooting unit 11 such that one side of the editing unit 12 is in contact with the front panel 42 of the shooting unit 21.

[0029] If the configuration of the editing unit 12 shown in Figure 1 is considered the front side configuration, then the editing unit 12 has components for use in editing work on both its front and back sides. This configuration allows two sets of users to perform editing work simultaneously.

[0030] The front side of the editing unit 12 consists of a vertical surface 61 and a sloped surface 62 formed above the vertical surface 61. The sloped surface 62 is equipped with a tablet-integrated monitor and a stylus pen for use in editing work. A columnar support 63A is provided on the left side of the sloped surface 62 to support one end of the lighting device 64. A columnar support 63B is provided on the right side of the sloped surface 62 to support the other end of the lighting device 64. A support 65 for supporting the curtain rail 25 is provided on the upper surface of the support 63A.

[0031] A curtain rail 25 is installed above the editing unit 12. The curtain rail 25 is made up of three rails 25A to 25C combined together. One end of rails 25A and 25B, which are installed parallel to each other, is fixed to connecting parts 23A and 23B, respectively, and the other ends of rails 25A and 25B are joined to both ends of rail 25C, respectively.

[0032] Curtains are attached to the curtain rail 25 so that the front front and rear front spaces of the editing unit 12 are not visible from the outside. The front front and rear rear spaces of the editing unit 12, enclosed by the curtains, become the editing space where the user performs their editing work.

[0033] <Regarding user movement> Here, we will explain the flow of the photo sticker creation game and the movement of users involved.

[0034] Figure 3 is a top view of the photo sticker making device 1.

[0035] The user inserts the payment into the coin slot in the pre-selection space A0, which is the space in front of the pre-selection unit 20. Next, the user makes various settings according to the screen displayed on the touch panel monitor. For example, the user makes pre-selections such as selecting a course related to the shooting to be performed in the shooting space.

[0036] After completing their pre-selection, the user enters the shooting space A1 through the entrance / exit G1 between side panels 41A and 52A, as indicated by the white arrow #1. The user then takes photos using the camera and touch panel monitor provided in the shooting unit 21.

[0037] After finishing their shoot, users can either exit shooting space A1 through entrance / exit G1 as indicated by the white arrow #2 and move to editing space A2-1, or exit shooting space A1 through entrance / exit G2 as indicated by the white arrow #3 and move to editing space A2-2.

[0038] Editing space A2-1 is the editing space on the front side of editing unit 12. On the other hand, editing space A2-2 is the editing space on the rear side of editing unit 12. Users are guided to which editing space A2-1 or editing space A2-2 to move to by the screen display on the touch panel monitor of the shooting unit 21. For example, the user is guided to move to the available of the two editing spaces. Once a user moves to editing space A2-1 or editing space A2-2, they begin editing.

[0039] Image printing begins at a predetermined time during editing. In the photo sticker creation device 1, image printing is performed while the user is editing. When image printing is complete, the sticker paper with the printed image is ejected from the output port.

[0040] Users who perform editing work in editing space A2-1 and receive the sticker paper will exit editing space A2-1 as indicated by arrow #4, thus ending their use of the photo sticker creation device 1. Similarly, users who perform editing work in editing space A2-2 and receive the sticker paper will exit editing space A2-2 as indicated by arrow #5, thus ending their use of the photo sticker creation device 1.

[0041] <<Configuration of each device>> Next, we will explain the configuration of each device.

[0042] <Configuration of the pre-selection section> Figure 4 shows an example of the configuration of the pre-selection unit 20.

[0043] A touch panel monitor 71 is provided above the pre-selection unit 20. The touch panel monitor 71 consists of a monitor such as an LCD (Liquid Crystal Display) and a touch panel stacked on it. The touch panel monitor 71 has the function of displaying various GUIs (Graphical User Interfaces) and accepting selection operations from the user. The touch panel monitor 71 displays screens used for selecting the number of users, etc.

[0044] A speaker 72 is provided below the touch panel monitor 71. The speaker 72 outputs voice guidance for pre-selection processing, background music, sound effects, etc. Adjacent to the speaker 72 is a coin slot 73 into which the user inserts coins.

[0045] <Composition of the filming department> Figure 5 shows an example of the front configuration of the imaging unit 21. The imaging unit 21 is configured to be surrounded by side panel 41A, side panel 41B, and front panel 42.

[0046] A camera unit 81 is provided slightly above the center of the front panel 42. A camera 91 and a touch panel monitor 92 are provided in front of the camera unit 81.

[0047] Camera 91 is, for example, a single-lens reflex camera and is mounted inside camera unit 81 so that the lens is exposed. Camera 91 has an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor and takes pictures of the user in shooting space A1. Camera 91 functions as a shooting unit that takes pictures of the user as the subject.

[0048] The moving images captured by the camera 91 (hereinafter also referred to as live view images) are displayed in real time on the touch panel monitor 92. Still images captured by the camera 91 at predetermined times, such as when a shooting command is issued, are saved as captured images.

[0049] The touch panel monitor 92 is located below the camera 91. The touch panel monitor 92 consists of a monitor such as an LCD and a touch panel stacked on top of it. The touch panel monitor 92 has the function of a live view monitor that displays moving images captured by the camera 91, and the function of displaying various GUIs and accepting selection operations from the user.

[0050] An upper strobe unit 82 is installed above the camera unit 81, with its curved light-emitting surface facing the user. The upper strobe unit 82 illuminates the user's face and upper body from directly above and in front of the user.

[0051] Below the camera unit 81, a foot strobe unit 83 is provided to illuminate the user's lower body and feet.

[0052] The upper strobe unit 82 and the lower strobe unit 83 are equipped with fluorescent lamps and flash tubes capable of strobe firing. The upper strobe unit 82 and the lower strobe unit 83 constantly illuminate the shooting space with fluorescent lamps, and at the timing of the shot, they fire the flash tubes to illuminate the user who is the subject with strobe light.

[0053] A box-shaped section 84 is provided between the foot-level strobe unit 83 and the side panel 41A. Additionally, a box-shaped section 85 is provided between the foot-level strobe unit 83 and the side panel 41B. The upper surfaces of the box-shaped sections 84 and 85 are approximately horizontal to the mounting surface of the photo sticker creation device 1 and are used as luggage storage areas for users performing photography tasks.

[0054] Additionally, a speaker is installed near the ceiling of the front panel 42. This speaker outputs voice guidance for the shooting process, background music, sound effects, etc.

[0055] <Structure of the editorial unit> Figure 6 shows an example of the configuration of the front side (editing space A2-1 side) of the editing unit 12.

[0056] A tablet-integrated monitor 131 is located approximately in the center of the slope 62. A stylus pen 132A is located to the left of the tablet-integrated monitor 131. A stylus pen 132B is located to the right of the tablet-integrated monitor 131.

[0057] The tablet-integrated monitor 131 is constructed by stacking a tablet and a display. The tablet allows for operation input using stylus pens 132A and 132B. The tablet-integrated monitor 131 displays, for example, a screen used for editing work. When two users are performing editing work, stylus pen 132A is used by the user on the left side of the tablet-integrated monitor 131, and stylus pen 132B is used by the user on the right side of the tablet-integrated monitor 131. Hereafter, when it is not necessary to distinguish between stylus pens 132A and 132B, they will be collectively referred to as stylus pen 132.

[0058] A sticker paper output slot 133 is provided in the lower left corner of the tablet's built-in monitor 131. A printer is installed inside the editing unit 12. Sticker paper printed with an image of the user of editing space A2-1 is ejected from the sticker paper output slot 133.

[0059] <<Internal Configuration of Photo Sticker Making Machine>> <Hardware Configuration> Figure 7 is a block diagram showing an example configuration of the photo sticker manufacturing device 1. In Figure 7, components identical to those described above are denoted by the same reference numerals. Repetitive explanations are omitted as appropriate.

[0060] As shown in Figure 7, the photo sticker creation device 1 is configured such that a pre-selection unit 302, a shooting unit 304, editing units 305A and 305B, and a printing unit 306 are connected to a PC (Personal Computer) unit 301 via an external input / output interface 303. The PC unit 301 is housed, for example, inside the casing of the editing unit 12.

[0061] The CPU (Central Processing Unit) 311, ROM (Read Only Memory) 312, and RAM (Random Access Memory) 313, which constitute the PC unit 301, are interconnected by a bus 314.

[0062] The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creation device 1. The ROM 312 stores the programs and data executed by the CPU 311. The RAM 312 temporarily stores the data and programs processed by the CPU 311.

[0063] The input / output interface 315 connected to the bus 314 is connected to the storage unit 316, the communication unit 317, and the drive 318.

[0064] The memory unit 316 is a non-volatile storage medium such as a hard disk or flash memory. The memory unit 316 stores various setting information supplied by the CPU 311. The information stored in the memory unit 316 is read out by the CPU 311 as needed.

[0065] The communication unit 317 is an interface to a network such as the internet. The communication unit 317 communicates with external devices according to the control of the CPU 311. The communication unit 317 sends images created by the user during the game to an image management server managed by, for example, the manufacturer of the photo sticker creation device 1. Images sent from the communication unit 317 are allocated a predetermined memory area and stored, and are displayed on a mobile terminal that accesses the image management server or downloaded to the mobile terminal.

[0066] A removable media 319, such as an optical disc or semiconductor memory, is appropriately mounted in the drive 318. Programs and data read from the removable media 319 are supplied to the CPU 311 and stored or installed in the storage unit 316.

[0067] An external input / output interface 303 is connected to the input / output interface 315. Control of each component by the PC unit 301 is performed via the external input / output interface 303.

[0068] The pre-selection unit 302 implements pre-selection processing for users in the pre-selection space A0. The pre-selection unit 302 consists of a touch panel monitor 71, a speaker 72, and a coin processing unit 321.

[0069] The touch panel monitor 71 displays various selection screens according to the control of the PC unit 301 and accepts user input on the selection screens. Input signals representing the content of the user's input are supplied to the PC unit 301, and various settings are made.

[0070] The coin processing unit 321 detects when a coin is inserted into the coin slot 73. When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, it outputs a start signal to the PC unit 301 to instruct the game to start.

[0071] The imaging unit 304 performs imaging processing targeting users in imaging space A1. The imaging unit 304 consists of a lighting device 331, a camera 91, a touch panel monitor 92, and a speaker 332.

[0072] The lighting device 331 consists of individual strobe units within the shooting space A1, which emit light according to the lighting control signals supplied from the PC unit 301.

[0073] The camera 91 takes pictures according to the shutter control by the PC unit 301 and outputs the captured image (image data) obtained from the shooting to the PC unit 301.

[0074] Editorial unit 305A provides editing processing for users in editing space A2-1. Editorial unit 305A consists of a tablet-integrated monitor 131, stylus pens 132A and 132B, and speaker 341. Editorial unit 305B provides editing processing for users in editing space A2-2 and has the same configuration as editorial unit 305A. Hereafter, unless otherwise specified, editorial units 305A and 305B will simply be referred to as editorial unit 305.

[0075] The tablet's built-in monitor 131 displays the editing screen according to the control of the PC unit 301 and accepts user input on the editing screen. Input signals representing the user's input are supplied to the PC unit 301, and the captured image to be edited is edited.

[0076] The printing unit 306 is configured to include a printer 351. A sticker paper unit 352 is mounted on the printer 351.

[0077] The printer 351 drives its built-in head 361 and prints an image onto a roll of sticker paper 363 stored in the sticker paper unit 352, based on the print data supplied from the PC unit 301. The printer 351 also cuts the printed sticker paper 363 at predetermined cutting positions using a cutter 362 and discharges it to the sticker paper output port. Various media other than sticker paper that can print photographs can be used as the printing medium.

[0078] <Example of Functional Configuration> Figure 8 is a block diagram showing an example of the functional configuration of the photo sticker creation device 1. At least some of the functional units shown in Figure 8 are realized by the execution of a predetermined program by the CPU 311.

[0079] In the photo sticker creation device 1, a control unit 401 is implemented. The control unit 401 consists of a pre-selection processing unit 411, a shooting processing unit 412, an editing processing unit 413, a printing processing unit 414, and a transmission processing unit 415.

[0080] The pre-selection processing unit 411 executes the pre-selection process by controlling each part of the pre-selection unit 302. The pre-selection process involves selecting the number of users, the shooting course, and so on. Information representing the user's selections is supplied to the shooting processing unit 412.

[0081] The shooting processing unit 412 performs the shooting process by controlling each part of the shooting unit 304. In the shooting process, for example, multiple images, such as six, are taken by changing the shooting course. By changing the shooting parameters and the parameters of the flash light during shooting for each shooting course, images with different impressions are taken depending on the shooting course.

[0082] The imaging processing unit 412 outputs the data of multiple captured images obtained through the imaging process to the editing processing unit 413. The captured image data output from the imaging processing unit 412 is supplied to each part of the editing processing unit 413.

[0083] The editing processing unit 413 consists of a display control unit 421, a sticker-specific image generation unit 422, and a mobile-specific image generation unit 423.

[0084] The editing processing unit 413 performs editing by controlling each part of the editing unit 305. The editing process includes editing the captured image, printing the image onto sticker paper, and transmitting the image to an external device, the image management server.

[0085] The image editing process involves applying image processing to the target image, corresponding to the editing work performed using a pre-prepared tool selected by the user, such as a pen tool or stamp tool. By using the pen tool or stamp tool, the pen image or stamp image, which serves as a composite image, is superimposed onto the target image.

[0086] The editing tools include not only tools for applying image processing to a portion of the image being edited, but also filter tools for applying image processing to the entire image. Users can select their preferred tool and proceed with editing the image by selecting the area to be processed on the image being edited.

[0087] In this way, the editing process for captured images can be carried out by the user using the stylus pen 132, giving the feeling of doodling on the captured image. Hereafter, the editing process will be referred to as doodling.

[0088] The editing processing unit 413 provides two types of graffiti: graffiti specifically for stickers and graffiti specifically for mobile phones.

[0089] Sticker-specific graffiti is graffiti used to create images to be printed on sticker paper. Images created using sticker-specific graffiti are used for printing on sticker paper. In other words, images created using sticker-specific graffiti are images specifically for printing.

[0090] On the other hand, mobile-specific graffiti is graffiti created to produce images to be sent to an image management server. Images with graffiti created using mobile-specific graffiti are used to send to the image management server. In other words, images with graffiti created using mobile-specific graffiti are images for transmission only.

[0091] Note that "print-only" indicates that the image's intended use is for printing, one of two uses (printing and transmission). Similarly, "transmission-only" indicates that the image's intended use is for printing, one of two uses (printing and transmission). Print-only images are never used to send images to an image server, and transmission-only images are never used to print on sticker paper. In other words, print-only and transmission-only images may be used for purposes other than printing and transmission, such as displaying images on the tablet's built-in monitor 131.

[0092] As described above, the images sent to the image management server can be viewed or downloaded on a mobile device such as a smartphone by the user after the game on the photo sticker creation device 1 is finished.

[0093] These sticker-specific and mobile phone-specific graffiti are performed using separate graffiti screens. Details of each graffiti screen will be described later.

[0094] The display control unit 421 of the editing processing unit 413 displays various screens, including a dedicated sticker drawing screen and a dedicated mobile phone drawing screen, on the tablet's built-in monitor 131. The display control unit 421 controls the display of the screen according to the user's operation.

[0095] The sticker-specific image generation unit 422 processes the captured image of the object to be graffitied on in response to the user's operation on the sticker-specific graffiti screen, and generates a sticker-specific image. The sticker-specific image is a print-only image that has been graffitied on using the sticker-specific graffiti function. The sticker-specific image generation unit 422 outputs the sticker-specific image generated by the image processing to the print processing unit 414.

[0096] The mobile-only image generation unit 423 processes the captured image to be graffitied on in response to the user's operation on the mobile-only graffiti screen, and generates a mobile-only image. The mobile-only image is a transmission-only image that has been graffitied on using the mobile-only graffiti function. The mobile-only image generation unit 423 outputs the mobile-only image generated by the image processing to the transmission processing unit 415.

[0097] The printing processing unit 414 outputs the print data to the printer 351 and prints the image specifically for stickers onto sticker paper.

[0098] The transmission processing unit 415 communicates with the image management server by controlling the communication unit 317 and sends (uploads) mobile-specific images to the image management server.

[0099] <<Operation of the photo sticker creation device>> <Photo Sticker Creation Game> Now, referring to the flowchart in Figure 9, we will explain the operation of the photo sticker creation device 1 that provides the photo sticker creation game.

[0100] In step S1, the pre-selection processing unit 411 determines whether or not a predetermined amount of coins has been inserted, and waits until it determines that coins have been inserted.

[0101] If it is determined in step S1 that a coin has been inserted, in step S2 the pre-selection processing unit 411 performs pre-selection processing, including selecting the number of users and selecting the shooting course.

[0102] In step S3, the shooting processing unit 412 controls the shooting unit 304 and performs the shooting process. Specifically, the shooting processing unit 412 displays the moving image captured by the camera 91 on the touch panel monitor 92 in live view. The shooting processing unit 412 also photographs the user in the shooting space A1 as the subject and generates a captured image.

[0103] For example, a close-up image showing the user's face and upper body, and a full-body image showing the entire body, are taken. The shooting process is completed when multiple images, including the close-up and full-body images, have been taken.

[0104] In step S4, the editing processing unit 413 performs editing by controlling the editing unit 305 that corresponds to the editing space that the user has moved to after completing the shooting process, out of editing spaces A2-1 and A2-2.

[0105] <Details of the editing process> Next, referring to the flowchart in Figure 10, the editing process performed in step S4 of Figure 9 will be explained.

[0106] In step S11, the display control unit 421 of the editing processing unit 413 displays the address input screen on the tablet's built-in monitor 131.

[0107] The address input screen is used for users to enter their email address. The address input screen displays a software keyboard and other elements used for entering the email address.

[0108] The email address entered here is uploaded to the image management server along with the mobile-specific image, and is used to notify the user via email of the URL where the mobile-specific image is stored. For example, by tapping the URL notified via email, the user can display the mobile-specific image created in the game of the photo sticker creation device 1 on the screen of their mobile device.

[0109] In step S12, the display control unit 421 displays the sticker graffiti image selection screen on the tablet's built-in monitor 131. The sticker graffiti image is a photographed image used for graffiti on stickers.

[0110] By using the sticker graffiti image selection screen, a predetermined number of images are selected from among the multiple images obtained through the shooting process to be used as sticker graffiti images.

[0111] Figure 11 shows an example of the display of the image selection screen for sticker graffiti.

[0112] The sticker drawing image selection screen displays six captured images, P1 through P6, side by side, representing the images obtained through the shooting process. The two people in captured images P1 through P6 are the two users themselves who are playing the game on the photo sticker creation device 1.

[0113] A message is displayed above the captured images P1 through P6, instructing the user to select two images to be used for sticker drawing. In this example, it is possible to select two images from the six captured images to be used for sticker drawing.

[0114] Furthermore, each of the captured images P1 to P6 is displayed bordered by a border image P11, which is a predetermined design image containing text such as the model name of the photo sticker creation device 1. Sticker-specific images created by sticker-specific graffiti also include a border image. The combination of captured images P1 to P6 and border image P11 represents the final image of the sticker paper that the user can obtain.

[0115] The user selects an image for sticker drawing by pressing a designated image using the stylus pen 132. In the example in Figure 11, the user standing to the left of the tablet's built-in monitor 131 selects image P3, and the user standing to the right selects image P5. Images P3 and P5 are displayed grayed out along with their respective border images P11. For example, if the OK button is pressed after both users have selected one image each, the selection of images for sticker drawing is complete.

[0116] Once the selection of images for sticker drawing is complete, in step S13 of Figure 10, the display control unit 421 displays a sticker-specific drawing screen on the tablet's built-in monitor 131. In other words, in this example, of the two types of drawing—sticker-specific drawing and mobile phone-specific drawing—sticker-specific drawing is performed first.

[0117] Figure 12 shows an example of the display of the sticker-only graffiti screen.

[0118] At the top of the sticker drawing screen, a flowchart is provided to show the game's progress. In the example in Figure 12, the words "Sticker Drawing" are highlighted with an underline and symbols, indicating that the current status is that of the sticker drawing screen. The availability of this flowchart allows users to understand the flow of the game during the editing process and their current status.

[0119] On the left side of the sticker-dedicated graffiti screen, a graffiti input area 511L is formed, and on the right side, a graffiti input area 511R is formed. The graffiti input areas 511L and 511R are the areas where the captured image selected as the image for graffiti on the sticker is displayed as the target for graffiti.

[0120] In the example shown in Figure 12, the image P3 selected by the user standing on the left is displayed in the graffiti input area 511L as the image for graffiti on the sticker. Additionally, the image P5 selected by the user standing on the right is displayed in the graffiti input area 511R as the image for graffiti on the sticker.

[0121] The user standing on the left will draw on the captured image P3 displayed in the drawing input area 511L, while the user standing on the right will draw on the captured image P5 displayed in the drawing input area 511R.

[0122] To the right of the drawing input area 511L, a tool area 512L is formed, which contains buttons such as the one pressed when selecting the eraser tool and the one pressed when resetting (initializing) the drawing.

[0123] To the left of the drawing input area 511L, along the left edge of the screen, are a series of semi-circular tool tabs 513-1L to 513-5L, which are pressed when selecting various tools (drawing tools).

[0124] Tool tab 513-1L is the tab that is pressed when selecting the filter tool, and tool tab 513-2L is the tab that is pressed when selecting the pen tool. Tool tab 513-3L is the tab that is pressed when selecting the stamp tool, and tool tab 513-4L is the tab that is pressed when selecting the texture tool. Tool tab 513-5L is the tab that is pressed when selecting the seal color tool. For example, the seal color tool is used when selecting the design of a border image.

[0125] On the other hand, to the left of the drawing input area 511R, there is a tool area 512R with the same buttons as those displayed in the tool area 512L. Also, to the right of the drawing input area 511R, along the right edge of the screen, are semi-circular tool tabs 513-1R to 513-5R, which have the same functions as the tool tabs 513-1L to 513-5L.

[0126] On the sticker-dedicated drawing screen, at least the tool tabs 513-1L to 513-5L and tool tabs 513-1R to 513-5R, which are pressed as buttons when selecting various tools, are displayed symmetrically on the left and right edges of the screen.

[0127] For example, if the tool tab 513-3L is pressed by a user standing on the left and the tool tab 513-2R is pressed by a user standing on the right, each tab will extend toward the center of the screen, as shown in Figure 13.

[0128] The horizontal strip-shaped tool tab 513-3L, which is displayed overlaid on the graffiti input area 511L, displays multiple buttons, each representing a different stamp image. When a designated button is pressed from among the buttons displayed on the tool tab 513-3L, the stamp tool is selected, and the display of the tool tab 513-3L returns to the state shown in Figure 12.

[0129] Meanwhile, the horizontal strip-shaped tool tab 513-2R, which is overlaid on the drawing input area 511R, displays multiple buttons, each representing a different pen image. When a specific button is pressed from among the buttons displayed on the tool tab 513-2R, the pen tool is selected, and the display of the tool tab 513-2R returns to the state shown in Figure 12.

[0130] Similarly, if any other tab is clicked, the clicked tab will extend towards the center of the screen, and multiple buttons will be displayed on the extended tab.

[0131] In this way, by making the buttons used for selecting tools appear only when a tab is pressed, the display control unit 421 can enlarge the graffiti input areas 511L and 511R.

[0132] The large display of the graffiti input areas 511L and 511R allows each user to carefully graffiti on the single image they have selected as the graffiti image for the sticker, paying attention to even the smallest details. Furthermore, because there is only one image for graffiti, users can concentrate on doodling on that single image.

[0133] Multiple images can be selected as images for drawing on stickers. In this case, as with the mobile-specific drawing screen described later (see Figure 18, etc.), thumbnail images used to select the images to be drawn on are displayed, for example, in the center of the sticker-specific screen. Depending on the thumbnail image selected, the images to be drawn on are switched.

[0134] Figure 14 is a magnified view of the graffiti input area 511L.

[0135] In the graffiti input area 511L, the captured image P3 selected as the image for graffiti on the sticker is displayed, bordered by a border image P11, which is an image with a predetermined design that includes text such as the model name of the photo sticker creation device 1. As explained with reference to Figure 11, the sticker-specific image created by sticker-specific graffiti also includes a border image that represents the design of the edge of the sticker paper.

[0136] In this way, the graffiti input area 511L, which is the input area for graffiti specifically for stickers, displays the captured image P3 along with the border image P11, which represents the border design of the sticker paper, the printing medium. Since the captured image is displayed as if it were printed on sticker paper, users can graffiti while imagining the finished product. The display in the graffiti input area 511R is the same, except that the captured image used for graffiti is different.

[0137] Figure 15 shows an example of graffiti input.

[0138] As explained with reference to Figure 13, for example, if the stamp tool is selected and an input position is specified on the graffiti input area 511L, the stamp image will be superimposed on the captured image displayed in the graffiti input area 511L, as shown in Figure 15.

[0139] In the example shown in Figure 15, stamp image 521 is superimposed on the user on the left, and stamp image 522 is superimposed on the user on the right. Additionally, a heart-patterned stamp image 523 is superimposed so as to span across the captured image P3 and the border image P11.

[0140] In this way, the entire graffiti input area 511L becomes the target for graffiti input. Users can input graffiti not only on the target image P3 but also on the border image P11 displayed around the image P3. This type of display is used for graffiti specifically for stickers.

[0141] In step S14 of Figure 10, the sticker-specific image generation unit 422 performs image processing on the captured image of the subject to be drawn on, in response to user operations, and generates a sticker-specific image. For example, if a pre-set time limit has elapsed, the sticker-specific drawing process ends.

[0142] If the sticker-specific drawing is finished, in step S15, the display control unit 421 displays the sticker layout selection screen on the tablet's built-in monitor 131.

[0143] The sticker layout selection screen is used to select a sticker layout. A sticker layout is a layout (arrangement pattern) that defines the position and size of the photographed images placed on the sticker paper, as well as the overall design of the sticker paper.

[0144] Figure 16 shows an example of the sticker layout selection screen.

[0145] On the left side of the sticker layout selection screen, images P101 and P102 are displayed, representing images with doodles already added. Images P101 and P102 represent images created using the sticker-specific doodle function. Stamp images and other elements added using the sticker-specific doodle function are also displayed in images P101 and P102.

[0146] On the right side of the sticker layout selection screen, images P111 to P114 are displayed, representing images where the two photographed images selected as images for sticker drawing are arranged in a predetermined configuration. For example, image P111 is a layout in which the two photographed images selected as images for sticker drawing are printed on a single sheet of sticker paper. Note that the photographed images that make up images P111 to P114 do not reflect any doodles entered using the sticker drawing function.

[0147] In the example shown in Figure 16, users can select two sticker layouts to print from a selection of six available layouts. For example, if two users each select one sticker layout and then press the OK button, the sticker layout selection process is complete.

[0148] Once the sticker layout selection is complete, in step S16 of Figure 10, the printing processing unit 414 starts printing the image specifically for the sticker.

[0149] After printing of the sticker image begins, in step S17, the display control unit 421 displays the mobile-only drawing screen on the tablet's built-in monitor 131. In other words, while the sticker image is being printed, the user starts drawing on the mobile-only drawing screen.

[0150] Unlike when using stickers for graffiti, the selection of images to be graffitied on is not performed before using mobile phone-specific graffiti. For mobile phone-specific graffiti, all six images obtained through the shooting process are used as the target for graffiti.

[0151] Figure 17 shows the state at the start of displaying the mobile-specific drawing screen.

[0152] In the flow display located at the top of the mobile-only graffiti screen, the words "Mobile Graffiti" are highlighted, indicating that the current status is that of mobile-only graffiti.

[0153] When the mobile-specific graffiti screen is displayed, the graffiti input area 551L formed on the left side of the screen and the graffiti input area 551R formed on the right side of the screen each display a captured image that has been graffitied using the sticker graffiti feature. In the example in Figure 17, captured images P3 and P5, which have been selected as images for sticker graffiti and have been graffitied on them, are displayed.

[0154] Additionally, a button used to select whether to turn sticker graffiti on or off is displayed in the speech bubble 561L to the left of the graffiti input area 551L. Similarly, a button used to select whether to turn sticker graffiti on or off is displayed in the speech bubble 561R to the right of the graffiti input area 551R. Speech bubbles 561L and 561R display a message guiding the user on whether or not to leave graffiti specifically for stickers.

[0155] In other words, the content of the graffiti specifically for stickers can be reflected in the graffiti specifically for mobile phones. When "Sticker Graffiti On" is selected, the graffiti specifically for mobile phones starts with the same content as the graffiti specifically for stickers entered into the same captured image used for the graffiti specifically for stickers. The mobile phone image generation unit 423 performs image processing on one of the six captured images used for the graffiti specifically for stickers, and generates a mobile phone image with the same content as the graffiti specifically for stickers.

[0156] As mentioned above, with sticker-specific graffiti, it is possible to input graffiti across the entire area of ​​the captured image and border image displayed in the graffiti input area. When "Sticker Graffiti On" is selected, for example, only graffiti with the same content as the graffiti entered on the captured image will be reflected. It is also possible to have the content of graffiti entered on the border image reflected as well.

[0157] After the sticker graffiti on / off setting is selected, the mobile-specific graffiti screen will switch to the display shown in Figure 18.

[0158] As shown in Figure 18, the mobile-specific drawing screen is basically composed of displays arranged symmetrically on either side of a central thumbnail display area 553. The left area is used by users standing to the left of the tablet's built-in monitor 131. The right area is used by users standing to the right of the tablet's built-in monitor 131.

[0159] Note that the dashed rectangular lines surrounding each area on the mobile-only drawing screen shown in Figure 18 are not actually displayed on the screen.

[0160] The thumbnail display area 553, located in the center of the mobile-specific drawing screen, is a display area for thumbnail images representing the captured images. The user selects the captured image to be used for drawing using the thumbnail images displayed in the thumbnail display area 553.

[0161] The thumbnail display area 553 displays six thumbnail images representing the captured images side by side. In the example in Figure 18, the user standing on the left selects the top-left thumbnail image, and the user standing on the right selects the top-right thumbnail image. The top-left thumbnail image represents the first captured image P1, and the top-right thumbnail image represents the fourth captured image P4.

[0162] A graffiti input area 551L is provided approximately in the center of the left-hand area. The graffiti input area 551L is the display area for the captured image to be graffitied on, which has been selected using a thumbnail image. The user can select a tool using the stylus pen 132A and edit the captured image P1 displayed in the graffiti input area 551L.

[0163] As shown in Figure 18, the graffiti input area 551L of the mobile-only graffiti screen displays only the captured image to be graffitied on. In other words, unlike the graffiti screen for stickers, the captured image to be graffitied on is displayed without a border image.

[0164] To the right of the drawing input area 551L is a tool area 552L, which contains buttons such as the one pressed when selecting the eraser tool and the one pressed when resetting the drawing.

[0165] Below the graffiti input area 551L is a palette area 554L. The palette area 554L is an area where buttons and other elements used to select various tools to be composited onto the captured image displayed in the graffiti input area 551L are displayed.

[0166] To the right of the palette area 554L is the tab area 555, which displays tabs used for selecting tool categories. Users can switch between the tools displayed in the palette area 554L using these tabs.

[0167] To the left of the graffiti input area 551L, a status image 556L is displayed that shows the printing status of the sticker-specific image. The display of the status image 556L changes, for example, depending on the printing status of the sticker-specific image, so that the sticker-specific image gradually appears.

[0168] The status image 556L displays information such as "XX%" indicating the progress of printing the sticker-specific image. For example, when printing the sticker-specific image is complete, the progress will be displayed as 100%.

[0169] Figure 19 shows an example of sticker paper with an image specifically printed on it.

[0170] When printing of the sticker-specific image is complete, sticker paper s1 and sticker paper s2, as shown in Figure 19, with the sticker-specific image printed on them, are discharged into the sticker paper discharge port 133 (Figure 6). The image printed on sticker paper s1 is an image generated specifically for stickers, combining the doodled photographic image P3 and the border image P11. The image printed on sticker paper s2 is an image generated specifically for stickers, combining the doodled photographic image P5 and the border image P11.

[0171] The user takes out these sticker papers s1 and s2 from the sticker paper output slot 133 and continues drawing on their mobile phone.

[0172] Returning to the explanation in Figure 18, the user uses a mobile-specific graffiti screen, which has a different screen configuration from the sticker-specific graffiti screen described above, to graffiti on each of the six captured images. The tools available on the sticker-specific graffiti screen and the tools available on the mobile-specific graffiti screen differ in at least some respects.

[0173] Furthermore, the right-hand area, used by a user standing to the right of the tablet's built-in monitor 131, has the same configuration as the left-hand area described above, but arranged symmetrically.

[0174] In step S18 of Figure 10, the mobile-specific image generation unit 423 processes the captured image to be used for graffiti in response to user operations and generates a mobile-specific image. For example, if a pre-set time limit has elapsed, the mobile-specific graffiti process ends. Because there are many captured images to be used for graffiti, the time limit for mobile-specific graffiti is set to be longer than the time limit for sticker graffiti.

[0175] If the mobile-specific graffiti is completed, in step S19, the display control unit 421 displays an image selection screen on the tablet's built-in monitor 131. The image selection screen displayed here is used to select one mobile-specific image from among the six mobile-specific images that have been graffitied on by the mobile-specific graffiti.

[0176] Of the six mobile-specific images uploaded to the image management server, one mobile-specific image selected using the image selection screen is provided to the free member user. The image provision service provided by the image management server is a membership-based service that allows users to view images on their mobile devices and download images to their mobile devices.

[0177] Free members can view one mobile-only image, while paid members can view all mobile-only images.

[0178] If the selection of mobile-only images is complete, in step S20, the transmission processing unit 415 sends the mobile-only images to the image management server.

[0179] Figure 20 shows an example of information uploaded from the photo sticker creation device 1.

[0180] As shown in Figure 20, management information is attached to the image files of the six mobile-specific images before they are uploaded. The management information is generated in the photo sticker creation device 1 to manage the uploaded images and is sent to the image management server 601. The image management server 601 manages the uploaded images by linking them to each piece of information included in the management information.

[0181] Management information includes seal ID, image selection flag, and email address.

[0182] The sticker ID is an ID issued by the photo sticker creation device 1 for each game, according to predetermined rules. For example, the sticker ID is notified to the user by being printed on the edge of the sticker paper on which the sticker image is printed. When a user of a mobile terminal who has logged into the image provision service (a user who has played the game on the photo sticker creation device 1) looks at the edge of the sticker paper and enters the sticker ID, the image management server 601 identifies the image created by the user in the game. In this way, the sticker ID is used to identify the image created by each user.

[0183] The image selection flag is a flag that represents the mobile-specific image selected by the user during the game using the image selection screen.

[0184] The email address is the user's email address entered during the game.

[0185] Each group of users of the photo sticker creation device 1 is provided with a photo creation game consisting of the series of processes described above.

[0186] Through the above series of processes, users can use different drawing screens to draw on stickers and draw on mobile phones, creating drawn images tailored to each purpose.

[0187] By providing separate drawing screens for each purpose, users can intuitively understand what to do with each drawing screen, enabling them to draw efficiently.

[0188] If it were possible to draw on a sticker-specific drawing screen for mobile-specific images, the drawing screen's layout would become complex, making the operation less intuitive. However, this problem can be prevented.

[0189] <<Variation>> Of the two types of graffiti—graffiti specifically for stickers and graffiti specifically for mobile phones—graffiti specifically for stickers is supposed to be done first, but it is also acceptable to have graffiti specifically for mobile phones done first.

[0190] While the number of images eligible for sticker-only graffiti is set to be greater than the number of images eligible for mobile phone-only graffiti, it is also acceptable to set the number of images eligible for sticker-only graffiti to be greater. In this case, the time limit for sticker-only graffiti will be set to be longer than the time limit for mobile phone-only graffiti.

[0191] The number of images to be used for sticker-specific graffiti and the number of images to be used for mobile phone-specific graffiti may be the same.

[0192] The series of processes described above can be executed by hardware or by software. When the series of processes are executed by software, the programs that make up the software are installed on a computer that is built into dedicated hardware, or on a general-purpose personal computer.

[0193] The program to be installed is provided by recording it on removable media 319, such as an optical disc (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or semiconductor memory. Alternatively, it may be provided via wired or wireless transmission media such as a local area network, the internet, or digital broadcasting. The program can be pre-installed in ROM 312 or storage unit 316.

[0194] The programs executed by the computer may be programs that are processed chronologically in the order described herein, or they may be programs that are processed in parallel or at necessary times, such as when they are called. [Explanation of symbols]

[0195] 1 Photo sticker creation device, 131 Tablet-integrated monitor, 301 PC unit, 302 Pre-selection unit, 304 Shooting unit, 305 Editing unit, 306 Printing unit, 401 Control unit, 411 Pre-selection processing unit, 412 Shooting processing unit, 413 Editing processing unit, 414 Printing processing unit, 415 Transmission processing unit, 421 Display control unit, 422 Sticker-specific image generation unit, 423 Mobile-specific image generation unit

Claims

1. A display control unit that displays a first editing screen used for creating an image for printing, and after the creation of the image for printing using the first editing screen, displays a selection screen used for selecting the print layout. A printing unit prints the printable image created using the first editing screen based on the layout selected using the selection screen. Equipped with, The display control unit is used to create images for transmission to an external device, and displays a second editing screen, which has tools that are at least partially different from the tools provided on the first editing screen, after the selection of a layout using the selection screen has been completed. Image processing device.

2. The display control unit displays the first editing screen in which the image to be edited is bordered with a border image representing the design of the print medium's border. The image processing apparatus according to claim 1.

3. The system further comprises a print image generation unit that edits the image to be edited in response to input to the region of the edge image and generates the print image. The image processing apparatus according to claim 2.

4. The display control unit displays the second editing screen in parallel with printing the image for printing. The image processing apparatus according to claim 1.

5. The system further includes a transmission image generation unit that generates the transmission image by applying the same editing content as the editing performed using the first editing screen to the same image that was edited using the first editing screen. The image processing apparatus according to claim 1.

6. The image processing device The first editing screen used to create images for printing is displayed. After creating the print image using the first editing screen, a selection screen used to select the print layout is displayed. The printable image created using the first editing screen is printed based on the layout selected using the selection screen. A second editing screen, which is used to create images for transmission to an external device and contains tools that differ in some respects from those provided on the first editing screen, is displayed after the selection of a layout using the selection screen is complete. Information processing methods.

7. On the computer, The first editing screen used to create images for printing is displayed. After creating the print image using the first editing screen, a selection screen used to select the print layout is displayed. The printable image created using the first editing screen is printed based on the layout selected using the selection screen. A second editing screen, which is used to create images for transmission to an external device and contains tools that differ in some respects from those provided on the first editing screen, is displayed after the selection of a layout using the selection screen is complete. A program to execute a process.

Images