Image processing device, image processing method, and program

The image processing device addresses user preference for mobile viewing by allowing easy editing and layout design for captured images, supporting both printed and mobile-compatible formats.

JP7590641B2Active Publication Date: 2024-11-27FURYU KK
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
JP2020187272
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-11-10
Publication Date
2024-11-27
Estimated Expiration
2040-11-10

AI Technical Summary

Technical Problem

Users prefer to view images on mobile devices rather than having them printed on sticker paper and desire easy editing options for such images.

Method used

An image processing device that allows users to easily edit and select layout designs by arranging captured images with various angles of view, combining them with superimposed content and background designs, and generating layout images for both printing and mobile viewing.

Benefits of technology

Enables easy editing and layout selection for captured images, facilitating both printed and mobile-compatible image formats.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007590641000001
    Figure 0007590641000001
  • Figure 0007590641000002
    Figure 0007590641000002
  • Figure 0007590641000003
    Figure 0007590641000003
Patent Text Reader

Abstract

To provide an image processing device capable of easily performing edition of captured images and selection of layout designs.SOLUTION: An image processing device in one embodiment generates a layout image according to user's choices of a layout image design which is constituted of placing a pick-up image by synthesizing a pick-up image with a first content which is superimposed on a person in a pick-up image and a second content that represents a design of the area around the pick-up image. The art is applicable to a photo creation game machine that provides a series of a game to print a captured image on a seal sheet.SELECTED DRAWING: Figure 12
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] In particular, the present technology relates to an image processing device, an image processing method, and a program that enable easy editing of captured images and selection of layout designs.

[0002] Conventionally, photo sticker creation devices are known. The photo sticker creation devices take a picture of a user, allow the user to edit the photographed image, and print the edited image on sticker paper for provision. The photo sticker creation devices are installed in amusement facilities and the like.

[0003] The flow of one game provided by the photo sticker creation device typically involves taking a photo of the user in the shooting space as the subject, then moving the user to the editing space, editing the image according to the operations performed in the editing space, and printing the edited image on sticker paper.

[0004] The images obtained by shooting are edited using an editing screen displayed on a display provided in the editing space after moving from the shooting space to the editing space. The editing screen displays the image to be edited as well as buttons used to select various editing tools.

[0005] For example, Patent Document 1 discloses a photo sticker creation device that allows a user to select a sticker layout after editing a photographed image. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2019-121996 A Summary of the Invention [Problem to be solved by the invention]

[0007] Many users consider it important to receive the images obtained from the game in a format that can be viewed on a mobile device such as a smartphone, rather than printed on sticker paper. For such users, it is preferable to have a simple function that allows them to easily edit the images to be printed on sticker paper.

[0008] The present technology has been made in view of such circumstances, and makes it possible to easily edit captured images and select layout designs. [Means for solving the problem]

[0009] According to one aspect of the present technology, there is provided an image processing device that, in response to a user's selection of a design of a layout image formed by arranging photographed images, 、 A first content to be superimposed on the person and composited, and the photographed image The area in which and a second content representing the design of the surrounding area. Among the plurality of captured images having a plurality of different angles of view, the angle of view set for the design selected by the user is and an image processing unit for combining the captured image with the layout image to generate the layout image.

[0010] In one aspect of the present technology, a design of a layout image formed by arranging photographed images is selected by a user. 、 A first content to be superimposed on the person and composited, and the photographed image The area in which and a second content representing the design of the area surrounding the Among the plurality of captured images having a plurality of different angles of view, the angle of view set for the design selected by the user is The layout image is generated by combining the captured image with the image data. Effect of the Invention

[0011] According to the present technology, it is possible to easily edit a captured image and select a layout design. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a perspective view showing an example of the external configuration of a photo sticker creating device. [Diagram 2] FIG. 2 is a perspective view of the photo sticker creating device as seen from another angle. [Diagram 3] FIG. 2 is a perspective view showing an example of the configuration of the front of the imaging space. [Figure 4] FIG. 2 is a perspective view showing an example of the configuration of a ceiling surface of a photography space. [Diagram 5] FIG. 2 is a diagram showing an example of a captured image. [Figure 6] 1 is a block diagram showing an example of the configuration of a photo sticker creating device; [Figure 7] 2 is a block diagram showing an example of a functional configuration of the photo sticker creating device; [Figure 8] 2 is a block diagram showing an example of the configuration of an edit processing unit; [Figure 9] 10 is a flowchart illustrating an operation of the photo sticker creating device. [Figure 10] 10 is a flowchart illustrating the editing process performed in step S4 of FIG. 9. [Figure 11] 11 is a flowchart illustrating a sticker design selection process performed in step S12 of FIG. [Figure 12] FIG. 13 is a diagram showing an example of a sticker design selection screen. [Figure 13] FIG. 1 is an enlarged view of a sample image; [Figure 14] FIG. 13 is a diagram showing examples of content that are components of a sticker design. [Figure 15] FIG. 13 is a diagram illustrating an example of a template. [Figure 16] FIG. 13 is a diagram showing an example of generation of an image for a sticker. [Figure 17] FIG. 13 is an enlarged view of another sample image. [Figure 18] FIG. 13 is a diagram showing examples of content that are components of a sticker design. [Figure 19] FIG. 13 is a diagram showing an example of generation of an image for a sticker. [Figure 20] FIG. 13 is a diagram showing an example of an image selection screen. [Figure 21] FIG. 13 is a diagram showing an example of a sticker image. [Figure 22] FIG. 13 is a diagram showing an example of a printed sticker sheet. [Figure 23] FIG. 13 is a diagram showing a display example of a mobile-only graffiti screen. [Figure 24] FIG. 13 is a diagram showing an editing process using a role-playing stamp. [Diagram 25] 25 is an enlarged view of the graffiti input area in FIG. 24. FIG. [Figure 26] 13 is an enlarged view of a stamp image constituting the role-playing stamp; FIG. [Figure 27] 13A to 13C are diagrams illustrating an example of an operation when adjusting a stamp image. [Figure 28] FIG. 13 is a diagram showing an example of an enlarged stamp image. [Figure 29] FIG. 11 is another diagram showing an example of enlarging the stamp image. [Diagram 30] FIG. 11 is a diagram showing types of adjustment. [Diagram 31] FIG. 13 is a diagram showing an example of movement of a stamp image. [Diagram 32] 13A and 13B are diagrams illustrating an example of taking over adjustment of a stamp image. [Diagram 33] FIG. 13 is a diagram showing the difference in synthesis position. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] <<Configuration of the photo sticker creation device>> <External configuration> 1 and 2 are perspective views showing an example of the external configuration of a photo sticker creating device 1. FIG.

[0014] The photo sticker creation device 1 is a game machine that provides a captured image of a user as a subject. The photo sticker creation device 1 provides images to a user by printing the captured image on sticker paper or by making the captured image viewable on the user's mobile terminal. The photo sticker creation device 1 is installed in an amusement facility such as a game center or in a store.

[0015] The users of the photo sticker creating device 1 are mainly high school girls and young women. In the photo sticker creating device 1, a plurality of users, usually two or three people per group, can enjoy the game.

[0016] The user of the photo sticker creation device 1 takes a photo of himself / herself as the subject. The user selects an image from the images obtained by shooting and performs editing to combine it with a composite image such as handwritten characters or a stamp image. In this way, the captured image is edited into a colorful image. The user receives a sticker paper with an image of himself / herself printed on it, completing the series of games.

[0017] The photo sticker creating device 1 can be said to be a photo creating game machine that provides a photo creating game.

[0018] 1, the photo sticker creating device 1 is basically configured by installing a photographing unit 11 and an editing unit 12 in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected.

[0019] The photographing unit 11 has a box-shaped housing with a space large enough for a person to enter, and is composed of a pre-selection section 20, a photographing section 21, and a background section 22. The pre-selection section 20 is installed on the side of the photographing section 21. The space in front of the pre-selection section 20 becomes a pre-selection space where pre-selection processing is performed. In addition, the photographing section 21 and the background section 22 are installed a predetermined distance apart. The space formed between the photographing section 21 and the background section 22 becomes a photographing space where photographing processing is performed.

[0020] As a pre-selection process, the pre-selection unit 20 performs guidance to introduce the game provided by the photo sticker creating device 1 and performs various settings for photography in the photography space. The pre-selection unit 20 is provided with a coin slot through which the user inserts money, a touch panel monitor 71, etc.

[0021] The touch panel monitor 71 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and accepting selection operations by the user. A screen used for selecting the number of users, etc. is displayed on the touch panel monitor 71.

[0022] The photographing unit 21 is a device for photographing a user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the photographing unit 21 facing the photographing space.

[0023] Assuming that the left side as viewed from a user facing forward in the photographing space is the left side and the right side is the right side, the left side of the photographing unit 21 is made up of side panel 41A and the right side is made up of side panel 41B. Furthermore, the front of the photographing unit 21 is made up of front panel 42. The above-mentioned pre-selection unit 20 is installed on side panel 41A.

[0024] The background unit 22 is composed of a rear panel 51, a side panel 52A, and a side panel 52B. The rear panel 51 is a plate-like member located behind a user facing forward. The side panel 52A is attached to the left end of the rear panel 51. The side panel 52B is attached to the right end of the rear panel 51.

[0025] The opening between side panel 41A and side panel 52A serves as an entrance to the photography space. In addition, the opening between side panel 41B and side panel 52B also serves as an entrance to the photography space.

[0026] At least a portion of the ceiling surface formed above the photographing space is covered with the ceiling sheet 23. The ceiling sheet 23 may be in the form of a sheet or a plate.

[0027] The editing unit 12 is a device for editing a captured image. As shown in Fig. 2, the editing unit 12 is connected to the photographing unit 11 with one side surface thereof contacting the front panel 42 of the photographing section 21.

[0028] 1 is the configuration on the front side of the editing unit 12, components used for editing work are provided on both the front side and the rear side of the editing unit 12. With this configuration, two groups of users can perform editing work simultaneously.

[0029] The front side of the editing unit 12 is composed of a vertical surface 61 and an inclined surface 62 formed above the vertical surface 61. A tablet built-in monitor 141 and touch pens 142A and 142B are provided on the inclined surface 62 as components used for editing work. An illumination device 63 is provided above the inclined surface 62.

[0030] The tablet built-in monitor 141 is configured by stacking a tablet and a display. For example, an editing screen used for editing is displayed on the tablet built-in monitor 141. When two users perform editing at the same time, the touch pen 142A is used by the user standing on the left side as viewed from the tablet built-in monitor 141, and the touch pen 142B is used by the user standing on the right side as viewed from the tablet built-in monitor 141. Hereinafter, when it is not necessary to distinguish between the touch pen 142A and the touch pen 142B, they are collectively referred to as the touch pen 142.

[0031] A curtain rail 24 is attached above the editing unit 12. The curtain rail 24 is formed by combining three rails 24A to 24C.

[0032] A curtain is attached to the curtain rail 24 so that the space in front of the front and the space in front of the rear of the editing unit 12 cannot be seen from the outside. The space in front of the front and the space behind the rear of the editing unit 12 surrounded by the curtain become the editing space where the user performs editing work.

[0033] A sticker paper outlet 161 is provided on the side of the editing unit 12. A printer is provided inside the editing unit 12. Sticker paper on which an image of the user is printed is discharged from the sticker paper outlet 161. The space in front of the side of the editing unit 12 (sticker paper outlet 161) becomes a print waiting space where the user waits for the printed sticker paper to be discharged.

[0034] <Front view of the shooting space> FIG. 3 is a perspective view showing an example of the configuration of the front of the imaging space.

[0035] At the front of the imaging space, the components of the imaging unit 21 are provided so as to be surrounded by side panel 41A, side panel 41B, and front panel 42. Note that in FIG. 3, the illustration of the pre-selection unit 20 installed on side panel 41A is omitted.

[0036] A front camera unit 81 is provided slightly above the center of the front panel 42. The front camera unit 81 is provided with a front camera 91 and a front monitor 92.

[0037] The front camera 91 is, for example, a single-lens reflex camera, and is built into the front camera unit 81 so that the lens is exposed. The front camera 91 has an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and captures a user in the shooting space. The front camera 91 functions as a shooting unit that captures a user as a subject.

[0038] A moving image (hereinafter also referred to as a live view image) captured by the front camera 91 is displayed in real time on the front monitor 92. A still image captured by the front camera 91 at a predetermined timing, such as when a shooting instruction is issued, is saved as a captured image.

[0039] The front monitor 92 is provided below the front camera 91. The front monitor 92 is composed of a monitor such as an LCD and a touch panel laminated thereon. The front monitor 92 has a function as a live view monitor that displays moving images captured by the front camera 91, and a function of displaying various GUIs and accepting selection operations by the user.

[0040] A front strobe unit 82 that irradiates light onto the face and upper body of the user from above and in front of the user is installed above the front camera unit 81. The front strobe unit 82 has a built-in light bulb for illumination in addition to a strobe light emitting tube that emits light in accordance with the timing of shooting.

[0041] Front strobe unit 82 has three panels 82a, 82b, and 82c, which are made of transparent or semi-transparent acrylic plates or the like, arranged in a horizontal row as light-emitting surfaces. The light-emitting surfaces (panels 82a, 82b, and 82c) of front strobe unit 82 are installed facing diagonally downward.

[0042] A lower-case strobe unit 83 that irradiates light onto the lower body and feet of the user is provided below the front camera unit 81. The lower-case strobe unit 83 includes a built-in light bulb for illumination in addition to a strobe light emitting tube that emits light in accordance with the timing of photographing.

[0043] The light emitting surface of lower box strobe unit 83 is formed so as to completely cover the front between side panel 41A and side panel 41B. The light emitting surface of lower box strobe unit 83 is also formed of a transparent or semi-transparent acrylic plate or the like. The upper surface of lower box strobe unit 83 is used as a luggage storage area for users performing photography work to place their baggage, etc.

[0044] <Ceiling surface configuration of the shooting space> FIG. 4 is a perspective view showing an example of the configuration of the ceiling surface of the imaging space.

[0045] A ceiling camera unit 101 and a ceiling strobe unit 102 are provided at approximately the center of the ceiling surface of the photographing space so as to protrude from the ceiling surface.

[0046] The ceiling camera unit 101 is provided with a ceiling camera 111 and a ceiling monitor 112 .

[0047] Like the front camera 91, the ceiling camera 111 is configured as, for example, a single-lens reflex camera, and is built in the ceiling camera unit 101 with its lens exposed. The ceiling camera 111 photographs users in the photographing space.

[0048] A live view image captured by ceiling camera 111 is displayed in real time on ceiling monitor 112. A still image captured by ceiling camera 111 at a predetermined timing, such as when an instruction to capture is given, is saved as a captured image.

[0049] The ceiling monitor 112 is provided below the ceiling camera 111. The ceiling monitor 112 is configured by a monitor such as an LCD. The ceiling monitor 112 has a function as a live view monitor that displays moving images captured by the ceiling camera 111.

[0050] The surface of the ceiling camera unit 101 on which the ceiling camera 111 and the ceiling monitor 112 are provided is formed so as to face obliquely downward.

[0051] On the ceiling surface of the shooting space, a ceiling strobe unit 102 is installed adjacent to the ceiling camera unit 101 at a position in front of the ceiling camera unit 101. The ceiling strobe unit 102 irradiates the user with strobe light from above the user's head diagonally in front. The ceiling strobe unit 102 has a built-in light bulb for illumination in addition to a strobe light emitting tube that emits light in accordance with shooting timing.

[0052] Ceiling strobe unit 102 is provided with a panel 102a formed of a transparent or semi-transparent acrylic plate or the like as a light-emitting surface. In addition, speakers are provided on the left and right sides of the light-emitting surface (panel 102a) of ceiling strobe unit 102 for outputting voice guidance for the shooting process, background music, sound effects, and the like.

[0053] The light emitting surface (panel 102a) of ceiling strobe unit 102 is also formed so as to face obliquely downward.

[0054] In this way, on the ceiling surface of the shooting space, the ceiling camera unit 101 and the ceiling strobe unit 102 are provided so as to have the same positional relationship as the front camera unit 81 and the front strobe unit 82 at the front of the shooting space.

[0055] FIG. 5 is a diagram showing an example of a captured image.

[0056] Shooting in the shooting space is performed using both the front camera 91 and the ceiling camera 111. The image captured using the front camera 91 is an image in which the face and upper body of a user facing forward are captured prominently, as shown on the left side of FIG.

[0057] On the other hand, the image captured by using the ceiling camera 111 is an image showing the whole body of a user sitting on a bench provided in the shooting space, as shown on the right side of Fig. 5. In the shooting space, a bench on which a user can sit and face the ceiling camera 111 to shoot is provided close to the back panel 51.

[0058] Hereinafter, an image captured using front camera 91 will be referred to as a close-up image, and an image captured using ceiling camera 111 will be referred to as a ceiling camera image. In this way, by providing ceiling camera 111, it becomes possible to capture a variety of types of images with different angles of view.

[0059] <Block structure of the photo sticker creation device> Fig. 6 is a block diagram showing an example of the configuration of the photo sticker creating device 1. In Fig. 6, the same components as those described above are given the same reference numerals, and duplicated explanations will be omitted as appropriate.

[0060] 6, the photo sticker creating device 1 is configured by connecting a pre-selection unit 302, a photographing unit 304, editing units 305A and 305B, and a printing unit 306 to a PC (Personal Computer) unit 301 via an external input / output interface 303. The PC unit 301, which controls the overall operation of the photo sticker creating device 1, is housed inside the editing unit 12, for example.

[0061] The PC section 301 includes a central processing unit (CPU) 311, a read only memory (ROM) 312, and a random access memory (RAM) 313, which are connected to each other via a bus 314.

[0062] The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating apparatus 1. The ROM 312 stores the programs and data executed by the CPU 311. The RAM 313 temporarily stores the data and programs processed by the CPU 311.

[0063] An input / output interface 315 is further connected to the bus 314. A storage unit 316, a communication unit 317, and a drive 318 are connected to the input / output interface 315.

[0064] The storage unit 316 is a non-volatile storage medium such as a hard disk, a flash memory, etc. The storage unit 316 stores various setting information and the like supplied from the CPU 311. The information stored in the storage unit 316 is read out by the CPU 311 as appropriate.

[0065] The communication unit 317 is an interface for a network such as the Internet. The communication unit 317 communicates with an external device under the control of the CPU 311. The communication unit 317 transmits an image selected by a user to, for example, an image management server managed by the manufacturer of the photo sticker creating device 1. The image transmitted from the communication unit 317 is assigned a predetermined memory area in the image management server and stored therein, and is displayed on or downloaded to a mobile terminal that has accessed the image management server.

[0066] Removable media 319, such as an optical disk or semiconductor memory, is appropriately loaded into the drive 318. Programs and data read from the removable media 319 by the drive 318 are supplied to the CPU 311, and are stored in the storage unit 316 or installed.

[0067] An external input / output interface 303 is connected to the input / output interface 315. The PC unit 301 controls each unit via the external input / output interface 303.

[0068] The pre-selection unit 302 performs a pre-selection process for users in the pre-selection space. The pre-selection unit 302 is composed of a touch panel monitor 71, a speaker 321, and a coin processing unit 322.

[0069] The touch panel monitor 71 displays various selection screens under the control of the PC unit 301, and accepts operations by the user on the selection screens. An input signal representing the content of the user's operation is supplied to the PC unit 301, and various settings are made.

[0070] The coin processing unit 322 detects the insertion of coins into the coin insertion slot. When the coin processing unit 322 detects that a predetermined amount of coins has been inserted, it outputs a start signal to the PC unit 301 to instruct the start of a game.

[0071] The image capturing unit 304 performs image capturing processing of a user in the image capturing space. The image capturing unit 304 is composed of a front camera 91, a front monitor 92, a ceiling camera 111, a ceiling monitor 112, a lighting device 331, and a speaker 332.

[0072] The front camera 91 and the ceiling camera 111 take pictures under the control of the PC section 301 , and output still image or video image data obtained by taking pictures to the PC section 301 .

[0073] The front monitor 92, under the control of the PC unit 301, displays live view images captured by the front camera 91 in real time, accepts user operations on various screens, and outputs signals representing the contents of the accepted operations to the PC unit 301.

[0074] The ceiling monitor 112 displays a live view image captured by the ceiling camera 111 in real time under the control of the PC unit 301 .

[0075] The lighting devices 331 are strobe units in the shooting space, and emit light in accordance with a control signal supplied from the PC section 301. The lighting devices 331 are composed of a front strobe unit 82, a lower box strobe unit 83, and a ceiling strobe unit 102.

[0076] The speaker 332 is a speaker provided in the ceiling strobe unit 102 within the shooting space.

[0077] Editing unit 305A performs editing processing for a user in one editing space. Editing unit 305A is composed of tablet built-in monitor 141, touch pens 142A and 142B, and speaker 341. Editing unit 305B performs editing processing for a user in the other editing space, and has the same configuration as editing unit 305A. Hereinafter, editing units 305A and 305B will be collectively referred to as editing unit 305 as appropriate.

[0078] The tablet built-in monitor 141 displays an editing screen and accepts operations on the editing screen by the user under the control of the PC section 301. An input signal representing the content of the user's operation is supplied to the PC section 301, and the captured image to be edited is edited.

[0079] The printing section 306 is configured to include a printer 351. A sticker paper unit 352 is attached to the printer 351.

[0080] The printer 351 drives a built-in head 361 and prints an image on a roll of sticker paper 363 stored in a sticker paper unit 352 based on print data supplied from the PC section 301. The printer 351 also cuts the sticker paper 363 with the image printed thereon at a predetermined cutting position using a cutter 362, and discharges the cut sticker paper to the sticker paper discharge port 161.

[0081] <Example of control unit functional configuration> Fig. 7 is a block diagram showing an example of a functional configuration of the photo sticker creating device 1. At least a part of the functional units shown in Fig. 7 is realized by the CPU 311 executing a predetermined program.

[0082] A control unit 401 is realized in the photo sticker creating device 1. The control unit 401 is made up of a pre-selection processing unit 411, a photography processing unit 412, an edit processing unit 413, a print processing unit 414, and a transmission processing unit 415.

[0083] The pre-selection processing unit 411 executes a pre-selection process by controlling each unit of the pre-selection unit 302. The pre-selection process selects the number of users, the game theme, etc. A plurality of themes are prepared for the game of the photo sticker creating device 1.

[0084] During the game, for example, the screen display and background music are used to produce a presentation according to the game theme. Also, the editing tools that can be used during editing are switched according to the game theme. The game theme defines the progress of the game. Information indicating the content of the user's selection is supplied to the shooting processing unit 412.

[0085] The shooting processing unit 412 performs shooting processing by controlling each unit of the shooting unit 304. In the shooting processing, a plurality of shot images, for example, seven shot images, are taken. The shooting processing unit 412 outputs data of the plurality of shot images obtained by performing the shooting processing to the editing processing unit 413.

[0086] The edit processing unit 413 performs edit processing by controlling each unit of the edit unit 305. The edit processing includes editing of captured images, printing of images on sticker paper, and transmission of images to an image management server, which is an external device.

[0087] As described above, the images transmitted to the image management server can be viewed or downloaded by the user on a mobile device such as a smartphone after the user has finished playing the game on the photo sticker creation device 1.

[0088] Editing the photographed image includes a process of generating an image to be printed on sticker paper based on the photographed image, and a process of generating an image to be sent to an image management server based on the photographed image.

[0089] As will be described in detail later, an image to be printed on a sticker sheet is generated by having a user select a sticker design and performing image processing in accordance with the sticker design selected by the user.

[0090] Moreover, the mobile-only image, which is the image to be sent to the image management server, is generated by applying image processing to the photographed image to be edited in accordance with the operation performed using a tool selected by the user from among editing tools prepared in advance, such as a pen tool or a stamp tool. By using the pen tool or the stamp tool, a pen image or a stamp image as an image to be combined is combined with the photographed image to be edited. The user selects the editing tool of their choice and selects the position on the photographed image to be edited where the image processing is to be applied, thereby proceeding with the editing of the photographed image.

[0091] In this way, the user edits the captured image to create a dedicated image for mobile use with the touch pen 142 in a manner similar to doodling on the captured image. Hereinafter, editing will be referred to as doodling where appropriate.

[0092] The edit processing unit 413 outputs print data generated based on the image to be printed on the sticker paper to the print processing unit 414 , and outputs data of the mobile-only image to the transmission processing unit 415 .

[0093] The print processing unit 414 outputs the print data to the printer 351, which prints the image on the sticker paper.

[0094] The transmission processing unit 415 controls the communication unit 317 to communicate with the image management server, and transmits (uploads) the portable image to the image management server.

[0095] FIG. 8 is a block diagram showing an example of the configuration of the edit processing unit 413. As shown in FIG.

[0096] The editing processing unit 413 is composed of an image analysis unit 421, a sticker image generation unit 422, a sticker design data storage unit 423, a mobile-only image generation unit 424, and a display control unit 425. Details of the functions of each processing unit will be described later with reference to a flowchart. The captured image data output from the capture processing unit 412 is input to the image analysis unit 421 and the display control unit 425.

[0097] The image analysis unit 421 analyzes the features of the user appearing in each captured image and recognizes the positions of specific body parts of the user appearing in the captured image. For example, the positions of the head, eyes, nose, and mouth are recognized as the positions of specific body parts. Information indicating the positions recognized by the image analysis unit 421 is supplied to the sticker image generation unit 422 and the mobile-only image generation unit 424 together with the captured image data.

[0098] The sticker image generating unit 422 reads information about the sticker design selected by the user from the sticker design data storage unit 423, and performs image processing based on the read information on the captured image.

[0099] The sticker image generating unit 422 also synthesizes a sticker image obtained by performing image processing based on information about the sticker design on the captured image with a sticker edge image corresponding to the sticker design, and generates a layout image showing a print image of the sticker paper. The layout image is an image that combines a sticker image in which the user is photographed as a subject with a sticker edge image of a predetermined design. The sticker image generating unit 422 accepts operations performed by each user and generates a layout image for each user.

[0100] The layout image data generated by the sticker image generating unit 422 is supplied as print data to the print processing unit 414. Information indicating the content of the image processing by the sticker image generating unit 422 is appropriately supplied to the display control unit 425 and used for screen display.

[0101] The image processing by the sticker image generating unit 422 can be said to be processing for creating an image to be printed on a sticker sheet. The layout image generated by the image processing by the sticker image generating unit 422 is an image for printing that is used for printing on a sticker sheet.

[0102] The mobile phone-only image generating unit 424 applies image processing to each captured image according to the mobile phone-only graffiti made by the user, and generates a mobile phone-only image. The mobile phone-only graffiti is graffiti for creating an image to be sent to the image management server. The image with the mobile phone-only graffiti is an image for transmission, which is used for sending to the image management server.

[0103] Note that "for printing" indicates that the image is intended for printing out of the two uses, printing out and sending out. "for sending" indicates that the image is intended for sending out of the two uses, printing out and sending out. Images for printing are not used for sending to an image server, and images for sending are not used for printing on sticker paper. In other words, images for printing and images for sending may be used for purposes other than the two uses, printing out and sending out, such as for displaying on the screen of the tablet built-in monitor 141.

[0104] The mobile-only image generated by the mobile-only image generating unit 424 is supplied to the transmission processing unit 415. Information indicating the content of image processing by the mobile-only image generating unit 424 is appropriately supplied to the display control unit 425 and used for screen display.

[0105] The display control unit 425 displays various screens including a screen used for generating an image for a sticker and a mobile-only doodling screen on the tablet built-in monitor 141. The display control unit 425 controls the display of the screen in response to a user's operation.

[0106] <<How the photo sticker creation device works>> <Photo sticker creation game> Now, with reference to the flow chart of FIG. 9, the operation of the photograph sticker creating device 1 that provides the photograph sticker creating game will be described.

[0107] In step S1, the pre-selection processing unit 411 determines whether or not a predetermined amount of coins has been inserted, and waits until it is determined that coins have been inserted. The fee to be paid at the start of one game is, for example, 400 yen.

[0108] If it is determined in step S1 that a predetermined amount of coins has been inserted, in step S2, the pre-selection processing unit 411 performs a pre-selection process. In the pre-selection process, the number of users, the game theme, etc. are selected.

[0109] In step S3, the photography processing unit 412 controls the photography unit 304 to perform photography processing. Specifically, the photography processing unit 412 displays the moving image captured by the front camera 91 in a live view on the front monitor 92. When the photography timing arrives, the photography processing unit 412 photographs the user in the photography space as a subject and generates a photographed image that is a close-up image.

[0110] Furthermore, the photographing processing unit 412 displays the moving image captured by the ceiling camera 111 on the ceiling monitor 112 in a live view. When the photographing timing arrives, the photographing processing unit 412 photographs the user in the photographing space as a subject, and generates a photographed image that becomes a ceiling camera image.

[0111] The capture process ends when multiple captured images have been taken, for example six close-up images and one ceiling camera image.

[0112] In step S4, the editing processing unit 413 performs editing processing by controlling the editing unit 305 corresponding to the editing space to which the user who has completed the shooting processing has moved.

[0113] <Editing process details> Next, the editing process performed in step S4 in FIG. 9 will be described with reference to the flowchart in FIG.

[0114] In step S11, the display control unit 425 of the edit processing unit 413 causes the tablet built-in monitor 141 to display an address input screen.

[0115] The address input screen is a screen used for inputting a user's email address. The address input screen displays a software keyboard and the like and is used for inputting an email address.

[0116] The email address entered using the address input screen is uploaded to the image management server together with the mobile-only image, and is used to notify the user of the URL where the mobile-only image is saved by email from the image management server. For example, the user can display the mobile-only image created in the game of the photo sticker creation device 1 on the screen of the mobile terminal by tapping the URL notified by email.

[0117] In step S12, a sticker design selection process is performed. In the sticker design selection process, image processing according to the sticker design selected by the user is performed on the captured image to generate an image for sticker. In addition, a layout image, which is an image for printing, is generated using the image for sticker. Details of the sticker design selection process will be described later with reference to the flowchart of FIG.

[0118] In step S13, the print processing unit 414 starts printing the layout image based on the print data representing the layout image. The timing to start printing the layout image can be any timing after the sticker design selection process has been performed.

[0119] In step S14, the display control unit 425 displays the mobile phone-specific graffiti screen on the tablet built-in monitor 141. The user uses the mobile phone-specific graffiti screen to doodle on the captured image. The mobile phone-specific graffiti is performed on all of the seven captured images obtained by the shooting process as graffiti targets. Details of the graffiti using the mobile phone-specific graffiti screen will be described later.

[0120] In step S15, mobile phone-only image generating section 424 performs image processing on the photographed image of the graffiti target in response to an operation by the user, and generates a mobile phone-only image.

[0121] In step S16, the mobile-only image generating unit 424 judges whether the mobile-only graffiti has ended. If it is judged in step S16 that the mobile-only graffiti has not ended, the process returns to step S14, and the mobile-only graffiti continues. For example, if a preset time limit has elapsed, the mobile-only graffiti ends.

[0122] When it is determined in step S16 that the mobile-only graffiti has ended, in step S17, the display control unit 425 displays an image selection screen on the tablet built-in monitor 141. The image selection screen displayed here is a screen used to select one mobile-only image from among the seven mobile-only images created by the mobile-only graffiti.

[0123] Of the seven mobile-only images uploaded to the image management server, one selected using the image selection screen is provided to the user who is a free member. The image provision service provided by the image management server is a membership-based service that allows users to view images on their mobile terminals and download images to their mobile terminals.

[0124] A free member can view one mobile phone image, while a paid member can view all mobile phone images.

[0125] When the selection of the image for mobile phone is completed, in step S18, the transmission processing unit 415 transmits the image for mobile phone to the image management server. When the transmission of the image for mobile phone is completed, the process returns to FIG. 9 and the series of processes of the photo sticker creation game is completed.

[0126] <Selecting the seal design> The sticker design selection process performed in step S12 in FIG. 10 will be described with reference to the flowchart in FIG.

[0127] In step S31, the image analysis unit 421 analyzes the features of the user appearing in each captured image and recognizes the position of each part of the user.

[0128] In step S32, the sticker image generating unit 422 generates a sample image serving as a model of a sticker design according to the game theme. In the pre-selection process, the game theme is selected.

[0129] In step S33, the display control unit 425 uses the sample image generated by the sticker image generating unit 422 to display a sticker design selection screen.

[0130] In step S34, the sticker image generating unit 422 judges whether or not a predetermined sticker design has been selected from among a plurality of sticker designs. If it is judged in step S34 that a sticker design has not been selected, the process returns to step S33, and processing according to the user's operation on the sticker design selection screen continues.

[0131] FIG. 12 is a diagram showing an example of a sticker design selection screen.

[0132] An area 501L is formed on the left side of the sticker design selection screen, and an area 501R is formed on the right side. The area 501L is an area used for operation by a user standing on the left side as viewed from the tablet built-in monitor 141. The area 501R is an area used for operation by a user standing on the right side as viewed from the tablet built-in monitor 141.

[0133] In this way, the selection of the sticker design is performed by each user using the display of area 501L and area 501R. The operations by each user on area 501L and area 501R are accepted, for example, by sticker image generating unit 422. Although the display of area 501L will be mainly described, the display of area 501R is the same as the display of area 501L.

[0134] A message is displayed in the upper center of the sticker design selection screen, encouraging the user to select the number of divisions, which is the layout of the image. Below the message are the "Pocket Print" and "Other Layouts" tabs, with the "Pocket Print" tab being selected in the example of Figure 12. Sticker design selection is performed when the "Pocket Print" tab is selected. When the "Other Layouts" tab is selected, sample layouts of various patterns are displayed.

[0135] A sample image 511L is displayed in the center of the area 501L. The sample image is an example of a sticker design.

[0136] To the left of the sample image 511L, color selection buttons 512L used to select a color are displayed.

[0137] Sticker design selection buttons 521-1 to 521-7 are displayed in a button area 513L formed below the sample image 511L. The sticker design selection buttons 521-1 to 521-7 are buttons used to select a sticker design. When a sticker design selection button is pressed, the display of the sample image 511L is switched. In the example of FIG. 12, the sticker design selection button 521-1 is in a selected state.

[0138] The user can select a sticker design by pressing the enter button while a specific sample image is being displayed.

[0139] FIG. 13 is an enlarged view of the sample image.

[0140] Sample image 511-1 shown in FIG. 13 is an image that is displayed in area 501L as sample image 511L when, for example, sticker design selection button 521-3 in FIG. 12 is pressed.

[0141] The sample image 511-1 is constructed by arranging the sticker image P1 and the sticker image P2 vertically and combining them with the sticker edge image P11. Both the sticker image P1 and the sticker image P2 are close-up images. Sticker designs in which the sticker images are arranged in different positions may be prepared, such as the sticker image P1 and the sticker image P2 arranged horizontally.

[0142] As described above, the sticker image is an image to be printed on sticker paper, which is generated based on a photographed image in which the user appears as a subject.

[0143] The sticker edge image is an image that represents the design of the edge portion of the sticker paper (the area surrounding the image in which the user is the subject). In the example of Fig. 13, an image of a predetermined color including a logo representing the model name of the photo sticker creation device 1 is used as the sticker edge image. For example, the color of the sticker edge image changes every time the color is changed using the color selection button 512L.

[0144] In this way, an image using an image actually obtained by photography is displayed as a sample image serving as a model of the sticker design. The user can select a sticker design while imagining the layout image that will actually be printed. A sample image using an image of a person other than the user, such as a model person, may also be displayed.

[0145] The sample image 511-1 is generated by combining, for example, a seal edge image P11, a pattern image P12, and a sticky stamp image P13 as shown in FIGS. 14A to 14C.

[0146] The pattern image is an image that is to be combined with the background of the user appearing in the photographed image. Pattern image P12 shown in Fig. 14B is an image of a floral pattern.

[0147] The sticky stamp image is a stamp image (image for synthesis) that is synthesized at a synthesis position determined based on the position of a specific part of the user in the captured image. For example, a position on the user is determined as the synthesis position so that the image is synthesized superimposed on the user. The sticky stamp image P13 shown in Fig. 14C is composed of six flower images arranged at shifted positions.

[0148] A number of templates representing the components of each sticker design are prepared for each game theme.

[0149] FIG. 15 is a diagram showing an example of a template.

[0150] In the example of Fig. 15, six templates, templates 1 to 6, are associated with the game theme "girly". As shown in the speech bubble, each template is composed of at least one of a sticker edge image, a pattern image (background image), a sticky stamp image, a frame image, and a filter image. Sticker designs that do not use the above-mentioned pattern images or sticky stamp images may also be prepared.

[0151] A frame image is an image that is composited in the foreground of a photographed image. Unlike a sticky stamp image, an image of a predetermined design that constitutes a frame image is composited in a fixed position on the photographed image.

[0152] The filter image is an image that represents the content of the filter processing to be applied to the captured image. By applying the filter processing using the filter image to the captured image, the brightness, color, etc. of the captured image are changed partially or entirely.

[0153] Information on templates representing sticker designs corresponding to each of these game themes is stored in sticker design data storage unit 423 of Fig. 8. For example, when selecting a sticker design, content that will be components of the sticker design, such as a sticker edge image, a pattern image, and a sticky stamp image, is specified based on the template information linked to the game theme selected by the user, and multiple sample images are generated by sticker image generation unit 422. In addition, the images generated by sticker image generation unit 422 are used to display a sticker design selection screen.

[0154] Sticker designs using other types of content, such as stamp images that are composited across the photographed image and portions other than the photographed image, may be prepared. Also, as the sticky stamp images, images for makeup, such as images of eyeshadow, eyeliner, and eyelashes that are composited at the position of the eyes of the face, images of cheeks that are composited at the position of the cheeks, and images of lips that are composited at the position of the lips, may be used.

[0155] FIG. 16 is a diagram showing an example of the generation of an image for a sticker.

[0156] As indicated by arrow #1, a pattern image P12 is composited with the background of a photographed image P21 to generate a sticker image P1 as indicated by the tip of arrow #2.

[0157] The composition of the pattern image P12 is performed by compositing the pattern image P12 on the background of the person area (the layer below the layer of the person area) extracted from the photographed image P21 by chromakey processing.

[0158] In addition, as shown by arrow #3, a pattern image P12 is composited into the background of the captured image P22, and as shown by arrow #4, a stamp image P13 is attached to the head positions of each of the two users appearing in the captured image P22, thereby generating a sticker image P2 as shown by arrow #5.

[0159] The sticky stamp image P13 is synthesized at positions p1 and p2, which are synthesis positions determined based on the head positions of the two users recognized by analyzing the captured image P22. The sticky stamp image P13 is synthesized on a layer above the layer of the person area. The sticky stamp image P13 is rotated according to the direction of the user's head and scaled according to the size of the user's head as appropriate.

[0160] The sticker image P1 and sticker image P2 thus generated are combined with a sticker edge image P11 to generate a sample image 511-1.

[0161] In this way, a sticker design is prepared using a content to be combined at a combination position determined based on the position of a specific part of the user in the photographed image, and a content to be used to edit the part other than the image for sticker. In the above example, the content to be combined at a combination position determined based on the position of a specific part of the user in the photographed image is the sticky stamp image P13, and the content to be used to edit the part other than the image for sticker is the sticker edge image P11.

[0162] The information of the template representing the sticker design includes information indicating which of the seven photographed images is to be used to generate the sample image. The photographed images P21 and P22 used to generate the sample image 511-1 are, for example, the first photographed image obtained by the first photographing and the second photographed image obtained by the second photographing, respectively. The default photographed images of the sticker design of the sample image 511-1 are two close-up images of the first photographed image and the second photographed image.

[0163] Among the sticker designs, there are not only close-up images, but also designs that use a seventh image taken with a different angle of view, a ceiling camera image, as the default image.

[0164] FIG. 17 is an enlarged view of another sample image.

[0165] Sample image 511-2 shown in FIG. 17 is an image that is displayed in area 501L as sample image 511L when a predetermined sticker design selection button is pressed.

[0166] The sample image 511-2 is constructed by vertically arranging the sticker image P51 and the sticker image P52 and synthesizing them with the sticker edge image P71. The sticker image P51 is a close-up image, and the sticker image P52 is an image taken with a ceiling camera.

[0167] In this way, sticker designs are also available that use ceiling camera images in combination with close-up images.

[0168] The sample image 511-2 is generated by using, for example, a seal edge image P71, a filter image P72, and sticky stamp images P73 and P74 in combination as shown in FIGS. 18A to 18C.

[0169] 18B is an image used to generate an image that gives the impression that the entire image is tinted with a predetermined color. Filtering using the filter image P72 changes the pixel values ​​of the pixels in the entire captured image.

[0170] The sticky stamp image P73 shown in Fig. 18C is an image showing an angel's halo. The sticky stamp image P74 is an image showing angel's wings. The sticky stamp image of the angel's halo and the sticky stamp image of the angel's wings are used as a set.

[0171] FIG. 19 is a diagram showing an example of generating an image for a sticker.

[0172] As indicated by arrow #11, a filter process using the filtered image P72 is performed on the captured image P81, thereby generating a sticker image P51 as indicated by the tip of arrow #12.

[0173] In addition, as shown by arrow #13, a filter process using filter image P72 is applied to captured image P82, and as shown by arrows #14 and #15, a sticky stamp image P73 is composited onto the heads of each of the two users appearing in captured image P82, and a sticky stamp image P74 is composited near the shoulders of each of the two users, thereby generating a sticker image P52 as shown by arrow #16.

[0174] The sticky stamp image P73 is synthesized at positions p11 and p12, which are synthesis positions determined based on the head positions of the two users recognized by analyzing the captured image P82. The sticky stamp image P73 is synthesized on a layer above the layer of the person area. The sticky stamp image P73 is rotated according to the direction of the user's head, and is enlarged or reduced according to the size of the user's head, as appropriate.

[0175] The sticky stamp image P74 is synthesized at positions p21 and p22, which are synthesis positions determined based on the head positions of the two users recognized by analyzing the captured image P82. The sticky stamp image P74 is synthesized in the same layer as the sticky stamp image P73. The sticky stamp image P74 is rotated according to the direction of the user's head, and is enlarged or reduced according to the size of the user's head, as appropriate.

[0176] The sticker image P51 and sticker image P52 thus generated are combined with a sticker edge image P71 to generate a sample image 511-2.

[0177] The sticker design represented by sample image 511-2 is also a design that uses content that is composited at a composite position determined based on the position of a specific part of the user appearing in the captured image, and content that is used to edit parts other than the sticker image.

[0178] Using the sticker design selection screen on which the above-mentioned sample images are displayed, a sticker design is selected by each of a plurality of users.

[0179] For example, when the color selection button 512L is pressed, at least one of the colors of the seal edge image, the background image, and the filter image is changed according to the selected color. Each user selects a seal design while viewing the content that constitutes the seal design and the color of the content.

[0180] It may also be possible to enable the user to turn on / off filter processing using a filter image, adjust color density, etc., when selecting a sticker design.

[0181] If it is determined in step S34 of FIG. 11 that the given sticker design has been selected by two users, the process proceeds to step S35.

[0182] In step S35, the display control unit 425 causes an image selection screen to be displayed on the tablet built-in monitor 141, instead of the sticker design selection screen. The image selection screen is a screen used to select a captured image to be used as an image for a sticker.

[0183] The sample image displayed on the sticker design selection screen is an image using a default photographed image automatically selected by the photo sticker creation device 1. After selecting a sticker design, the user can change (replace) the default photographed image with another photographed image.

[0184] FIG. 20 is a diagram showing an example of an image selection screen.

[0185] Images 551L and 551R showing the seal edge image of the selected seal design are displayed in the areas 501L and 501R, respectively. The captured image is selected by each user using the displays in the areas 501L and 501R.

[0186] In the example of Fig. 20, the sticker design selected by the user on the left is a sticker design using two close-up images, as described with reference to Fig. 13 etc. The sticker design selected by the user on the right is a sticker design using a close-up image and a ceiling camera image, as described with reference to Fig. 17 etc.

[0187] Image arrangement areas 561L and 562L are formed vertically in image 551L in area 501L. The user on the left side uses the touch pen 142A to select two captured images, for example by moving thumbnail images displayed in display area 552L to the right of image 551L to image arrangement areas 561L and 562L.

[0188] Display area 552L displays thumbnail images representing six captured images P101 to P106. Captured images P101 to P106 are the first to sixth captured images, respectively. The thumbnail images displayed in display area 552L are thumbnail images of close-up images. Since the sticker design selected by the user on the left is a sticker design using two close-up images, the thumbnail image of the ceiling camera image is not displayed, and only the thumbnail image of the close-up image is displayed.

[0189] The user on the left gets to choose two close-up images to use for the sticker design they've chosen.

[0190] On the other hand, in the image 551R of the area 501R, image arrangement areas 561R and 562R are formed vertically aligned. A ceiling camera image has already been arranged in the image arrangement area 562R, and the entire image arrangement area 562R is displayed in a grayed-out state. It is not possible to replace the captured image to be arranged in the image arrangement area 562R.

[0191] In this example, the sticker design selected by the user on the right side is a sticker design using a close-up image and a ceiling camera image, and since the ceiling camera image has been taken only once, only the close-up image to be placed in the image arrangement area 561R can be selected. Whether or not to accept the selection of the captured image is switched by the sticker image generation unit 422 or the like depending on the angle of view of the default captured image of the sticker design.

[0192] The user on the right side uses touch pen 142B to select one captured image by, for example, moving the thumbnail image displayed in display area 552R to the right of image 551R to image arrangement area 561R. In display area 552R, the same thumbnail image as the thumbnail image displayed in display area 552L is displayed.

[0193] Using such a display, two users can use their favorite photographed image for the sticker design they selected, regardless of the photographed image placed in the sample image on the sticker design selection screen. Since the photographed image to be used for the sticker design can be selected after the sticker design is selected, the users can replace the default photographed image with a photographed image that matches the sticker design.

[0194] For example, when the user on the left side selects a captured image to be placed in image placement areas 561L, 562L, the sticker image generation unit 422 performs image processing using a template representing the sticker design described with reference to FIG. 13 etc.

[0195] The photographed image to be placed in the upper part of the sticker design is subjected to image processing using the pattern image P12, and an image for a sticker is generated.

[0196] Furthermore, the photographed image arranged in the lower part of the sticker design is subjected to image processing using the pattern image P12 and the sticky stamp image P13. For example, when the user on the left arranges the photographed image P104 in the lower image arrangement area 562L, the photographed image P104 is subjected to image processing using the pattern image P12 and the sticky stamp image P13, as shown in Fig. 21. In the example of Fig. 21, the pattern image P12 is composited into the background of the two users, and the sticky stamp image P13 is composited at a composite position determined based on the position of the head of each of the two users.

[0197] Similarly, when the user on the right side selects a captured image to be placed in image placement area 561R, image processing is performed by sticker image generation unit 422 using a template representing the sticker design, as described with reference to Figure 17, etc.

[0198] The process returns to step S35 and continues the selection of captured images until it is determined in step S36 of Fig. 11 that the selection of captured images using the image selection screen as described above has ended. If it is determined in step S36 that a captured image has been selected, the process proceeds to step S37.

[0199] In step S37, the sticker image generating unit 422 applies the sticker design selected by the user to the photographed image selected by the user to generate a sticker image. The sticker image generating unit 422 also generates a layout image by combining the sticker image with a sticker edge image constituting the sticker design selected by the user, and outputs the layout image data as print data.

[0200] After that, the process returns to step S12 in Fig. 10, and the subsequent processes are carried out. When printing of the layout image is completed, the printed sticker sheet is removed from sticker sheet outlet 161.

[0201] FIG. 22 is a diagram showing an example of a printed sticker sheet.

[0202] For example, when the sticker designs described with reference to FIGS. 13 and 17 are selected, sticker sheets s1 and s2 on which layout images of the respective sticker designs are printed are provided to the user, as shown in FIG.

[0203] In this way, in the game of the photo sticker creation device 1, the user does not doodle on the image provided in a printed state on the sticker paper. The user can decide the printing contents of the sticker paper by simply selecting the sticker design and the photographed image.

[0204] Modifications Although the selection of the photographed image is performed after the selection of the sticker design, the selection of the sticker design may be performed after the selection of the photographed image. Alternatively, the selection of the sticker design and the selection of the photographed image may be performed using one screen.

[0205] Alternatively, one of the selection of the sticker design and the selection of the photographed image may be performed first, and the other may be performed afterwards, after which the user may return to the previous selection.

[0206] The game theme may be selected again when selecting the sticker design.

[0207] A game theme may be selected for each user. For example, by allowing two users to select different game themes, the user satisfaction can be improved.

[0208] <About mobile graffiti> - Screen layout of the mobile-specific graffiti screen FIG. 23 is a diagram showing a display example of the mobile-specific doodling screen.

[0209] As shown in Fig. 23, the mobile-only scribble screen is basically configured by providing each display symmetrically on either side of the central thumbnail display area 603. The left area is used by the user on the left side, and the right area is used by the user on the right side.

[0210] It should be noted that the rectangular dashed lines surrounding each area on the mobile-specific doodling screen shown in FIG. 23 are not actually displayed on the screen.

[0211] A thumbnail display area 603 provided in the center of the mobile-only graffiti screen is a display area for thumbnail images representing captured images. The user uses the thumbnail images displayed in the thumbnail display area 603 to select a captured image on which to doodle.

[0212] Six close-up images and one thumbnail image showing a ceiling camera image are displayed side by side in the thumbnail display area 603. Graffiti for mobile phones is performed on all captured images.

[0213] In the example of Fig. 23, the thumbnail image at the top left is selected by the user on the left, and the thumbnail image at the top right is selected by the user on the right. The thumbnail image at the top left represents the first captured image P101, and the thumbnail image at the top right represents the fourth captured image P104.

[0214] A doodle input area 601L is provided approximately in the center of the left area. The doodle input area 601L is a display area for a captured image that is selected using a thumbnail image and is to be doodled on. The user can select an editing tool using the touch pen 142A and edit the captured image P101 displayed in the doodle input area 601L.

[0215] On the right side of doodle input area 601L, there is provided a tool area 602L in which a button to be pressed to select the eraser tool, a button to be pressed to reset the doodle, a button to be pressed to return to the previous operation, and the like are arranged.

[0216] A palette area 604L is provided below the graffiti input area 601L. The palette area 604L is an area that displays buttons and the like used to select various editing tools to be combined with the captured image displayed in the graffiti input area 601L.

[0217] Above the palette area 604L, tabs used to select a category of editing tools are provided. The user can use the tabs to switch between editing tools to be displayed in the palette area 604L. In the example of FIG. 23, the tabs of Pretend Stamp, MAKE, STAMP, and PEN are provided, and the Pretend Stamp tab is selected. The tabs of MAKE, STAMP, and PEN are tabs for a makeup tool, which is an editing tool used for applying makeup to the face, a stamp tool used for compositing stamp images, and a pen tool used for compositing pen images, respectively.

[0218] In the palette area 604L, selection buttons 611-1 to 611-5 are displayed, which are buttons used to select the type of impersonation stamp. The selection buttons 611-1 to 611-5 are used to select impersonation stamps with the names "Rabbit", "Moon", "Cherry", "Cat", and "Wirelight", respectively.

[0219] In addition, in the right-side area used by the right-side user, the same configuration as that in the left-side area described above is arranged in a symmetrical position.

[0220] About the Stamp The role-playing stamp is an editing tool used when combining a stamp image according to the game theme with a photographed image of a graffiti target. The type of role-playing stamp that can be used for graffiti changes depending on the game theme.

[0221] A single input using the roleplay stamp will combine multiple stamp images with designs that correspond to the game theme. A roleplay stamp is made up of multiple stamp images.

[0222] Each stamp image, which is the content that makes up the role-playing stamp, is composited at a composite position determined based on the position of a specific part of the user recognized by analyzing the captured image, in the same way as the sticky stamp image described above.

[0223] For example, when the user on the left presses the selection button 611-3, a "Cherry" impersonation stamp is superimposed on the photographed image P101 that is the graffiti target, as shown in Fig. 24. In the example of Fig. 24, a plurality of stamp images are superimposed on the faces of users U1 and U2 appearing in the photographed image P101.

[0224] FIG. 25 is an enlarged view of the display of graffiti input area 601L in FIG.

[0225] A stamp image P201 in the form of a speech bubble containing the word "cherry" is synthesized at the position of the head of each of users U1 and U2 appearing in the photographed image P101. An enlarged view of the stamp image P201 is shown in Fig. 26A. The stamp image P201 is a stamp image synthesized at a synthesis position determined based on, for example, the position of the head of each user appearing in the photographed image.

[0226] A stamp image P202 consisting of a set of two cherry images is synthesized under the eyes of each of users U1 and U2 in the photographed image P101. The stamp image P202 is shown enlarged in FIG. 26B. The stamp image P202 is synthesized at a synthesis position determined based on the center of the face of the user in the photographed image. For example, the position of the nose is used as the center of the face.

[0227] In this way, when one operation is performed using the role-playing stamp, a plurality of stamp images are combined together at combination positions determined based on the positions of specific body parts of the user.

[0228] In addition, multiple stamp images are synthesized for each user appearing in the captured image. If a set of two cherry images is considered as one stamp image P202, four stamp images are synthesized into one captured image P101 in the example of Fig. 25. The two cherry images constituting the stamp image P202 may each be synthesized as a separate stamp image.

[0229] -Adjustment of the composition of the impersonation stamps The multiple stamp images synthesized using the role-playing stamps are images that can be adjusted in various ways as separate contents.

[0230] FIG. 27 is a diagram showing an example of an operation when adjusting a stamp image that constitutes a role-playing stamp.

[0231] As shown on the left side of Fig. 27, for example, when a user selects a stamp image P201 superimposed at the position of the head of user U1 appearing on the left side with the touch pen 142, a rectangular frame is displayed surrounding the stamp image P201 as shown on the right side of Fig. 27. A circular zoom button 621 and a delete button 622 are displayed at the bottom right and top left of the rectangular frame, respectively.

[0232] The enlargement / reduction button 621 is a button used to enlarge or reduce the stamp image. As will be described later, the enlargement / reduction button 621 is also used to rotate the stamp image, etc. The delete button 622 is a button used to delete the stamp image.

[0233] FIG. 28 is a diagram showing an example of an enlarged stamp image P201.

[0234] 28, the stamp image is enlarged by moving the touch pen 142 in the lower right direction while pressing the enlargement / reduction button 621. For example, by releasing the touch pen 142 from the enlargement / reduction button 621, the size of the stamp image P201 is determined.

[0235] Conversely, by moving the touch pen 142 in the upper left direction while the zoom in / out button 621 is held down with the touch pen 142, the stamp image P201 will be reduced in size in accordance with the movement of the touch pen 142.

[0236] FIG. 29 is another diagram showing an example of enlargement of the stamp image P202.

[0237] 29, for example, when a user selects a stamp image P202 that is composited at the center of the face of user U1 shown on the left side with the touch pen 142, a rectangular frame is displayed surrounding the stamp image P202. A zoom button 621 and a delete button 622 are displayed at the bottom right and top left of the rectangular frame, respectively.

[0238] By moving the touch pen 142 in the lower right direction while the zoom button 621 is pressed, the stamp image P202 is enlarged following the movement of the touch pen 142, as shown on the right side of Fig. 29. For example, by releasing the touch pen 142 from the zoom button 621, the size of the stamp image P202 is determined.

[0239] Conversely, by moving the touch pen 142 in the upper left direction while the zoom button 621 is held down, the stamp image P202 will be reduced in size in accordance with the movement of the touch pen 142.

[0240] The stamp image P201 and stamp image P202 synthesized for the user U2 can also be enlarged or reduced.

[0241] Fig. 30 is a diagram showing types of adjustments. In Fig. 30, types of adjustments are shown using a stamp image P201.

[0242] As shown in FIG. 30A, by using a zoom button 621, the stamp image P201 can be enlarged or reduced.

[0243] 30B, the stamp image P201 can be rotated by using the zoom button 621. For example, the stamp image can be rotated by moving the touch pen 142 upward or downward while pressing the zoom button 621. The stamp image P201 rotates in accordance with the movement of the touch pen 142, and the orientation of the stamp image is determined by releasing the touch pen 142 from the zoom button 621.

[0244] A button used for rotating the stamp image may be prepared separately from the zoom button 621. The button used for rotating the stamp image may be displayed, for example, at one of the four corners of the frame surrounding the stamp image. This makes it easier to visually understand that it is a button used for rotation.

[0245] As shown in Fig. 30C, the stamp image P201 can be deleted by using the delete button 622. For example, when two stamp images are combined, it is possible to adjust the design to one's preference by deleting only one of the stamp images or deleting both of the stamp images.

[0246] In this way, the user can adjust the composition of the stamp image that is automatically composed by using the role-playing stamp for each stamp image, that is, partially.

[0247] The adjustment of the composition aspect of the stamp image can also be made by adjusting (moving) the position. The adjustment of the composition aspect includes not only the size adjustment, orientation adjustment, and deletion shown in FIG. 30, but also the position adjustment.

[0248] FIG. 31 is a diagram showing an example of movement of a stamp image.

[0249] The stamp image is moved, for example, by pressing the stamp image in a state in which a rectangular frame or the like is displayed with the touch pen 142 and moving the touch pen 142 in that state. The stamp image moves following the movement of the touch pen 142, and the position of the stamp image is determined by releasing the touch pen 142. In the example of Fig. 31, the stamp image P201 that was composited at the default position p31 has moved to the position p32, which is a position to the left of the position p31.

[0250] It is also possible to move the stamp image P202 composed for the user U1 and the stamp images P201 and P202 composed for the user U2. The user can adjust the position of each of the multiple stamp images composed by the role-playing stamp from the default position to a position of their choice.

[0251] In this way, the multiple stamp images synthesized using the role-playing stamp are each treated as separate content, and can be adjusted by moving as well as by other adjustments such as enlarging / reducing, rotating, and deleting.

[0252] When a stamp image has been composed using a specific impersonation stamp and an operation to select another impersonation stamp is performed using the selection buttons 611-1 to 611-5, the stamp image of the newly selected impersonation stamp is composed in place of the previously composed stamp image. The previously composed stamp image of the photographed image to be doodled disappears, and the newly selected stamp image is composed. The impersonation stamp is an editing tool that can be used for each photographed image, with only one type selected from multiple types.

[0253] For example, when the selection button 611-4 is pressed and the "cat" stamp is selected in the state of Fig. 24 in which the "cherry" stamp is composed, the stamp image of the "cat" stamp is composed in place of the already composed stamp images P201 and P202. The "cat" stamp is also composed of multiple stamp images.

[0254] Here, when the above-mentioned adjustments have been made to the stamp images P201 and P202 that compose the composed "Cherry" impersonation stamp, some of the adjustments will be carried over to the composition of the "Cat" impersonation stamp.

[0255] For example, when the stamp image P201 constituting the "Cherry" impersonation stamp is moved, the stamp image constituting the "Cat" impersonation stamp, whose composite position is determined based on the position of the head, is composited from the beginning at the same position as the stamp image P201 after it was moved, not at the default position. In this case, the content of the movement of the stamp image is inherited.

[0256] FIG. 32 is a diagram showing an example of taking over adjustment of a stamp image.

[0257] The state shown on the left side of Fig. 32 is a state in which the stamp image P201 has moved from the default position p31 to position p32 as described with reference to Fig. 31. The stamp image P202 is composited at position p41 for user U1, and the stamp images P201 and P202 are composited at positions p42 and p43 for user U2, respectively. Position p41 is a default composite position determined based on the center of the face of user U1. Positions p42 and p43 are default composite positions determined based on the head position and center of the face of user U2, respectively.

[0258] In this state, when the selection button 611-4 is pressed and the "cat" impersonation stamp is selected, the stamp image of the "cat" impersonation stamp is synthesized as shown on the right side of FIG.

[0259] The "cat" role-play stamp is composed of a stamp image P211, which is a set of images of left and right cat ears, and a stamp image P212, which is a set of images of left and right whiskers and a nose (dots). The stamp image P211 is a stamp image that is composited at a composite position determined based on the position of the user's head in the photographed image. The stamp image P212 is a stamp image that is composited at a composite position determined based on the center of the user's face in the photographed image.

[0260] Some of the impersonation stamps, such as the "Cherry" impersonation stamp and the "Cat" impersonation stamp, have their composite position determined based on the same position.

[0261] In the example on the right side of Fig. 32, a stamp image P211 intended for user U1 is composited at position p32, and a stamp image P212 is composited at position p41. Also, a stamp image P211 intended for user U2 is composited at position p42, and a stamp image P212 is composited at position p43.

[0262] That is, the stamp image P211 inherits the movement contents before the selection of the "cat" impersonation stamp, and is superimposed from the beginning at the position p32 which was the movement destination of the stamp image P201.

[0263] FIG. 33 is a diagram showing the difference in synthesis position.

[0264] The state shown on the left side of Fig. 33 is a state in which each stamp image constituting the "cat" impersonation stamp is composited in a default position. If the stamp image is not moved before the "cat" impersonation stamp is selected, the stamp images P211 and P212 are composited at a composite position determined based on the position of the user's head in the photographed image and a composite position determined based on the center of the user's face, respectively, as shown on the left side of Fig. 33.

[0265] The state shown on the right side of FIG. 33 is the state in which the contents of the movement have been carried over, as described with reference to FIG.

[0266] In this way, the adjustment of the composite mode is carried over when the type of the impersonation stamp is switched, so that the user can efficiently doodle using the impersonation stamp. For example, if the stamp image of the "Cat" impersonation stamp is composited in the default position when the user switches to the "Cat" impersonation stamp after moving the stamp image of the "Cat" impersonation stamp, the user would have to move it again, but this can be avoided.

[0267] In the above, the adjustments made to the composition target of the roleplay stamp are the movement adjustments made, but the enlargement / reduction adjustments and the rotation adjustments may also be made to ...

[0268] For example, in the case where the contents of the deletion are carried over, if the stamp image P201 is deleted after selecting the "Cherry" impersonation stamp, when the stamp image P201 is switched to the "Cat" impersonation stamp, the stamp image P211 is not composited, and only the stamp image P212 is composited.

[0269] In this way, the adjustment contents to be carried over can be changed arbitrarily. At least one of the adjustment contents of the multiple types of combination modes is carried over.

[0270] This allows the user to individually adjust the composition of the automatically composed stamp images, and to create a good-looking mobile phone image with a well-balanced composition.

[0271] In addition, the user can adjust the graffiti using the impersonation stamp and the stamp image synthesized with the impersonation stamp for each captured image. The user can create a number of good-looking images for mobile use based on each captured image.

[0272] When the back button is pressed after the stamp image has been moved, the position of the stamp image returns to the position before the movement. As described above, the tool area 602L is provided with a button that is pressed to return to the previous operation. As a behavior when the back button is pressed, instead of returning the position of the stamp image to the position before the movement, the operation of the impersonation stamp itself may be canceled and all stamp images composited by the impersonation stamp may be deleted.

[0273] When the position of a stamp image combined with the role-playing stamp is changed and then deleted, for example, the position before the deletion is stored. When graffiti is created again using the role-playing stamp, the stamp image is combined in the position before the deletion, thereby reducing the user's effort to adjust the position again.

[0274] Modifications As stamp images to be synthesized using the role-playing stamp, images for makeup such as images of eyeshadow, eyeliner, and eyelashes to be synthesized at the eye position of the face, a blush image to be synthesized at the cheek position, and a lip image to be synthesized at the lip position may be used.

[0275] This allows the user to input a plurality of makeup images at once, and also allows the user to adjust the composition manner of each of the plurality of makeup images.

[0276] In the above, the stamp image of the role-playing stamp is synthesized when a predetermined operation such as pressing the selection buttons 611-1 to 611-5 is performed, but it may be automatically synthesized when doodling starts without performing such an operation. For example, predetermined stamp images are randomly selected from a plurality of types of stamp images prepared according to the game theme, and are synthesized together.

[0277] This allows the user to easily input multiple stamp images for the roleplay stamp by simply selecting a game theme. The composition of the stamp images that are automatically composed in this way can also be adjusted as described above.

[0278] The composition mode of the sticky stamp image composed by the selection of the sticker design may be adjusted in the same manner as the stamp image of the role-playing stamp. When a plurality of sticky stamp images are composed by the selection of the sticker design, the user can adjust the composition mode of each sticky stamp image.

[0279] In the above, operations such as doodling are performed using the touch pen 142, but they may also be performed using a finger.

[0280] <Other> The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed in a computer incorporated in dedicated hardware or a general-purpose personal computer.

[0281] The program to be installed is provided by being recorded on a removable medium such as an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or semiconductor memory. It may also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in a ROM or storage unit.

[0282] The program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called. It should be noted that the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained.

[0283] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology. [Explanation of symbols]

[0284] 1 Photo sticker creation device, 141 tablet built-in monitor, 142 touch pen, 301 PC section, 302 pre-selection section, 304 photography section, 305 editing section, 306 printing section, 401 control section, 411 pre-selection processing section, 412 photography processing section, 413 editing processing section, 414 printing processing section, 415 transmission processing section, 421 image analysis section, 422 sticker image generation section, 423 sticker design data storage section, 424 mobile dedicated image generation section, 425 display control section

Claims

1. The image generating unit generates the layout image by composing a first content, which is superimposed on a person, and a second content, which represents a design of an area surrounding an area in which the photographed image is arranged, on a photographed image having an angle of view set for the design selected by the user, among a plurality of photographed images having a plurality of different angles of view, in response to a design of the layout image formed by arranging the photographed images, selected by a user. Image processing device.

2. The image generating unit synthesizes the first content at a synthesis position determined based on an analysis result of a feature of a person appearing in the photographed image. The image processing device according to claim 1 .

3. The image generating unit synthesizes the first content with respect to each of a plurality of people appearing in the photographed image.

3. The image processing device according to claim 1 or 2.

4. The display control unit further includes: a display control unit that displays a selection screen for a design of the layout image, on which the layout image generated by synthesizing the first content and the second content set for the design selected by the user is arranged.

4. The image processing device according to claim 1.

5. The display control unit displays a selection screen for the captured images to be used in generating the layout image after a design of the layout image is selected. The image processing device according to claim 4.

6. A first camera provided in front of the shooting space; A second camera provided on the ceiling of the shooting space; Further equipped with The plurality of captured images include an image captured by the first camera and an image captured by the second camera.

6. The image processing device according to claim 1.

7. The present invention further comprises a storage unit configured to store template information representing design components of the layout image, the template information including information representing the first content type, the second content type, and the captured image used to generate the layout image.

7. The image processing device according to claim 1.

8. the layout image is an image for printing, The layout image may be printed on a sticker sheet.

8. The image processing device according to claim 1.

9. The image processing device In response to a user's selection of a design of a layout image formed by arranging photographed images, a first content to be superimposed on a person and a second content representing a design of an area surrounding an area in which the photographed images are arranged are synthesized with the photographed image having an angle of view set for the design selected by the user out of a plurality of photographed images having a plurality of different angles of view, thereby generating the layout image. Image processing methods.

10. On the computer, In response to a user's selection of a design of a layout image formed by arranging photographed images, a first content to be superimposed on a person and a second content representing a design of an area surrounding an area in which the photographed images are arranged are synthesized with the photographed image having an angle of view set for the design selected by the user out of a plurality of photographed images having a plurality of different angles of view, thereby generating the layout image. A program for executing a process.

Citation Information

Patent Citations

  • Photographic printer, printing paper unit, method, program for controlling photographic printer and computer readable recording medium in which the same is recorded

    JP2004062839A

  • Photographic print device control method, its program, recording medium with the program recorded thereon, photographic print device, print medium unit and print medium

    JP2004064454A

  • Photographic sticker making device, photographic sticker making method, and program

    JP2009258488A

  • Photographic seal producing apparatus

    JP2013254213A

  • Photographic seal creation device and image processing method

    JP2015210515A