Image processing system

Abstract

To diversify the layout of images photographed by a game image photographing device.SOLUTION: The play image photographing device includes a photographing processing unit configured to photograph a user in a photographing space, an editing processing unit configured to receive an editing input from the user for a photographed image in an editing space, an image output unit configured to output an edited image, which is the photographed image after editing, to an external medium, and an area designation unit configured to designate an output area indicating a range to be output to the external medium in the photographed image. The area designation unit fixes the output area at a predetermined position in the captured image according to a preset condition in a first direction, and variably sets the output area according to an instruction from a user in a second direction different from the first direction.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to capturing game images, and in particular to a technique for adjusting the layout of captured images. [Background technology]

[0002] Fun image capture devices, such as Purikura (registered trademark), are extremely popular, especially among high school girls. With a fun image capture device, users take a photo of themselves and decorate the captured image in various ways on an editing display. The decorated image is then provided to the user by printing it onto a sticker mount or by downloading it from a device such as a smartphone or PC. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 5246524 Summary of the Invention [Problem to be solved by the invention]

[0004] Users playing with game image capture devices decorate their captured images by writing messages or attaching stamps to them in various ways. When writing messages, users often want to write the message in the blank space of the captured image. For example, if the user's face is displayed at the bottom of the image to be decorated, there will be more blank space at the top of the image than if the user's face is displayed in the center of the image. This allows the user to have more space to write a message. It is also desirable for the user to be able to freely change the size of such blank space depending on the message they want to write.

[0005] The present invention was completed based on the above-mentioned points of view of the inventors, and its main purpose is to provide technology for adjusting the position of a subject in an image captured by a game image capturing device. [Means for solving the problem]

[0006] In one aspect of the present invention, a game image capture device includes a capture processing unit that captures a user in a capture space, an editing processing unit that accepts editing input from the user for the captured image in an editing space, an image output unit that outputs the edited captured image to an external medium, and an area designation unit that designates an output area in the captured image that indicates the range to be output to the external medium. In a first direction, the area designation unit fixes the output area to a predetermined position in the captured image according to preset conditions, and in a second direction different from the first direction, the output area is variably set according to instructions from the user. [Effects of the Invention]

[0007] According to the present invention, in a game image photographing device, a user can more easily edit photographed images in a more flexible layout. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating the overall configuration of a game image capturing system. [Figure 2] FIG. 2 is a perspective view of the appearance of the game image capturing device. [Figure 3] FIG. [Figure 4] 10 is a flowchart showing the flow of play in the game image capturing device. [Figure 5] FIG. 2 is a plan view of the game image capturing device seen from above. [Figure 6] FIG. 2 is a functional block diagram of the play image capturing device. [Figure 7] 1 is a schematic diagram of an original still image, a captured image, an adjusted image, and modifiable areas. [Figure 8] FIG. 2 is a schematic diagram showing a captured image in the first embodiment. [Figure 9] 2A and 2B are schematic diagrams showing a still original image and a captured image in the first embodiment. [Figure 10]FIG. 4 is a schematic diagram illustrating an adjustment process in the first embodiment. [Figure 11] FIG. 2 is a schematic diagram showing an editing screen in the first embodiment. [Figure 12] FIG. 4 is a schematic diagram showing readjustment in the first embodiment. [Figure 13] FIG. 4 is a schematic diagram showing a readjusted image in the first embodiment. [Figure 14] FIG. 2 is a schematic diagram showing an edited image in the first embodiment. [Figure 15] FIG. 10 is a schematic diagram showing a captured image in the second embodiment. [Figure 16] 10A and 10B are schematic diagrams showing a still original image and a captured image in the second embodiment. [Figure 17] FIG. 10 is a schematic diagram showing an adjustment process in the second embodiment. [Figure 18] FIG. 10 is a schematic diagram showing an editing screen in the second embodiment. [Figure 19] FIG. 11 is a schematic diagram showing a captured image in the third embodiment. [Figure 20] FIG. 11 is a schematic diagram showing an adjustment process in the third embodiment. [Figure 21] FIG. 11 is a schematic diagram showing an editing screen in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] First, an overview of the game image capturing device of the present invention will be described. Next, the detailed configuration of the game image capturing system will be described. Next, the detailed processing flow will be described for each of the first to third embodiments. Finally, modified examples will be described. Hereinafter, the first to third embodiments will be collectively referred to as "the present embodiment."

[0010] First, an outline of the game image device according to this embodiment will be described. The game image capturing device in this embodiment is equipped with a photo booth (photography space) and an editing booth (editing space). Users take photos of themselves in the photo booth. Hereinafter, an image captured of a subject (user) in the photo booth will be referred to as a "photographed image." The game image capturing device adjusts the position of the display range of the captured image based on the position of the user in the photo booth (hereinafter, such automatic adjustment processing will be simply referred to as an "adjustment processing"). Details of the adjustment processing will be described later. Hereinafter, a captured image that has undergone adjustment processing will be referred to as an "adjusted image."

[0011] In this embodiment, the shooting space and the editing space are described as being separate spaces, but the shooting space and the editing space may be the same space. In this case, a predetermined space may be used as the shooting space during shooting and as the editing space during editing.

[0012] The adjusted image is sent to the editing booth. In the editing booth, the user can further adjust the position of the display range of the adjusted image (hereinafter, such manual adjustment processing will be referred to as "readjustment"). Hereinafter, an image that has been readjusted by the user will be referred to as a "readjusted image." Furthermore, the user can decorate the readjusted image as desired, such as by drawing with a stylus or attaching a stamp image (hereinafter, such image decoration processing and readjustment will be referred to as "editing work"). A readjusted image that has completed editing work will be referred to as an "edited image."

[0013] The user selects a mount image that defines the layout and background of the edited image. The user then composites the edited image onto the selected mount image. Hereinafter, the image obtained as the final product by embedding the edited image into the mount image will be referred to as the "finished image."

[0014] The game image capturing device prints the completed image onto a sticker mount or photo printing paper (external medium). The game image capturing device also uploads the completed image, which is an image in which the edited image is fitted into the mount image, and the edited image, which is an image before the mount image is fitted, to a server (external medium). Users can also download edited images, etc. by accessing the server from a user terminal such as a smartphone or PC. As described above, the game image capturing device in this embodiment has a capture function, an editing function, a printing function, and a communication function.

[0015] Next, the detailed configuration of the game image photographing system will be described. FIG. 1 is a diagram showing the overall configuration of a game image capturing system 200. As shown in FIG. In the game image capturing system 200, the game image capturing device 100 is connected to a server 202 and a user terminal 206 (a mobile device and a PC) via the Internet 204. Hereinafter, the user terminal 206 is assumed to be a mobile device such as a smartphone. The user captures a picture of themselves using the game image capturing device 100. The game image capturing device 100 acquires a captured image including the subject (user), performs adjustment processing on the captured image, and accepts editing work by the user. As mentioned above, the editing work here also includes readjusting the position of the display range (described later).

[0016] The edited image and the completed image after the editing work are uploaded to the server 202 together with the user ID from the game image capturing device 100. The server 202 stores the user ID, the capture date and time, the edited image, and the completed image (a composite image of the edited image and the mount image) in association with each other. The user can download the edited image, etc. from the server 202 by accessing the server 202 by specifying the user ID.

[0017] FIG. 2 is a perspective view of the appearance of the game image capturing device 100. As shown in FIG. The game image capturing device 100 comprises a reception device 102, a photo booth 104, an editing booth 106, and a printing device 110. The reception device 102 comprises a reception monitor 108. A user reserves the use of the game image capturing device 100 at the reception device 102. At the reception device 102, the user inputs a user ID into the reception monitor 108 and pays a play fee in cash or electronic money.

[0018] The user takes a photo in the photo booth 104. After taking the photo, the user moves to the editing booth 106. An editing device 126 is installed in the editing booth 106. The editing device 126 is equipped with an editing monitor 120. The edited image (the image to be readjusted or decorated) is displayed on the editing monitor 120. In this embodiment, the editing monitor 120 is formed by a capacitive touch panel. Two stylus pens 122a and 122b are provided for one editing monitor 120. The user uses the stylus pen 122 and their finger to readjust or decorate the adjusted image. After editing is completed, the printing device 110 prints the completed image on a sticker mount. The editing device 126 also uploads the edited image, etc. to the server 202.

[0019] FIG. 3 is a perspective view of the exterior of the photo booth 104. As shown in FIG. The photo booth 104 is shielded from the outside by a curtain 124. A photo taking device 128 is installed in the photo booth 104. The photo taking device 128 includes a lighting device 116, which is a light that illuminates the user, who is the subject, from three directions, a camera 118 for acquiring photographed images, and a photo taking monitor 112. The lighting device 116 is a large lighting device that illuminates the entire photo taking booth 104. The photo taking monitor 112 displays a live view image that allows the user to check their own appearance, as well as a countdown image that indicates the timing for taking photos.

[0020] Fig. 4 is a flowchart showing the flow of play in the game image capturing device 100. Fig. 5 is a plan view of the game image capturing device 100 as seen from above. When a user makes a reservation for use at the reception device 102, the reception device 102 executes reception processing (S10). When making a reservation, the user selects the size of the display range of the photographed image on the reception monitor 108 corresponding to the number of players. Hereinafter, the image display range will be referred to as a "frame." There are two sizes of frame for photographed images: a "for two people" size suitable for photographing two people, and a "for three or more people" size suitable for photographing three or more people. The vertical widths of the "for two people" frame and the "for three or more people" frame are both set to the same length. On the other hand, the horizontal width of the "for three or more people" frame is set to be longer than the "for two people" frame. After completing the reception, the user enters the photo booth 104.

[0021] The photographing device 128 acquires a photographed image of the user (S12). During photographing, a live view image with the frame size selected by the user in S10 is displayed on the photographing monitor 112. In the photographing booth 104, the user can acquire photographed images a specified number of times. In this embodiment, the specified number is eight times. The photographing device 128 performs an adjustment process on the photographed image (S14). In the adjustment process, the photographing device 128 automatically changes the frame position of the photographed image to generate an adjusted image. The frame size of the adjusted image is the same as that of the live view image (photographed image), but the frame position of the adjusted image differs from that of the live view image. Specific processing will be described later.

[0022] After the adjustment process is completed, the photographing device 128 determines whether or not a specified number (eight) of photographed images have been acquired (S16). If the specified number of photographed images have not been acquired (N in S16), the photographing device 128 continues photographing. If the specified number of photographed images have been acquired (Y in S16), the photographing device 128 ends photographing. That is, when photographing with the photographing device 128, the process of acquiring photographed images, adjusting the frame position of the photographed images, and acquiring adjusted images is repeated eight times (specified number of times).

[0023] After shooting, information instructing one of the two editing booths 106 is displayed on the shooting monitor 112. The user moves to the editing booth 106 specified by the shooting monitor 112, out of the two editing booths 106a and 106b. The adjusted image is transferred from the shooting device 128 to the editing device 126. The user performs editing work on the editing device 126. First, the user readjusts the transferred adjusted image. In readjustment, the user changes the position of the frame of the adjusted image to generate a readjusted image. Note that the frame size of the readjusted image is the same as that of the adjusted image. Specific processing will be described later. The user then applies decorative processing to the readjusted image to create an edited image (S18). After completing the editing work, the user selects a mount image and creates a finished image by laying out the edited image on the mount image.

[0024] The editing device 126 sends the completed image to the printing device 110, which then prints the completed image on a sticker mount (S20). The editing device 126 also uploads the edited image and the completed image to the server 202 via the Internet 204 (S22). By accessing the server 202, the user can download the edited image, etc. from the server 202 to the user terminal 206.

[0025] Generally, editing takes longer than photographing. In the game image photographing device 100 of this embodiment, two editing booths 106a, 106b (editing devices 126a, 126b) are provided for one photographing booth 104, thereby increasing customer turnover.

[0026] FIG. 6 is a functional block diagram of the play image capturing device 100. As shown in FIG. Each component of the game image capture device 100 is realized by hardware including computing units such as a CPU (Central Processing Unit) and various co-processors, storage devices such as memory and storage, and wired or wireless communication lines connecting them, as well as software stored in the storage devices that supplies processing instructions to the computing units. The computer program may be composed of device drivers, an operating system, various application programs located at higher layers than these, and libraries that provide common functions to these programs. As described above, the game image capture device 100 is configured as a collection of the capture device 128, the reception device 102, the editing device 126, and the printing device 110. Each block described below represents a functional block, not a hardware configuration.

[0027] The game image capturing device 100 includes a user interface processing unit 130, a data processing unit 132, a communication unit 134, and a data storage unit 136. As described above, the game image capturing device 100 also includes a camera 118 and a lighting device 116. The user interface processing unit 130 is responsible for user interface processing via the reception monitor 108, editing monitor 120, etc. The communication unit 134 is responsible for communication processing with the server 202 via the Internet 204. The communication unit 134 can also communicate directly with the user terminal 206 via short-range wireless communication such as Wi-Fi (registered trademark). For example, the communication unit 134 may directly transmit an edited image to the user terminal 206. The data storage unit 136 stores various data. The data processing unit 132 performs various processes based on the data acquired by the communication unit 134 and the data stored in the data storage unit 136. The data processing unit 132 also functions as an interface between the user interface processing unit 130, the communication unit 134, and the data storage unit 136.

[0028] The user interface processing unit 130 includes an input unit 140 that accepts operation inputs from the user, and an output unit 142 that presents information to the user.

[0029] The input unit 140 detects user operation inputs to touch panels installed in the reception device 102, the photographing device 128, the editing device 126, etc. The input unit 140 also detects operation inputs made by the stylus pen 122. The input unit 140 also detects a user ID in the reception device 102.

[0030] The output unit 142 executes various output processes such as image display on the reception device 102, the photographing device 128, the editing device 126, etc., as well as audio output and print output.

[0031] During shooting, the output unit 142 displays a live view image of the user (subject) on the shooting monitor 112. The user performs shooting while checking his or her own image in the live view image as if looking at a mirror.

[0032] The data processing unit 132 includes a photography processing unit 144 , an area designation unit 146 , an edit processing unit 148 , a reception processing unit 150 , and an image output unit 152 . The photography processing unit 144 controls the photography processing in the photography booth 104. The photography processing unit 144 also fires a strobe (not shown). The photography processing unit 144 notifies the user of the photography timing by instructing the output unit 142 to display a countdown and make an audio notification. The area designation unit 146 generates an adjusted image using a method described below. The area designation unit 146 also readjusts the adjusted image in accordance with operation input from the user to generate a readjusted image. The output unit 142 displays the adjusted image on the editing monitor 120 (a capacitive touch panel). The editing processing unit 148 decorates the readjusted image in accordance with operation input from the user to generate an edited image. The reception processing unit 150 manages the payment of play fees by users at the reception device 102. The reception processing unit 150 also accepts the user's selection of the frame size for the photographed image. Each time photography work in the photography booth 104 is completed, the reception processing unit 150 guides users with reservations to the photography booth 104. The image output unit 152 controls the printing of the completed image on the printing device 110 and the output of the edited image and the like to the user terminal 206 .

[0033] The communication unit 134 includes a receiving unit 230 that receives data and a transmitting unit 232 that transmits data.

[0034] Here, the photographing process (S12), the adjustment process (S14), and the editing process (S18) in this embodiment will be described in detail. First, the photographing process (S12) will be described in detail. FIG. 7 is a schematic diagram of a still original image 300, a captured image 310, an adjusted image 320, and a modifiable region 330. When a user who has completed check-in at the reception device 102 enters the photo booth 104, the camera 118 starts capturing an original image. The original image is an image captured with the widest angle of view that the camera 118 can capture. The photo processing unit 144 also extracts a portion of the original image in the frame size selected by the user at check-in, and displays it as a live view image on the photo monitor 112. In this way, the camera 118 captures a relatively wide range as the original image, but only a portion of the original image is displayed as the live view image.

[0035] The photography processing unit 144 instructs the output unit 142 to output an announcement that photography should begin. The photography processing unit 144 also sends an instruction to the camera 118 to acquire a still original image 300 (described below) the moment the countdown time expires. Note that the countdown time refers to the time required for the countdown. At the same time, the photography processing unit 144 instructs the output unit 142 to display the countdown and notify it by voice.

[0036] The moment the countdown ends, the camera 118 acquires the original image captured at that moment as the still original image 300. At the same time, the shooting processing unit 144 acquires a live view image at the moment the countdown time ends as the captured image 310 (area indicated by solid lines). That is, the original image at the time of shooting is acquired as the still original image 300, and a live view image that is a part of the original image is acquired as the captured image 310. As a result, the still original image 300, which is a relatively large still image, and the captured image 310, which is a relatively small image that has been cropped from the still original image 300, are obtained.

[0037] Next, the adjustment process (S14) will be described in detail. The still original image 300 and the captured image 310 are transferred to the area designation unit 146. The area designation unit 146 changes the position of the frame of the captured image 310 vertically and horizontally within the range of the still original image 300, and generates an adjusted image 320 (area indicated by dashed lines).

[0038] For example, consider a situation in which a user is taking a photograph, as shown in FIG. 7 . In the photographed image 310, the user's face is shown in the upper left. In this case, the area designation unit 146 detects the position of the face shown in the still original image 300 and automatically changes the position of the frame of the photographed image 310 so that the user's face is positioned at the center of the adjusted image 320. As a result, an adjusted image 320 is generated in which the user's face is positioned at the center. The frame size of the adjusted image 320 is the same as that of the photographed image 310 (live view image), but the cropping position in the still original image 300 is different from that of the photographed image 310. As described above, the photographed image 310 is acquired corresponding to the live view image (the image viewed by the user), and then the cropping position is adjusted to match the user's position, thereby acquiring the adjusted image 320. This control method allows appropriate position adjustment even if the user ends up in a corner of the photographed image 310.

[0039] After generating the adjusted image 320, the area designation unit 146 sets a modifiable area 330 (area indicated by a two-dot chain line) on the still original image 300. The modifiable area 330 is an area in which the position of the adjusted image 320 can be changed when the user performs readjustment, which will be described later. The horizontal width of the modifiable area 330 is the same as that of the adjusted image 320, but the vertical width is set to be longer than that of the adjusted image 320. In other words, the modifiable area 330 is set within the still original image 300 at a position and size based on the adjusted image 320. Note that in this embodiment, the vertical width of the modifiable area 330 is set to 1.5 times the vertical width of the adjusted image 320, but does not exceed the extent of the original image.

[0040] The above-described shooting process and adjustment process are performed a specified number of times, eight times, for each shot image, and the adjusted image 320 and the still original image 300 with the modifiable area 330 set therein are transferred to the editing device 126. The shooting processing unit 144 also instructs the output unit 142 to notify the user by display and audio regarding the move to the editing booth 106. The user who received the instruction moves to the editing booth 106.

[0041] Next, the editing process (S18) will be described in detail. After completing the shoot, the user enters the editing booth 106 and uses the editing device 126 to edit the adjusted image 320. The adjusted image 320 is displayed on the editing monitor 120. The user then vertically repositions the frame of the adjusted image 320 within the modifiable area 330 and fixes it at a desired location. In other words, the modifiable area 330 is the range within which the frame position of the adjusted image 320 can be changed. This operation of repositioning and fixing the frame position is called readjustment. Specific user operations for readjustment will be described later. In FIG. 7, readjustment is possible within the range indicated by the double-headed arrows drawn above and below the adjusted image 320. In this way, the user repositions and fixes the frame position of the adjusted image 320, generating a readjusted image 340. After the readjusted image 340 is generated, the user decorates the image by writing a message, for example. The editing processor 148 accepts input from the user and creates an edited image 350.

[0042] Next, detailed processing flows will be described for each of the first to third embodiments. In the first embodiment, a scene in which two users take a picture side by side will be described. In the second embodiment, a scene in which three users take a picture side by side will be described. In the third embodiment, a scene in which two users take a picture with their faces lined up above each other will be described.

[0043] [First embodiment] In the first embodiment, a scene is assumed in which two users A1 and A2 are taking pictures. First, users A1 and A2 pay the play fee at the reception device 102 and enter their user IDs. Users A1 and A2 also select the frame size at the reception device 102. Users A1 and A2 select "for two players" as the frame size for the photographed image 310. At this time, the reception processing unit 150 detects that the play fee has been paid and accepts the user ID and the selection of the "for two players" frame. The reception processing unit 150 instructs the output unit 142 to output an announcement urging the users to enter the photo booth 104. At this time, the photo processing unit 144 instructs the lighting device 116 to turn on. In response to this instruction, the lighting device 116 illuminates the inside of the photo booth 104.

[0044] Following the instruction to enter the photography booth 104, users A1 and A2 enter the photography booth 104. The photography processing unit 144 extracts an area corresponding to the size of the "two-person" frame from the original image captured by the camera 118. The photography processing unit 144 instructs the output unit 142 to display this area on the photography monitor 112 as a live view image.

[0045] The photography processing unit 144 instructs the output unit 142 to output an announcement that photography should begin. The photography processing unit 144 also sends an instruction to the camera 118 to acquire a still original image 300 the moment the countdown time ends. At the same time, the photography processing unit 144 instructs the output unit 142 to display the countdown and notify the user by voice. When the countdown begins, users A1 and A2 pose for photography while checking their own appearance in the live view image displayed on the photography monitor 112. The moment the countdown time ends, the camera 118 acquires the still original image 300. At the same time, the photography processing unit 144 acquires a captured image 310, which is a part of the still original image 300.

[0046] The region designation unit 146 performs adjustment processing based on the still original image 300 and the captured image 310. When the adjustment processing by the region designation unit 146 is completed, the shooting processing unit 144 again sends an instruction to the camera 118 to acquire the still original image 300. At the same time, the region designation unit 146 instructs the output unit 142 to notify a countdown. This processing is repeated eight times to acquire the still original image 300 and the captured image 310. In other words, a set of the still original image 300 and the captured image 310, which is an extracted portion of the still original image 300, can be acquired in one shooting. Eight sets of these sets are acquired after eight shootings (the specified number of times).

[0047] FIG. 8 is a schematic diagram showing a captured image 310 in the first embodiment. 8, users A1 and A2 are shown hugging each other and shifting to the right of the center. In other words, in the captured image 310 before adjustment processing, the positions of the two users are shifted to the right.

[0048] FIG. 9 is a schematic diagram showing a still original image 300 and a captured image 310 in the first embodiment. The camera 118 captures an original image during shooting. The shooting processor 144 extracts an area from the original image that corresponds to the size of the "two-person" frame and displays it as a live view image on the shooting monitor 112. The moment the countdown time ends, the camera captures a still original image 300. At the same time, the shooting processor 144 captures a captured image 310.

[0049] FIG. 10 is a schematic diagram showing the adjustment process in the first embodiment. Based on the still original image 300 and the captured image 310, the region designation unit 146 performs an adjustment process to generate an adjusted image 320. During the adjustment process, the region designation unit 146 automatically detects a position where the faces of users A1 and A2 are displayed near the center by changing the frame position of the captured image 310 vertically and horizontally within the range of the still original image 300. In this embodiment, the region designation unit 146 detects the midpoint (not shown) between the faces of users A1 and A2 and changes the position of the frame of the captured image 310 so that this point is the center of the image. The range (the range indicated by the dashed line) that appears when this position is confirmed becomes the frame of the adjusted image 320. In the adjusted image 320 after adjustment, the two users are positioned at the center. The region designation unit 146 also sets a modifiable region 330 based on the position and frame size of the adjusted image 320. The adjusted image 320 and the original still image 300 with the modifiable region 330 set therein are transferred to the editing device 126 .

[0050] When the shooting is completed, the shooting processing unit 144 instructs the output unit 142 to notify by display and sound that the users should move to the editing booth 106. Having received the instruction, users A1 and A2 move to the editing booth 106.

[0051] FIG. 11 is a schematic diagram showing an editing screen 400 in the first embodiment. An editing screen 400 is displayed on the editing monitor 120 in the editing device 126 of the editing booth 106. As described above, the editing device 126 acquires the still original image 300, but what is displayed on the editing screen 400 is an adjusted image 320, which is a portion of the still original image 300. The edit screen 400 displays the adjusted image 320 and a slider bar 410 with a slider 420. Users A1 and A2 make readjustments on the edit screen 400.

[0052] Specifically, users A1 and A2 move slider 420 on slider bar 410 on the right side of editing screen 400 to adjust the position of the frame of adjusted image 320 vertically within modifiable area 330. Slider 420 represents the user's appearance. Therefore, when slider 420 is moved downward, the user's appearance on adjusted image 320 also moves downward. In other words, the further slider 420 is moved downward, the more blank space there is at the top of adjusted image 320.

[0053] FIG. 12 is a schematic diagram showing readjustment in the first embodiment. As users A1 and A2 operate the slider 420, the area designation unit 146 changes the position of the frame of the adjusted image 320 within the range of the double-headed arrow in the changeable area 330. When users A1 and A2 fix the position of the slider 420 at a desired location, the area designation unit 146 generates a readjusted image 340 based on the frame position at that time.

[0054] The flow of FIGS. 11 and 12 will be explained in a different form. The adjusted image 320 and the still original image 300 with the modifiable area 330 set are transferred to the editing device 126 upon completion of the adjustment process. Of the transferred still original images 300, the adjusted image 320 is designated as the first image to be displayed on the editing screen 400. Furthermore, the modifiable area 330 is designated as the range within which the frame position of the adjusted image 320 can be changed. Initially, the adjusted image 320 is displayed on the editing screen 400. However, users A1 and A2 can move the slider 420 to change the frame position within the modifiable area 330. When the position of the slider 420 is fixed at a desired location, the area designation unit 146 generates a readjusted image 340 based on the frame position at that time. For example, if the slider 420 is moved downward while the adjusted image 320 shown in FIG. 12 is displayed, the adjusted image 320 moves upward. In the adjusted image 320 after the movement, users A1 and A2 are displayed lower than before the movement. In other words, moving the slider downward means moving the users downward. As a result, an image (readjusted image 340) with blank space above the heads of users A1 and A2 can be created, as shown in the following Figure 13.

[0055] FIG. 13 is a schematic diagram showing a readjusted image 340 in the first embodiment. As a result of readjustment by users A1 and A2, a readjusted image 340 like the one shown in Figure 13 is generated. Compared to adjusted image 320, there is more blank space at the top of readjusted image 340. The user can decorate this blank space by writing any message or attaching a stamp.

[0056] FIG. 14 is a schematic diagram showing an edited image 350 in the first embodiment. Users A1 and A2 decorate the blank space at the top of the readjusted image 340 by touching the editing monitor 120 or using the stylus pen 122. Users A1 and A2 write the message "We'll always be friends" in this blank space and attach multiple heart-shaped stamps. The editing processing unit 148 accepts such input from the users and generates edited image 350.

[0057] After the edited image 350 is generated, users A1 and A2 further select a mount image and lay out the edited image 350 on the mount image to create a completed image. Once the completed image is created, the image output unit 152 instructs the output unit 142 to print the completed image. In accordance with the instructions of the image output unit 152, the completed image is printed on a sticker mount or photo printing paper by the printing device 110. The image output unit 152 also uploads the edited image and the completed image to the server 202 via the Internet 204. Users A1 and A2 can download the edited image, etc. to their user terminals 206 by accessing the server 202.

[0058] [Second embodiment] In the second embodiment, a scene is assumed in which three users, A3, A4, and A5, are taking a photo. Unlike the first embodiment, in the second embodiment, the three users select a frame for "three or more people." Here, the horizontal adjustment process by the area designation unit 146 will be described in detail.

[0059] At the time of reception, users A3, A4, and A5 select "for three or more people" as the frame size for the photographed image 310. Following the instructions to enter the photographing booth 104, users A3, A4, and A5, who have completed the reception, enter the photographing booth 104. The photographing processing unit 144 extracts an area corresponding to the frame size for "for three or more people" from the original image captured by the camera 118. The photographing processing unit 144 instructs the output unit 142 to display this area on the photographing monitor 112 as a live view image.

[0060] The photographing processing unit 144 instructs the output unit 142 to display a countdown and notify the user by voice. When the countdown begins, users A3, A4, and A5 pose for a photo shoot while checking their own appearance in the live view image displayed on the photographing monitor 112. The moment the countdown time ends, the camera 118 captures a still original image 300. At the same time, the photographing processing unit 144 captures a photographed image 310. The area designation unit 146 performs adjustment processing based on the still original image 300 and the photographed image 310. This processing is repeated eight times, and the still original image 300 and the photographed image 310 are acquired.

[0061] FIG. 15 is a schematic diagram showing a captured image 310 in the second embodiment. In the photographed image 310 of FIG. 15, users A3 and A4 are close to each other in the center, and the right side of A5's face is outside the photographed image 310.

[0062] FIG. 16 is a schematic diagram showing a still original image 300 and a captured image 310 in the second embodiment. As in the first embodiment, the camera 118 captures an original image during shooting. The shooting processor 144 extracts an area from the original image that corresponds to the size of the frame for "three or more people" and displays it as a live view image on the shooting monitor 112. The moment the countdown time ends, the camera captures a still original image 300. At the same time, the shooting processor 144 captures a captured image 310.

[0063] FIG. 17 is a schematic diagram showing the adjustment process in the second embodiment. Of the users appearing in the still original image 300, the region designation unit 146 sets point P1 at the left edge of the face of the leftmost person and point P2 at the right edge of the face of the rightmost person. In FIG. 17, the region designation unit 146 sets point P1 on the outside of the right ear of user A3 and point P2 on the outside of the left ear of user A5. The region designation unit 146 sets a reference line in the vertical direction of the image so as to pass through the set points P1 and P2. The reference line passing through point P1 is called a left reference line 321. The reference line passing through point P2 is called a right reference line 322. The region designation unit 146 sets a vertical center line 323 at a location midway between the left reference line 321 and the right reference line 322. Similarly, the area designation unit 146 sets a center line (not shown) at a location midway between the top of the head of user A3, whose face is displayed at the highest position, and the tip of the chin of user A4, whose face is displayed at the lowest position. The area designation unit 146 moves the position of the frame of the captured image 310 so that the point where this center line intersects with the vertical center line 323 is the center of the image. The range that appears when this position is confirmed becomes the frame of the adjusted image 320. At this time, the area designation unit 146 also sets a modifiable area 330 based on the position and size of the adjusted image 320. The adjusted image 320 and the still original image 300 with the modifiable area 330 set are transferred to the editing device 126.

[0064] FIG. 18 is a schematic diagram showing an editing screen 400 in the second embodiment. Users A3, A4, and A5 move slider 420 on slider bar 410 on editing screen 400. This causes area designation unit 146 to adjust the margins of adjusted image 320 within the range of modifiable area 330, generating readjusted image 340. Users A3, A4, and A5 decorate the margins of readjusted image 340 by writing any message or attaching a stamp, for example. Editing processing unit 148 accepts such input from the users and generates edited image 350.

[0065] [Third embodiment] In the third embodiment, a scene is assumed in which two users, A6 and A7, are taking a photo. In the third embodiment, as in the first embodiment, the two users select a "two-person" frame. Here, the vertical adjustment process by the area designation unit 146 will be described in detail. At the time of reception, users A6 and A7 select "two-person" as the frame size of the captured image 310. Following the instruction to enter the photo booth 104, users A6 and A7 enter the photo booth 104 after completing reception. The photo processing unit 144 extracts an area corresponding to the "two-person" frame size from the original image captured by the camera 118. The photo processing unit 144 instructs the output unit 142 to display this area on the photo monitor 112 as a live view image.

[0066] The photographing processing unit 144 instructs the output unit 142 to display a countdown and notify the user by voice. When the countdown begins, users A6 and A7 pose for a photo shoot while checking their appearance in the live view image displayed on the photographing monitor 112. The moment the countdown time ends, the camera 118 captures a still original image 300. At the same time, the photographing processing unit 144 captures a photographed image 310. The region designation unit 146 performs adjustment processing based on the still original image 300 and the photographed image 310. This processing is repeated eight times, and the still original image 300 and the photographed image 310 are acquired.

[0067] FIG. 19 is a schematic diagram showing a captured image 310 in the third embodiment. In the photographed image 310 of FIG. 19, the faces of users A6 and A7 are shown next to each other, one above the other, slightly shifted to the right.

[0068] FIG. 20 is a schematic diagram showing the adjustment process in the third embodiment. The region designation unit 146 sets point P3 at the top of the head of the topmost user (user A6) among the users appearing in the still original image 300, and point P4 at the bottom of the face of the bottommost user (user A7). In FIG. 19, the region designation unit 146 sets point P3 at the tip of user A6's head and point P4 at the tip of user A7's chin. The region designation unit 146 sets reference lines in the horizontal direction of the image so as to pass through the set points P3 and P4. The reference line passing through point P3 is called an upper reference line 324. The reference line passing through point P4 is called a lower reference line 325. The region designation unit 146 sets a horizontal center line 326 at a location midway between the upper reference line 324 and the lower reference line 325. Similarly, the area designation unit 146 sets a center line (not shown) at a location midway between the tip of the right cheek of user A6, who appears on the far left, and the tip of the left cheek of user A7, who appears on the far right. The area designation unit 146 moves the position of the frame of the captured image 310 so that the point where this center line intersects with the horizontal center line 326 is the center of the image. The range that appears when this position is confirmed becomes the frame of the adjusted image 320. At this time, the area designation unit 146 also sets a modifiable area 330 based on the position and size of the adjusted image 320. The adjusted image 320 and the still original image 300 with the modifiable area 330 set are transferred to the editing device 126.

[0069] FIG. 21 is a schematic diagram showing an editing screen 400 in the third embodiment. Users A6 and A7 move slider 420 on slider bar 410 on editing screen 400. This causes area designation unit 146 to adjust the margins of adjusted image 320 within the modifiable area 330, generating readjusted image 340. Users A6 and A7 decorate the margins of readjusted image 340 by writing any message or attaching a stamp, for example. Editing processing unit 148 accepts such input from the users and generates edited image 350.

[0070] The game image capturing device 100, the server 202, and the game image capturing system 200 have been described above based on the embodiments. In the present invention, the adjusted image 320 is generated by automatically correcting the frame position of the captured image 310 so that the user's face is centered. Furthermore, the user can change the frame position of the adjusted image 320 in a specific direction to generate a readjusted image 340. Compared to the adjusted image 320, the readjusted image 340 can have more blank space. The user can decorate the readjusted image 340 by writing a message in the blank space, for example.

[0071] When multiple users take a photo, it is desirable that all users appear in the captured image. Therefore, the position of the frame of the captured image 310 is automatically adjusted horizontally so that all users appear near the center of the image. This allows users to take photos comfortably without worrying about their standing position or the position of their face. On the other hand, it is desirable that users be able to freely adjust the margins in the vertical direction of the image depending on the amount of messages they write or stamps they attach. Therefore, by setting a margin in one direction, users can freely change the position of the frame in the vertical direction and adjust the space of the margins.

[0072] Generally, it is desirable to set such blank space above the user's head. A monochrome background (chromakey) of the photo booth 104 is projected above the user's head. Therefore, in the area above the user's head, the user can write a message or affix a stamp without it overlapping the user's face or clothing. Therefore, in the present invention, the position of the adjusted image 320 is initially set to the bottom of the modifiable area 330 to facilitate creating a blank space above the user's head (see, for example, Figures 7, 12, and 20). The blank space can be freely set within the modifiable area 330. For example, a user who wants to clearly capture both the user's face and clothing and does not need a blank space may generate the adjusted image 320 in its default position as the readjusted image 340. A user who wishes to write a large message in the blank space of the image, even if it obscures some of the user's clothing, can create a blank space of the desired size by changing the position of the frame of the adjusted image 320 within the modifiable area 330. Such users can write messages freely without worrying about the margins of the image, and can therefore create photos with more original designs.

[0073] The present invention is not limited to the above-described embodiments and modifications, and the components can be modified without departing from the spirit of the invention. Various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments and modifications. Furthermore, some components can be omitted from all the components shown in the above-described embodiments and modifications.

[0074] In the above description, the game image capturing system 200 is configured by the game image capturing device 100, the server 202, and the user terminal 206, and in particular the game image capturing device 100 and the server 202. However, some of the functions of the game image capturing device 100 may be realized by the server 202, or some of the functions of the server 202 may be assigned to the game image capturing device 100. Also, some of the functions of these devices may be performed by a third device other than the game image capturing device 100 and the server 202. How the multiple functions required to realize the present invention are allocated to one or more pieces of hardware may be determined in consideration of the processing capabilities of each piece of hardware and the specifications required for the game image capturing system 200.

[0075] In this embodiment, when generating the readjusted image 340, the horizontal position of the adjusted image 320 is fixed, and the user changes the position of the frame of the adjusted image 320 vertically within the changeable area 330. As a variation, the user may be able to generate the readjusted image 340 by moving the adjusted image 320 both horizontally and vertically. Alternatively, after generating the readjusted image 340, the user may be able to further change the position of the frame of the readjusted image 340 horizontally or vertically.

[0076] In this embodiment, it has been described that a margin is created at the top of the adjusted image 320 by the user adjusting the position of the frame of the adjusted image 320 vertically within the modifiable area 330. As a variation, a margin may be created at the bottom of the adjusted image 320. For example, when taking a photo that mainly shows the coordination of clothing, it is desirable to focus on the area below the face. In such a case, it is sufficient to set the vertical width of the modifiable area 330 long below the still original image 300, and allow the user to adjust the position of the frame of the adjusted image 320 downward.

[0077] In this embodiment, the horizontal width of the modifiable area 330 is set to be the same as that of the adjusted image 320, and the vertical width is set to be longer than that of the adjusted image 320. It has been described that the user changes the position of the frame of the adjusted image 320 within the vertical range of the modifiable area 330 and fixes the position at any location. As a variation, the vertical width of the modifiable area 330 may be set to be the same as that of the adjusted image 320, and the horizontal width may be set to be longer than that of the adjusted image 320. In this case, the user may move the adjusted image 320 in the horizontal direction.

[0078] For example, when a user decorates a readjusted image 340, the user can write a message, attach a stamp, or even attach a photo image of an idol or an illustrated image of a character. As an example, suppose two users take a photo using the game image capture device 100 and edit the image in the editing booth 106. As a result, a readjusted image 340 is generated in which both users are on the right side and there is a blank space on the left side. When decorating, both users attach a photo image of the idol to the blank space on the left side. By decorating in this way, the users can create an edited image 350 in which they appear virtually together with the idol.

[0079] In the present embodiment, when photographing multiple people, a reference line is set based on the tip of the face of each user at both ends, and the center of the adjusted image 320 is determined based on this reference line. As a modified example, the reference line may be set based on the center of the face of each user at both ends (for example, the nose). Alternatively, the reference line may be set based on the center of the body of each user at both ends.

[0080] When accepting an order, the user may be able to select whether they want to set more white space in the adjusted image 320 (top, bottom, left, or right). Depending on the result of this selection, either the vertical or horizontal position within the modifiable area 330 may be fixed, and the position of the frame of the adjusted image 320 may be changed in the other direction to adjust the size of the white space. For example, suppose that the user selects, when accepting an order, to set more white space to the right of the adjusted image 320. In this case, the area designation unit 146 fixes the position in the vertical direction and sets the modifiable area 330 so that there is more room to adjust the frame position to the right. Similarly, if the user selects, when accepting an order, to set more white space to the left, the area designation unit 146 fixes the position in the vertical direction and sets the modifiable area 330 so that there is more room to adjust the frame position to the left.

[0081] The user may be able to specify the number of people to be photographed at the time of reception. Furthermore, the direction in which the larger margins are set for the adjusted image 320 (top, bottom, left, or right) may be determined depending on the number of people selected by the user. For example, assume that the information "right" is previously associated with the information that the number of people to be photographed is one. In this case, when the user selects the number of people to be photographed as "1," the region designation unit 146 sets the modifiable region 330 so that the adjustment room for the adjusted image 320 increases in the rightward direction. Similarly, when the user selects the number of people to be photographed as "2," the region designation unit 146 may set the modifiable region 330 so that the adjustment room for the adjusted image 320 increases in the leftward direction. When the user selects the number of people to be photographed as "3," the region designation unit 146 may not set any adjustment room for the adjusted image 320. In this way, the number of people selected by the user may be associated with the direction in which the larger adjustment room for the adjusted image 320 is provided.

[0082] The orientation of the subject may determine in which direction (top, bottom, left, right) more white space should be set for the adjusted image 320. The orientation of the subject may be the orientation of the user's face, body, or line of sight.

[0083] For example, if a user turns their face to the right when taking a photo, the area designation unit 146 may detect that the user's face is facing right and set the modifiable area 330 so that there is more room for adjusting the frame position to the right of the adjusted image 320.

[0084] Consider a situation in which two users are taking a photo side by side. At the time of shooting, the user standing on the left is facing left, and the user standing on the right is facing right. In this case, the region designation unit 146 detects the orientation of the users' faces and, for example, may set the modifiable region 330 to match the user on the right as a representative, so that there is more room for adjusting the frame position to the right relative to the adjusted image 320. Alternatively, since the orientations of the faces of both users are different, no adjustment room may be set for the adjusted image 320. If both users' faces are facing left (the same direction), the region designation unit 146 may set the modifiable region 330 so that there is more room for adjusting the frame position to the left (the direction they are facing) relative to the adjusted image 320.

[0085] Consider a situation in which three users are taking a photo side by side. At the time of shooting, the user standing on the left is facing left, while the users standing in the center and on the right are facing right. For example, since many of the users are facing right, the region designation unit 146 may set the modifiable region 330 so that there is more room to adjust the frame position to the right in the adjusted image 320. Typically, the region designation unit 146 may set the adjustment room for the adjusted image 320 to the right, matching the orientation of the face of the user standing in the center. Alternatively, since the three users' faces are facing different directions, no adjustment room may be set for the adjusted image 320.

[0086] Specifically, consider a situation in which two users are taking a photo side by side. During the photo shoot, both users turn their bodies to the right and pose as if they are surprised. At this time, the area designation unit 146 detects the orientation of both users' bodies and sets the modifiable area 330 so that there is more room for adjusting the frame position to the right of the adjusted image 320. After the photo shoot, the two users edit the image in the editing booth 106. The two users then create a readjusted image 340 by adding a blank space to the right. During the decoration process, the users can paste a photo image of an idol onto the readjusted image 340. During the decoration process, both users paste a photo image of the idol into the blank space on the right side of the readjusted image 340. By applying decorations in this way, both users can create an edited image 350 that looks as if they are surprised that the idol has appeared.

[0087] In this embodiment, the frame size has been described as being of two types, "for two people" and "for three or more people," but the frame size may be arbitrarily changeable. The entire still original image 300 may also be set as the modifiable area 330. That is, the adjusted image 320 and the readjusted image 340 may be arbitrarily movable within the range of the still original image 300. Alternatively, the entire still original image 300 may be treated as the modifiable area 330.

[0088] In the present embodiment, it has been described that the horizontal position of the adjusted image 320 is fixed, and then the position of the frame of the adjusted image 320 is changed vertically within the modifiable area 330 to generate the readjusted image 340. As a variation, the vertical position of the adjusted image 320 may be fixed, and then the position of the frame of the adjusted image 320 may be changed horizontally within the modifiable area 330 that has a long horizontal width to generate the readjusted image 340.

[0089] As described above, in the game image photographing device 100 of this embodiment, the photographing booth 104 (photographing space) and the editing booth 106 (editing space) are configured separately, but the photographing booth 104 and the editing booth 106 may be shared. For example, not only the photographing device 128 but also the editing device 126 may be installed in the photographing booth 104 shown in FIG. 2. After taking a photograph using the photographing device 128, the user may continue to perform editing work using the editing device 126 in the photographing booth 104.

[0090] The user may access the server 202 from the user terminal 206 by specifying a user ID and set the frame size. The server 202 registers the user ID and the frame size in association with each other. Next, when the user enters the user ID on the reception monitor 108, the server 202 notifies the game image capturing device 100 of the frame size that is associated with the user ID in advance. The game image capturing device 100 may set the frame size according to this notification.

[0091] Alternatively, the user may select the frame size after entering the photo booth 104. For example, the output unit 142 may cause the photo monitor 112 to display a screen for selecting the frame size when the user enters the photo booth 104, and allow the user to select the frame size.

[0092] In this embodiment, the region designation unit 146 detects the position of the face in the still original image 300 and automatically changes the position of the frame of the photographed image 310 so that the user's face is centered. As a result, the adjusted image 320 is generated. It has also been described that the region designation unit 146 sets the modifiable region 330, which has the same width as the adjusted image 320 but a longer height than the adjusted image 320. As a variation, the region designation unit 146 may set the modifiable region 330, within the still original image 300, so that the width is the same as the photographed image 310 but a longer height than the photographed image 310. Next, the region designation unit 146 may generate the adjusted image 320 by automatically changing the position of the frame of the photographed image 310 so that the user's face is centered. Note that the position of the modifiable region 330 is also changed in conjunction with the change in the position of the frame of the photographed image 310. In this way, the modifiable area 330 may be set to match the captured image 310, and when the adjusted image 320 is determined by moving the captured image 310, the area designation unit 146 may move the modifiable area 330 to match the adjusted image 320.

[0093] In the present embodiment, the region designation unit 146 automatically detects the position where the user's face appears near the center while changing the frame position of the captured image 310 in the vertical and horizontal directions within the range of the still original image 300, and generates the adjusted image 320. As a modified example, the region designation unit 146 may generate the adjusted image 320 so that the user's face is not located near the center in the vertical direction. That is, in the adjusted image 320, the user's face may appear above or below the center of the image. Furthermore, the position where the user's face appears in the vertical direction of the adjusted image 320 may be separately set by the user or an administrator of the game image capture device 100. Once the adjusted image 320 has been determined, the user can simply readjust the position of their face, as in the present embodiment. [Explanation of symbols]

[0094] 100 game image capturing device, 102 reception device, 104 photography booth, 106 editing booth, 108 reception monitor, 110 printing device, 112 photography monitor, 116 lighting device, 118 camera, 120 editing monitor, 122 stylus pen, 124 curtain, 126 editing device, 128 photography device, 130 user interface processing unit, 132 data processing unit, 134 communication unit, 136 data storage unit, 140 input unit, 142 output unit, 144 photography processing unit, 146 area designation unit, 148 editing processing unit, 150 reception processing unit, 152 image output unit, 200 game image capturing system, 202 server, 204 Internet, 206 user terminal, 300 still original image, 310 photographed image, 320 adjusted image, 321 left reference line, 322 Right reference line, 323 Vertical center line, 324 Top reference line, 325 Bottom reference line, 326 Horizontal center line, 330 Changeable area, 340 Readjusted image, 350 Edited image, 400 Edit screen, 410 Slider bar, 420 Slider

Claims

[Claim 1] comprising a server and a shooting device, The aforementioned imaging device is A shooting processing unit that acquires images taken by the user, When the user gives instructions to change the position of the subject and the size of the margins, the area designation unit sets the output area, which indicates the range to be output, variably in the captured image. An editing processing unit that receives editing input for the output area from the user and generates an edited image, The system includes an image output unit that outputs the edited image and the completed image generated by laying out the edited image on a base image to the server, in association with user identification information. The server is an image processing system that, when the user specifies the user identification information, outputs the edited image or the completed image associated with the user identification information to the user terminal.