Photographing device, image forming method, image forming program, and photographing system

Abstract

To provide a photographing device and a photographing system that can provide high-quality moving images.SOLUTION: A photographing device comprises: a moving image photographing unit that acquires data for moving images including at least one of first image data and second image data; a still image photographing unit that acquires data for a still image; and an image processing unit that creates edited moving images. When the first image data is included in the data for moving images, the moving image photographing unit acquires the first image data before the acquisition of the data for a still image, and when the second data is included in the data for moving images, acquires the second data after the acquisition of the data for a still image. The image processing unit acquires special image data that is generated based on at least either one of the data for a still image, the first image data, or the second image data, and displays the edited moving images that are played back in the order of the first image data, special image data, and second image data, the order of first image data and special image data, or the order of the special image data and second image data.SELECTED DRAWING: Figure 12

Description

[Technical Field]

[0001] The present invention relates to an imaging device, an image forming method, an image forming program, and an imaging system. [Background technology]

[0002] Conventionally, there are known amusement photography devices that can take a picture of a user with a camera, output the photographed image as a photo print sheet, or transmit the photographed image as electronic data to an external device via a network. Incidentally, for example, a recent amusement photography device described in Patent Document 1 is configured to provide not only still images but also moving images as electronic data in order to enhance the amusement. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-038344 Summary of the Invention [Problem to be solved by the invention]

[0004] However, there is room for improvement in the video provided by the play layer imaging device of Patent Document 1, and there has been a demand for providing video of even higher quality. The present invention has been made to solve the above problem, and aims to provide an imaging device, an image forming method, an image forming program, and an imaging system that can provide video of even higher quality. [Means for solving the problem]

[0005] The photographing device of the present invention comprises a video shooting unit that acquires data for video including at least one of first image data and second image data, a still image shooting unit that acquires data for still images, and an image processing unit that generates edited video, wherein the video shooting unit acquires the first image data before acquiring the data for still images if the data for video includes first image data, and acquires the second image data after acquiring the data for still images if the data for video includes second image data, and the image processing unit acquires special image data generated based on at least one of the data for still images, the first image data, or the second image data, and displays at least a portion of the edited video played in the order of the first image data, the special image data, and the second image data, the first image data and the special image data, or the special image data and the second image data.

[0006] The image generation method of the present invention includes the steps of acquiring at least one of first image data and second image data for a moving image and data for a still image, where if the first image data is acquired, the data for the still image is acquired after the acquisition of the first image data, and if the second image data is acquired, the second image data is acquired after the acquisition of the data for the still image; acquiring special image data generated based on at least one of the data for the still image, the first image data, or the second image data; and generating the moving image to be played in the order of the first image data, the special image data, and the second image data, the first image data and the special image data, or the special image data and the second image data.

[0007] The image generation program of the present invention causes a computer to execute the steps of acquiring at least one of first image data and second image data for a moving image and data for a still image, where if the first image data is acquired, the data for the still image is acquired after the first image data is acquired, and if the second image data is acquired, the second image data is acquired after the data for the still image is acquired; acquiring special image data generated based on at least one of the data for the still image, the first image data, or the second image data; and acquiring the moving image that is played in the order of the first image data, the special image data, and the second image data, the first image data and the special image data, or the special image data and the second image data.

[0008] The photography system of the present invention comprises a photography device and an image processing unit that generates edited moving images, wherein the photography device comprises a video shooting unit that acquires data for moving images including at least one of first image data and second image data, and a still image shooting unit that acquires data for still images, wherein the video shooting unit acquires the first image data before acquiring the data for still images if the data for moving images includes first image data, and acquires the second image data after acquiring the data for still images if the data for moving images includes second image data, and the image processing unit generates special image data based on at least one of the data for still images, the first image data, or the second image data, and generates edited moving images that are played in the order of the first image data, the special image data, and the second image data, the first image data and the special image data, or the special image data and the second image data. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide higher quality moving images. [Brief explanation of the drawings]

[0010] [Figure 1A]1 is a perspective view showing the appearance of an imaging device (without a curtain) according to an embodiment of the present invention. [Figure 1B] FIG. 1B is a perspective view showing the appearance of the imaging device of FIG. 1A (with a curtain). [Figure 2] 2 illustrates an example of a photographing unit of the photographing device of FIG. 1. [Figure 3] 2 illustrates an example of the hardware configuration of the imaging device of FIG. 1. [Figure 4] FIG. 1 is a diagram showing a flow of capturing moving images and still images by a camera. [Figure 5] 2 illustrates an example of the software configuration of the imaging device of FIG. 1. [Figure 6] This is the screen for selecting the background. [Figure 7] This is the screen for selecting the background. [Figure 8] This is the screen for selecting the background. [Figure 9] This is a screen for selecting a shooting style. [Figure 10] This is the screen for taking pictures. [Figure 11] This is the screen for taking pictures. [Figure 12] FIG. 10 is a diagram showing an example of creating game video data. [Figure 13] FIG. 10 is a diagram showing an example of creating game video data. [Figure 14] FIG. 10 is a diagram showing an example of creating game video data. [Figure 15] This is a screen for setting the number of players who will be editing graffiti in the editing game. [Figure 16] 10 is a screen showing an editing process in an editing play. [Figure 17] This is a screen for selecting a sheet layout. [Figure 18] 10 is a flowchart showing the procedure of play. [Figure 19] FIG. 10 is a diagram showing an example of playback of a game video. [Figure 20] FIG. 10 is a diagram showing an example of playback of game moving images as a collage moving image. [Figure 21] 1 is a schematic diagram showing an example of an imaging system according to the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] <1. Overview of the imaging device> The photographing device according to this embodiment will be described below. Fig. 1A is a perspective view showing a state in which a curtain 13 has been removed from photographing device 100 according to this embodiment, and Fig. 1B is a perspective view showing a state in which curtain 13 has been attached to the photographing device according to this embodiment.

[0012] 1A and 1B, the image capturing device 100 includes a rectangular parallelepiped housing 1, and entrances 11 leading to an internal image capturing space 10 are formed on both sides of the housing 1. A curtain rail 12 is attached to the upper edge of the entrance 11, and a curtain 13 is attached to the curtain rail 12. As a result, when a user takes a photograph, the curtain 13 can be closed to make the image capturing space 10 invisible from the outside and to prevent unnecessary light from entering the image capturing space 10 from the outside. In the interior of the housing 1, a photographing range, such as the side (back) opposite to the side on which a camera 32 (described later) is disposed, is colored with a single color (e.g., blue, green, etc.) for chromakey compositing. The area colored with a single color may be a part of the image capturing range or the entire area.

[0013] Inside the housing 1 (photography space 10), a photography unit 3 is provided in front of the position where the user should be when taking a photo. The photography unit 3 is configured to photograph the user in the photography space 10, accept editing of the obtained image, and print the edited image. The configuration of the photography unit 3 will be described in detail later. Note that it is also possible to configure the image editing to be performed automatically regardless of user operation, or to configure it so that editing is not performed at all.

[0014] 2. Hardware configuration of the imaging device Next, the hardware configuration of the image capturing device 100 according to this embodiment will be described with further reference to Figures 2 and 3. Figure 2 illustrates an example of the image capturing unit 3 of the image capturing device 100 according to this embodiment. Figure 3 schematically illustrates an example of the hardware configuration of the image capturing device 100.

[0015] As shown in FIG. 3, the photographing device 100 according to this embodiment includes a computer electrically connected to a control unit 5, a storage unit 6, a communication interface 7, a drive 8, a touch panel display 31, a camera 32, an illumination unit (illumination unit) 33, a speaker 34, a printer 35, and a payment processing unit 36, all of which are housed in the photographing unit 3. In FIG. 3, the communication interface is referred to as a "communication I / F." The touch panel display 31 is an example of a "display unit" of the present invention, and the camera 32 is an example of a "still image photographing unit" and a "moving image photographing unit" of the present invention.

[0016] The control unit 5 includes a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), etc., and controls each component in accordance with information processing. The storage unit 6 is an auxiliary storage device such as a hard disk drive or solid state drive, and stores various data such as a program 61 executed by the control unit 5.

[0017] The program 61 is a program for causing the photographing device 100 to execute processes for accepting a request to take a photograph, taking a photograph in response to the accepted request, editing the photographed image, and printing it, and includes the image forming program according to the present invention. In addition, the storage unit 6 stores screen data and the like used in each processing step. Details will be described later.

[0018] The communication interface 7 is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, or the like, and is an interface for performing wired or wireless communication via a network. The type of communication interface 7 may be selected appropriately depending on the installation location of the image capturing device 100, etc. The image capturing device 100 can perform data communication with an external server, etc., via the communication interface 7.

[0019] The drive 8 is, for example, a CD (Compact Disk) drive, a DVD (Digital Versatile Disk) drive, or the like, and is a device for reading a program stored in a storage medium (not shown). The type of drive 8 may be selected appropriately depending on the type of storage medium. The program 61 may be stored in the storage medium.

[0020] A storage medium is a medium that stores information such as a program electrically, magnetically, optically, mechanically, or chemically so that the information can be read by a computer or other device or machine. Examples of such storage media include CDs, DVDs, and flash memory.

[0021] The touch panel display 31 is disposed in the center of the front panel of the main body of the photographing unit 3, and a camera 32 used for taking photographs is disposed above the touch panel display 31. The control unit 5 controls photographing by the camera 32. The control unit 5 also controls the display on the touch panel display 31 and input to the touch panel display 31. The types of the touch panel display 31 and the camera 32 may be selected appropriately depending on the embodiment.

[0022] Specifically, camera 32 is configured as a known single-lens reflex camera that takes pictures under the control of control unit 5, and stores the images obtained by taking pictures in RAM or storage unit 6. In this embodiment, the position of the user is roughly determined when taking pictures, and therefore the distance between the user and camera 32 when taking pictures is roughly determined. Therefore, the focal length of camera 32 according to this embodiment is constant. However, camera 32 may also be equipped with a zoom lens, and the focal length can be adjusted by control unit 5 as necessary.

[0023] The camera 32 is capable of capturing moving images and still images. That is, when capturing moving images, light passing through the lens is converted by the imaging element into moving image data (moving image signals). The moving image data is composed of first image data (the first half) and second image data (the second half), as described below. The moving image data is stored in the RAM and memory unit 6 of the control unit 5, and the first image data is subjected to image processing for display by an image processing unit 51 (see FIG. 5), which will be described later, before being transmitted to the touch panel display 31. The moving image data is composed of a plurality of frame images, for example, with a sampling rate of 20 frames per second. The image processing unit sequentially performs left-right flipping processing on each frame image constituting the first image data, and then extracts the subject using chromakey processing and combines it with the background image. In this way, a live composite image (moving image for display) is generated and displayed on the touch panel display 31. That is, the live composite image displayed on the touch panel display 31 is a left-right flipped image, and the user can view the live composite image displayed on the touch panel display 31 as if they were looking at their own reflection in a mirror. The live composite image thus generated is stored in the storage unit 6. The stored moving image data is used to generate game moving images, as will be described later. Therefore, in this embodiment, the moving image data is used to generate the live composite image and game moving images.

[0024] On the other hand, when capturing a still image, the shutter is first closed, and then, as the shutter opens and closes, the light passing through the lens is converted by the imaging element into still image data (still image signal). The still image data is stored in the RAM and memory unit 6 of the control unit 5 and transmitted to the touch panel display 31. In this case, as with the live composite image, the still image displayed on the touch panel display 31 is subjected to left-right flipping and chromakey processing by the image processing unit 51, and then composited with the background image and stored as a composite still image. For ease of explanation, the image obtained after the composite still image has been trimmed (described later) will also be referred to as a composite still image. In addition, the still image data is used as the edited moving image described above, as printing data provided to the user, and as data transmitted to the server (described later). However, the composite still image provided to the user may not have been subjected to the left-right flipping processing described above.

[0025] It is also possible to capture still images while capturing moving images. In this case, however, because the mechanical shutter (not shown) of the camera 32 opens and closes, generation of moving image data is temporarily suspended for at least a predetermined period including the opening and closing of the shutter. This point will be explained with reference to FIG. 4. As shown in FIG. 4, when a command to start capturing moving images is sent from the control unit 5 to the camera 32, capturing of moving images begins and data for moving images is generated. Then, focus adjustment for still images is started, and upon completion of the adjustment, the mechanical shutter is opened and closed, and still image data is acquired. During this period, generation of data for moving images is suspended. Then, when capturing of still images is completed, generation of data for moving images is resumed. When a command to end capturing of moving images is sent from the control unit 5 to the camera 32, generation of data for moving images is terminated. At this time, capturing of moving images continues from the command to start capturing until the command to end capturing, and continuous data for moving images is generated. However, data is missing from this data for moving images while still images are being captured, that is, from the start of focus adjustment to near the end of still image capturing. This point will be explained in detail.

[0026] The moving image data is made up of frame images generated between a shooting start command and a shooting stop command. The generated frame images are given file names (A#a, A#a+1, A#a+2, A#a+n, A#a+n+1, ...) in chronological order and stored. The "A" in the first half of the file name indicates the shooting session among multiple shooting sessions, and the "a," "a+1," ... in the second half indicate the sequentially generated frame image. In addition, in order to determine which data point is missing, the file name (or frame image number) of the frame image generated immediately before a focus adjustment command is issued to camera 32 is stored. Of the moving image data, the frame images from the shooting start command to the reference frame image constitute first image data, and the frame images generated from the frame image next to the reference frame image to the shooting stop command constitute second image data. Depending on the type of camera with a mechanical shutter, moving image data may be generated in such a way that data is missing only while the mechanical shutter is open and closed, regardless of the focus adjustment command. In this case, in order to determine the point in time at which data is missing, a reference frame image is set based on the timing at which the mechanical shutter is released, rather than the timing of the focus adjustment command. The reference frame image corresponds to the rear image data of the present invention.

[0027] In this specification, for the sake of convenience, the first image data and the second image data to which a background image has been synthesized or which has undergone image processing will also be referred to as the first image data and the second image data.

[0028] The touch panel display 31 displays the still images and live composite images described above, as well as a guide screen showing shooting instructions, etc., based on the program 61. Each screen accepts operation inputs such as selection operations. The control unit 5 detects operation inputs (touch inputs) on each screen and performs processing according to the detected operation inputs.

[0029] The lighting unit 33 includes an upper lighting unit 331 and a lower lighting unit 332. As shown in FIG. 2, the upper lighting unit 331 has a circular cover facing the user, with multiple straight-tube LEDs arranged inside. The cover is made of a translucent material such as a milky-white acrylic plate, and light emitted from the straight-tube LEDs is irradiated through the cover toward the user's face from above and in front. Meanwhile, the lower lighting unit 332 is arranged below the touch panel display 31, around the photo print outlet 37. The lower lighting unit 332 includes a rectangular cover and multiple straight-tube LEDs arranged therein, with the cover made of the same material as the cover of the upper lighting unit 331. The lower lighting unit 332 irradiates light from below and in front of the subject. The straight-tube LEDs of each lighting unit 331 and 332 are controlled by the control unit 5, which adjusts the light emission amount to adjust the brightness in the shooting space 10 according to the stage of the user's shooting process.

[0030] The speaker 34 and printer 35 are built into the main body of the photographing unit 3. The speaker 34 outputs audio such as photographing instructions under the control of the control unit 5. The printer 35 also prints the photographed image or the edited image under the control of the control unit 5, and ejects the printed image to the outlet 37.

[0031] The payment processing unit 36 ​​is located to the right of the touch panel display 31. Although detailed illustration is omitted, the payment processing unit 36 ​​is equipped with a coin slot, a bill slot, a card reader, and a change outlet. The payment processing unit is provided with various sensors that detect the insertion of coins or bills and output an activation signal indicating the detection to the control unit 5. Furthermore, when photography is canceled or an amount of cash greater than the amount required for photography is inserted, the corresponding amount of cash is ejected into the bill slot or change outlet.

[0032] The card reader is configured to be able to read information from cards such as IC cards and credit cards. Any known card reader capable of reading information from various cards may be used as this card reader. The card reader accepts payment of fees using electronic money, credit cards, etc., and when the payment of fees is accepted, it outputs an activation signal indicating this to the control unit 5.

[0033] (others) It should be noted that, with regard to the specific hardware configuration of the image capturing device 100, components can be omitted, replaced, or added as appropriate depending on the embodiment. For example, the control unit 5 may include multiple processors. Furthermore, the image capturing device 100 may be an information processing device designed specifically for the services provided, or may be a general-purpose PC (Personal Computer) or the like.

[0034] 3. Software configuration of the imaging device Next, an example of the software configuration of the image capturing device 100 according to this embodiment will be described with reference to Fig. 5. Fig. 5 schematically illustrates an example of the software configuration of the image capturing device 100 according to this embodiment.

[0035] The control unit 5 of the photographing device 100 loads a program 61 stored in the storage unit 6 into the RAM. The control unit 5 then interprets and executes the program 61 loaded into the RAM using a CPU to control each component. As a result, as shown in FIG. 5 , the control unit 5 and other components of the photographing device 100 according to this embodiment function as software modules: an image processing unit 51 that selects a background image, processes a photographing play, controls lighting, and generates a game moving image (described later); an editing processing unit 52 that provides an editing play; and an output processing unit 53 that performs processes such as printing sheets and displaying moving images. The photographing play is a series of plays for photographing a user, as described later, and the editing play is a series of plays for editing, such as drawing on an image for editing (described later).

[0036] <3-1. Image processing section> The image processing unit 51 performs the following processing. Unless otherwise specified, the processing described below is performed by the image processing unit 51. To select a background image, a background image selection screen 6 shown in FIG. 6 is first displayed on the touch panel display 31. In this embodiment, two close-up images and two full-body images are captured, and background images for each image are selected. The upper section of the screen shown in FIG. 6 provides a background image space for the two close-up images and a background image space for the two full-body images. Hereinafter, for ease of explanation, these spaces may be referred to as first to fourth spaces 61 to 64 from left to right. Below these background image spaces 61 to 64, an "automatic" button 65 is located, and below that, a sample space 66 is provided, displaying ten candidate background images. This sample space 66 displays ten background images, and touching the right scroll button 661 or the left scroll button 662 displays the other ten candidate background images.

[0037] When the user selects (touches) one of the background images in the sample space 66, the selected background image is displayed in turn in the first to fourth spaces 61 to 64, as shown in Fig. 7. At this time, if the user touches a background image space 61 to 64 in which a background image is displayed, the selection of the background image is canceled and the background image is erased from that background image space 61 to 64. This allows the user to reselect a background image.

[0038] It is also possible to select a background image using the "Random" button 65. When the "Random" button 65 is touched when no background images are displayed in any of the background image spaces 61-64, a background image randomly selected from the sample space 66 is displayed in each of the background image spaces 61-64. At this time, the background images displayed in each of the background image spaces 61-64 are selected so that they do not overlap. In this state, when the "X" button is touched in a background image space 61-64 in which a background image is displayed or in a background image space 61-64, the selection of the background image is canceled, as described above, and the background image is deleted from that background image space 61-64. Here, for example, as shown in FIG. 8, when the background images in the second and fourth spaces 62, 64 are canceled, touching the "Random" button 65 causes two background images to be randomly selected and displayed in the canceled second and fourth spaces 62, 64, respectively. At this time, the two new background images are selected so that they do not overlap with the two background images already selected in the first and third spaces 61, 63. In this way, when the "random" button 65 is touched, new background images are selected in the number of background image spaces 61 to 64 where no background image is displayed, without overlapping, and are displayed in those background image spaces 61 to 64. Note that when all four background images are selected, when the "random" button 65 is touched, the four background images displayed in the background image spaces 61 to 64 are replaced with four other background images randomly selected from the plurality of background images excluding these four background images.

[0039] Then, when the selection of the background image is completed and the OK button 67 is touched, the process moves to the next shooting process. In other words, background images can be selected any number of times until the OK button 67 is touched. Note that even before the OK button 67 is touched, if a predetermined time has elapsed, the background image selection process may be forcibly ended. At this time, if the selection of four background images has not been completed, the background image selection unit 51 arbitrarily selects a background image. Note that if some background images have already been selected, a background image other than the selected part is arbitrarily selected.

[0040] Next, the shooting play process will be described. When a selection is made using the OK button 67 on the background image selection screen 6, the shooting process starts. First, a close-up image is shot. At this time, a style selection screen 701 for selecting the close-up image style, as shown in FIG. 9, is displayed on the touch panel display 32. As shown in FIG. 9, this style selection screen 701 displays three styles for shooting close-up images. That is, from left to right, a high style 71, a low style 72, and a multi-person style 73 are displayed. The high style 71 is a style for generating a still image including the upper body of a tall subject such as an adult. The upper portion of the captured image is trimmed, and the above-mentioned composite still image is generated based on this. The low style 72 is a style for generating a still image including the upper body of a short subject such as a child. The middle portion of the captured image is trimmed, and the above-mentioned composite still image is generated based on this. Multi-person style 73 is a style for generating a still image of, for example, three or more subjects lined up horizontally. The captured image is cropped longer from the middle to the top, and the composite still image described above is generated based on this. The aspect ratio of the cropping is the same for all styles.

[0041] When the user selects one of styles 71 to 73 and touches OK button 74, the style selection is completed and the process moves to capturing a close-up image. Note that the style can be selected any number of times until OK button 74 is touched.

[0042] The OK button 67 and OK button 74 described above, as well as the various selection confirmation buttons that will appear in the following explanations, can be hidden until the user performs the first selection operation on each screen, or hidden for a few seconds after the screen is displayed. This reduces the chance that the user will accidentally touch the selection confirmation button and confirm a selection that is not to their liking.

[0043] FIG. 10 shows a screen for preparing to take a close-up image. As shown in FIG. 10, this screen 702 for preparing to take a close-up image displays a message indicating that close-up image shooting will begin, and below that, sample poses 75 for the selected style are displayed. For example, if a low style is selected, sample poses for a family (two people) including a child are displayed, and adults are prompted by audio or other means to bend slightly when taking a photo. If a high style is selected, sample poses for adults (couples, etc.) are displayed, and if a multi-person style is selected, sample poses for three or more people including children are displayed. Also, four image capture spaces 76 are displayed below the sample poses, and the captured composite still images (two close-up images and two full-body images) are placed in these spaces 76.

[0044] The screen in FIG. 10 is displayed for a predetermined time, during which the user is prompted to confirm the sample pose 75. After the predetermined time has elapsed, the screen transitions to a close-up image capture screen 703 in FIG. 11, and moving image capture by the camera 32, i.e., acquisition of moving image data, begins. On the screen in FIG. 11, a live composite image (display moving image) 77 is generated and displayed, in which image processing is performed on the first image data, which is the first half of the acquired moving image data, and sample poses 78 are displayed on both sides of the image. Note that the sample pose 78 is the same image as the sample pose 75 in FIG. 10. In addition, the captured image space 76 described above is displayed below the live composite image 77. As described above, the live composite image 77 is obtained by performing at least the following four processes, in order from 1 to 4, on the first image data captured by the camera 32. 1. Trimming process according to the result of style selection in Figure 9 (trimming process) 2. Subject extraction using chromakey processing (subject extraction processing) 3. Composite processing with the selected background image (composite processing) 4. Mirroring by flipping left and right (mirroring process)

[0045] If you do not want to flip the design of the background image horizontally, you can perform the "horizontal flip process" in 4 before the "composite process with background image" in 3. This allows the user to pose or adjust the position so that the subject is included in the captured image while viewing the live composite image 77.

[0046] Then, after the countdown is completed, the camera 32 is driven to capture an image and acquire still image data. When the camera 32 starts focusing while it is being driven, the acquisition of moving image data is interrupted and the acquisition of the first image data is completed. This also stops the display of the live composite image 77 on the touch display 31. The acquired still image data is then trimmed in accordance with the results of the style selection, and a still image with the subject portion extracted is generated using chromakey processing. This still image is then composited with the selected background image to generate a composite still image, which is stored in the storage unit 6. This composite still image is then displayed in the area of ​​the touch display 31 where the live image 77 was displayed, as a result of the capture. The composite still image displayed as a result of the capture may be subjected to left-right flip processing similar to the live composite image 77.

[0047] After the still image data is acquired, acquisition of the moving image data is resumed, and acquisition of the second image data begins. Then, before the next shooting begins after a predetermined period, moving image shooting, i.e., acquisition of the moving image data, ends, and acquisition of the second image data is completed. The first image data and second image data are stored in storage unit 6 as moving image data.

[0048] When capturing a still image, the touch panel display 31 displays an entirely white screen (staged still image) instead of the screen shown in FIG. 11 from just before (a few milliseconds before) the shutter is released until just after the shutter is released. This allows a brighter captured image to be obtained. If a darker captured image is desired, a black screen can be displayed instead of the white screen. Also, to direct the user toward the camera 32, the touch panel display 31 can show a display such as an arrow pointing in the direction of the lens of the camera 32.

[0049] After the two close-up shots described above are taken, two full-body images are taken using the same procedure as for the close-up shots. Then, composite still images, still image data, and moving image data corresponding to each shot are generated. As with the close-up images, a shooting preparation screen similar to that of FIG. 10 is displayed on the touch panel display 31 for a predetermined period of time, and then a shooting screen similar to that of FIG. 11 is displayed, and the full-body image is taken. At this time, sample poses for the predetermined full-body image are displayed on the shooting preparation screen and shooting screen. Once the two full-body images have been taken, the process moves to output processing. Note that the composite still image generated by shooting the full-body image differs from the composite generated image from the close-up shot, and is an image cut out with a trimming range that includes the lower half of the subject's body.

[0050] Although the intensity of light emitted from the lighting unit 33 is controlled from the start to the end of play through lighting control by the image processing unit 51, the light intensity of the upper lighting unit 331 and the lower lighting unit 332 is increased from a predetermined time before a still image is captured until a predetermined time has elapsed after the still image is captured, so that the still image can be captured appropriately. The time for which the light intensity of each lighting unit 331, 332 is increased can be changed as appropriate, but can be, for example, the time from when a command to start acquiring moving image data is issued to when a command to end acquisition is issued.

[0051] Next, the process of generating game moving images by the image processing unit 51 will be described. The image processing unit 51 has the function of generating moving images using moving image data and still image data stored in the storage unit 6. To distinguish this moving image from the above-mentioned live composite moving image 77, it will be called a game moving image (edited moving image), and the data for this game moving image will be called game moving image data. The provision of this game moving image is a surprise service for the user, and is performed without notifying the user that a game moving image is being generated.

[0052] The game moving image is generated using at least one of the four shots described above. For example, the game moving image is generated during the first close-up shot. As described above, the image processing unit 51 issues a command to the camera 32 to start acquiring moving image data a predetermined time before capturing a still image, and issues a command to the camera 32 to end acquisition a predetermined time after capturing the still image (see FIG. 4), as explained in the description of the live composite image 77. This generates moving image data including the first image data and second image data described above and stores it in the storage unit 6. The image processing unit 51 then trims each frame image constituting this moving image data based on the style selected on the style selection screen 701 described above. At this time, the trimming applied to the moving image data is performed so as to match the trimming applied to the composite still image, thereby preventing unnaturalness when the moving image data and still image data are combined, as will be described later. Chromakey processing is also performed on each frame image to extract only the subject, and a background image is then combined with this. The background image to be synthesized at this time is different from the background image selected by the processing by the background image selection unit 51 described above, and is a background image arbitrarily selected by the image processing unit 51. For ease of explanation, the moving image data, first image data, and second image data obtained after the frame images have been subjected to trimming processing, chromakey processing, and background image synthesis will also be referred to as moving image data, first image data, and second image data, respectively.

[0053] Next, the image processing unit 51 inserts special image data between the first image data and the second image data, i.e., after the last reference frame image of the first image data, and generates game video data in which the first image data, special image data, and second image data are played in that order. In other words, as described above, the special image data is video data generated to fill in the time period in which images are missing. There are various methods for generating special image data, but three methods will be shown below as examples.

[0054] In the first method, as shown in FIG. 12, still image data of a subject generated between the first image data and the second image data is used as special image data. More specifically, the image processing unit 51 first trims the still image data based on the style selected on the style selection screen 701. Then, using chromakey processing, the subject is extracted from the trimmed still image data, and composite image data is generated by combining this with a background image different from that selected by the user, as with the moving image data. Finally, one frame of composite image data is used as one frame, and multiple frames of this composite image data are connected to generate special image data that form a moving image of several frames. The number of frames generated here is not particularly limited; for example, the number of frames can be determined based on the time during which images are missing, or it can be longer or shorter than that time. By incorporating the special image data generated in this way between the first image data and the second image data, game moving image data is generated and stored in the storage unit 6.

[0055] The second method uses the first frame image of the second image data, i.e., the frame image (front image data) following the reference frame image. More specifically, as shown in FIG. 13, this frame image is treated as one frame, and multiple frames of special image data are connected to generate a moving image of several frames. The number of frames is determined in the same manner as in the first method. By incorporating the special image data thus generated between the first image data and the second image data, game moving image data is generated. Note that the special image data can also be generated using the last reference frame image (rear image data) of the first image data instead of the first frame image of the second image data. However, in cameras where data loss occurs after a focus adjustment command is issued as described above, since the generation of the first image data occurs before the capture of a still image, and the subject often moves, such as by posing, it is preferable to use the second image data immediately after the pose is decided during the capture. On the other hand, in cameras where data loss occurs while the shutter is open and closed, there is no significant difference between using the first image data and the second image data. Furthermore, special image data can be generated not only using the last frame image (reference frame image) of the first image data or the first frame image of the second image data, but also using, for example, the last few frame images of the first image data (corresponding to rear image data) or the first few frame images of the second image data (corresponding to front image data).Face detection can also be used to select frame images in which the subject is facing further forward from the frame images of the first image data and the second image data.

[0056] As a third method, as shown in FIG. 14, special image data can be generated by machine learning using a neural network or the like using the last frame image of the first image data and the first frame image of the second image data. For example, a learning device trained by backpropagation is generated using training data in which the two frame images are input data and the special image data is output data. A predetermined time is formed between the first image data and the second image data, and the subject appearing in the last frame image of the first image data may be different from the subject appearing in the first frame image of the second image data. Therefore, the output data included in the training data can be multiple frame images that include the movement of the subject between the two frame images. In this way, by incorporating the special image data output from the learning device between the first image data and the second image data, game video data is generated.

[0057] It should be noted that further image processing can be applied to the special image data. For example, by inserting a white frame image at the beginning or middle of the special image data, it is possible to create the effect of a strobe flashing in the middle of the game moving image. In addition, various image processing for effects can be applied to the special image data. For example, the color of the first, middle, and / or last few frames of the part of the game moving image corresponding to the special image data can be changed, or image processing can be performed on the special image data to create effects such as slide-in, fade-in, or turn. Similar image processing can also be applied to the first image data and the second image data.

[0058] The game moving image data generated in this way is used in the output process described below. Game moving image data can also be generated using the above-mentioned live composite image. In this case, the live composite image corresponds to the first image data. As described above, the live composite image has undergone trimming processing, subject extraction processing, composition processing, and mirroring processing, so the special image data and second image data used are also subjected to these four processes. This makes it possible to generate game moving images that are flipped left and right. Since the game moving image that has been flipped left and right is a reflection of yourself in a mirror, it is possible to provide a moving image of yourself that you are accustomed to seeing.

[0059] <3-2. Editing Processing Unit> Next, the edit processing unit 52 will be described. The edit processing unit 54 displays a screen for selecting the number of people to be edited on the touch panel display 31, as shown in Fig. 15. On this screen, the user selects whether the number of people to be edited is one or two. If the number of people to be edited is two, the edit screen of Fig. 16 is displayed on the touch panel display 31, and if the number of people to be edited is one, a screen showing only one edit screen (not shown) is displayed.

[0060] The screen shown in FIG. 16 is a screen for editing a composite still image generated by the image processing unit 51, and has a stamp list 804 in the center, displaying multiple stamps for editing. On either side of the stamp list, composite still images 805 are displayed. These are identical. The composite still image displayed here is one of the four composite still images created, but it may also be selectable. A countdown display indicating the time remaining until editing is complete is also displayed below the stamp list. Furthermore, multiple color pens 806 for editing are displayed below each composite still image 805.

[0061] Editing of the composite still image 805 is performed, for example, as follows: When the user touches any stamp to select it, and then touches any position on the composite still image 805, the selected stamp is displayed at the touched position. Then, each time the composite still image 805 is touched, the stamp currently selected is displayed on the composite still image 805 until another stamp is selected or a color pen 806, which will be described later, is selected.

[0062] Furthermore, when one of the color pens 806 is touched and selected, the pen color is set, and in that state, when a line or letter is drawn with a finger on the composite still image 805, the line or letter of the selected color is displayed on the composite still image 805. Then, until a stamp is selected or a color pen 806 of a different color is selected, each time a line is drawn with a finger on the composite still image 805, the line of the color selected at that time is displayed on the composite still image 805.

[0063] By the above-described processing of the editing processing unit 54, the user can carry out the editing process until the countdown display reaches 0. Then, when the countdown display reaches 0, the editing processing unit 54 ends the editing process and stores the edited image obtained after editing has been applied to the composite still image as edited image data in the storage unit 6. Next, output processing is performed by the output processing unit 55, which will be described next.

[0064] <3-3. Output processing section> The output processing unit 55 displays a sample of the sheet on which the output image will be printed. As described above, when editing is performed by two people, multiple sheet designs 809 are displayed as shown in FIG. 17, and the user can touch one to select it. Note that the sheet design can be reselected any number of times until the OK button is touched or a predetermined time has passed. Each sheet design has multiple generated edited images or composite still images arranged on it, and the sheet design, image layout, image contours, position, etc. are different.

[0065] Once the sheet is determined in this way, the output processing unit 55 causes the printer to print the sheet. From the time preparation for printing the sheet begins until the sheet is discharged from the outlet 37, the output processing unit 55 displays the game moving image on the touch display 31.

[0066] The output processing unit 55 can also output at least one of the generated still image data, edited image data, image data of a sheet on which an image is arranged, and game moving image data. In this case, these data can be sent directly to the user's mobile terminal, or can be sent to an external server, from which the user can obtain the data via the Internet.

[0067] In this embodiment, an example is described in which each software module of the image capturing device 100 is implemented by a general-purpose CPU. However, some or all of the above software modules may be implemented by one or more dedicated hardware processors. Furthermore, with regard to the software configuration of the image capturing device 100, functions may be omitted, replaced, or added as appropriate depending on the embodiment.

[0068] <4. Example of operation of the imaging device> Next, an example of the operation of the image capturing device 100 according to this embodiment will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the play procedure.

[0069] After the settlement process is completed, the screen shown in Fig. 6 is displayed on the touch panel display 31, and a background image is selected (step S11). Once the background image is selected, the screen shown in Fig. 9 is displayed, and a shooting style is selected (step S12). Next, the screens shown in Figs. 10 and 11 are displayed in sequence, and close-up images and full-body images are taken (step S13). While this shooting is taking place, game moving images are generated in parallel.

[0070] When the shooting is completed in this manner, the number of people to be edited is selected on the screen shown in FIG. 15, and then the editing screen shown in FIG. 16 is displayed on the touch panel display, prompting the user to edit the image for editing (step S14). When editing is completed, the screen shown in FIG. 17 is displayed on the touch panel display, prompting the user to select the layout of the sheet (step S15). Once the layout of the sheet has been determined in this manner, the output processing unit 55 starts printing the sheet (step S16). While printing is in progress, at least a portion of the game moving image generated by the image processing unit 51 (including thumbnails of the game moving image, images and text for notifying the user of the existence of the game moving image, etc.) is played on the touch panel display 31, for example, as shown in FIG. 19 (step S17). At this time, the user may also be notified of the existence of the game moving image by audio from the speaker 34. When printing is completed, the sheet is ejected from the outlet 37, and a message indicating that printing has been completed is displayed on the touch panel display 31 (step S18).

[0071] <5. Features> As described above, according to this embodiment, the following effects can be obtained. (1) In this photographing device 100, a game moving image is generated while the photographing process is being performed, and this game moving image is played back on the touch panel display 31 while the sheet is being printed. The user is not notified that a game moving image is being photographed, so this can be a surprise service for the user. In particular, the background image used in the game moving image is different from the background image used in the composite still image, so the background image of the created moving image is also one that the user has never seen before. This can further emphasize that this game moving image is a surprise service. However, the background image of the game moving image can also be a background image selected by the user.

[0072] (2) Because the camera 32 used in this embodiment is a single-lens reflex camera, attempting to generate still image data while generating moving image data results in a gap in the moving image data, as described above. That is, a predetermined period of time is gapped between the first image data and the second image data. In contrast, in this embodiment, special image data generated based on at least one of the still image data, the first image data, and the second image data is inserted between the first image data before the still image capture process is performed and the second image data after the still image capture is completed, generating a game moving image that is played in the order of the first image data, the special image data, and the second image data. Therefore, the moving image that should be inserted between the first image data and the second image data is supplemented by the special image data, thereby providing a smooth moving image.

[0073] (3) When capturing a still image, LED lighting is used instead of a strobe, so that first image data and second image data can be generated that are free from the glare of the strobe.

[0074] <6. Variations> Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment and various modifications are possible without departing from the spirit of the present invention. The following modified examples can be combined as appropriate.

[0075] <6.1> The screen displayed on the touch panel display 31 shown in the above embodiment is an example, and the screen layout and displayed content can be changed as appropriate. In addition, stamps and color pens are provided for editing, but other editing tools can also be provided as appropriate.

[0076] <6.2> In addition to the number of background images, editing stamps, and color pens, various restrictions can be set, such as editing time, the number of photos taken, and the layout of selectable sheets. Also, editing play is not necessarily required, and output processing can be performed after the shooting process.

[0077] <6.3> In the above embodiment, the game moving images are played back and notified during the output process, but this is not limitative, and they can also be played back and notified during the shooting process or the editing process.

[0078] <6.4> As in the above embodiment, instead of playing one type of game moving image, multiple game moving images may be played on one screen. In the above embodiment, four shots are taken, so four types of game moving images are generated. These four types of moving images can be displayed and played side by side.

[0079] Furthermore, a video collage can be displayed on the touch display 31. For example, as shown in FIG. 20, a screen having windows for playing multiple game videos can be generated. In this case, (1) the shapes of the multiple windows and (2) the video played in each window can be changed as appropriate. For example, a screen can be configured so that the video played in each window is the same, but at least one of the multiple windows has a different shape. Alternatively, a screen can be configured so that the windows have the same shape, but at least one different video is played. Specifically, in the above embodiment, four still images were captured, so four different game videos can be generated. These four different game videos can be synthesized with a predetermined video template to generate a new game video, or multiple game videos of one of the four types can be synthesized with a predetermined video template to generate a new game video.

[0080] <6.5> In the above embodiment, the still image data and the moving image data are generated by one camera 32, but they can also be generated by different cameras. That is, two cameras can be provided. Also, cameras other than single-lens reflex cameras can be used, such as mirrorless single-lens reflex cameras and web cameras.

[0081] In addition, using a webcam, mirrorless camera, or two cameras allows for capturing moving images while capturing still images, thereby preventing data loss between the first image data and the second image data. In other words, a series of moving image data is generated without any particular distinction between the first image data and the second image data. However, even in such cases, special image data can be generated and inserted between the first image data and the second image data to generate moving image data. Generally, still image data has a higher pixel count than moving image data, resulting in higher image quality. For example, image quality can be maintained even after cropping. Therefore, still image data can be subjected to various types of image processing compared to moving image data. Therefore, using special image data based on such high-quality still images that can be subjected to various types of image processing can improve the quality of game moving images.

[0082] <6.6> In the above embodiment, the lighting unit 33 has a built-in LED, but a lighting unit with a built-in strobe can also be used. In this case, there is a risk that the light from the strobe will be reflected in the moving image when shooting a still image. However, by generating the first image data and the second image data before and after the light emission time period when the light from the strobe may be reflected, and generating special image data corresponding to this light emission time period as described above, moving image data that does not reflect the light from the strobe can be generated. Note that the time period when the strobe emits light is the timing when the shutter is released to shoot a still image, so if a camera with a shutter is used, the moving image data at this time will be lost.

[0083] Therefore, in the present invention, moving image data that can suppress strong light reflections can be generated regardless of the type of lighting. The light source in the lighting unit 33 can be at least one of the above-mentioned LED and strobe, incandescent lamp, HID, mercury lamp, etc., for photography and other normal lighting purposes.

[0084] <6.7> The image capturing device 100 according to the above embodiment has a generally closed image capturing space 10, but the image capturing device 100 can be configured to be open to the outside by only using an image capturing unit 3 provided with a touch panel display 31, a camera 32, a lighting unit 33, a speaker 34, a printer 35, and a payment processing unit 36. In this case, since there is no curtain for chromakey processing, the indoor or outdoor scenery where the image capturing device 100 is placed spreads out behind the user.

[0085] Even with this type of imaging device 100, it is necessary to extract only the subject from the captured image to generate a composite still image, a game video, or a live composite video composited with a background image. However, since there is no curtain for chromakey processing, for example, when the imaging device 100 is installed outdoors, indoor or outdoor scenery, as well as passersby other than the subject, may appear behind the subject in the captured image. Therefore, known image processing must be performed on the captured image to remove these. In this case, the subject and passersby differ in the orientation of their faces relative to the camera 32, their facial size, and their distance from the camera 32. Based on these differences, the subject and passersby can be distinguished and only the subject can be extracted from the captured image. In this case, the distance from the camera 32 can be calculated by calculating the depth of field or by installing a device such as a distance image sensor or infrared sensor. Furthermore, by drawing a frame on the ground where the imaging device 100 is installed, the range of the user's standing position relative to the imaging unit 3 can be limited, thereby more accurately distinguishing between the subject and passersby. Furthermore, the extraction of the subject from the captured image can also be performed using machine learning.

[0086] In this way, even with the imaging device 100 that opens the imaging space 10 to the outside and does not perform imaging in a crowded space, it is possible to generate still image data and moving image data that combine the subject and background image.

[0087] <6.8> In the above embodiment, input is made to the touch panel display 31 by touch operation with a finger, but input can also be made by, for example, an electronic pen. Alternatively, input can also be made by providing an input unit such as a physical button.

[0088] <6.9> In the above embodiment, the photographed image and the background image are composited, but other than the background image, a foreground image may also be used, as long as it is an image that decorates the photographed image. Also, in the editing play, the composite editing image is edited, but this is not limited to this, and editing may be performed on a photographed image that has not been composited, or an image that has been slightly processed by trimming or the like.

[0089] <6.10> In the above embodiment, all of the above-described processing is performed by the image capture device 100, but this is not limiting. For example, FIG. 21 shows an image capture system including the image capture device 100 described in the above embodiment. The image capture device 100 can be connected to an image providing server 200 and a user's mobile terminal 300 via a network 400 such as the Internet. For example, the image capture device 32 mainly performs processing related to capturing an image of a subject and displaying the image on the touch panel display 31 (at least processing performed by the video capture unit and still image capture unit of the present invention), while other processing (e.g., part of the image processing unit 51 described above, such as generating video images for gameplay) can be performed by at least one of the image providing server 200 and the user's mobile terminal 300. When using the user's mobile terminal 300, for example, a dedicated application can be installed in advance, and the other processing described above can be performed by this application. In the above-described case, the image processing unit of the image capture system according to the present invention is included in at least one of the image providing server 200 and the mobile terminal 300.

[0090] For example, all data for generating a game moving image, including the first image data, the second image data, the data for still images, the background image, and the data that forms the base of the collage, are received from the imaging device 100, and the game moving image data is created in the image providing server 200 or the mobile terminal 300. In this case, if the first image data, the second image data, and the data for still images have not been subjected to chromakey processing, it is necessary to further receive chromakey information (mask image) and information indicating the trimming range. Then, the image providing server 200 and the mobile terminal 300 perform image processing such as chromakey processing, background image composition, and trimming to generate a game moving image.

[0091] Alternatively, the background image and the data that will be the base of the collage are stored in advance in the image providing server 200 or the mobile terminal 300, and the first image data, the second image data, and the data for the still image are received from the photographing device 100. Then, based on the received data, the server 200 or the mobile terminal 300 generates a moving image for play.

[0092] <6.11> When generating game videos, in order to shorten playback time, it is possible to use only part of the first image data and the second image data rather than all of them. In this case, in order to prevent the subject of the game video from moving unnaturally at the joints between the first image data, the second image data, and the special image data, it is preferable to generate the game video without using the first half of the first image data and / or the second half of the second image data. It is also possible to use the first image data and the second image data with some of the image data thinned out at certain intervals. By doing so, it is possible to create videos with a lower frame rate, and to create interesting videos in which the subject moves jerkily. Such partially thinned first image data and second image data are also referred to as first image data and second image data, respectively.

[0093] <6.12> In the above description, first image data, special image data, and second image data are used to generate game video data, but it is also possible to generate game video data without using all three of these data, for example, by playing the first image data and special image data in that order, or by playing the special image data and second image data in that order. From this perspective, therefore, the video data of the present invention only needs to include at least one of the first image data and the second image data. Therefore, the camera 32 (at least a part of the video acquisition unit of the present invention) can also acquire, for example, only the first image data or only the second image data.

[0094] <6.13> In the above embodiment, the user is allowed to select the trimming range for the composite still image, live composite video, and game video, but it is also possible to determine this automatically. For example, video shooting can be started before the first image data is acquired, and the video can be used to analyze the number and composition (height, age, gender) of users, and the trimming range can be set for each shoot according to the results.

[0095] <6.14> It is also possible to apply additional image processing to the composite still images, live composite moving images, and game moving images, such as facial image processing (eye enlargement, face slimming, etc.), image processing to make the skin look beautiful, image processing to make the legs look longer, etc. These image processing processes may be selected by the user, or predetermined ones may be applied.

[0096] <6.15> Deepfake videos can also be created using video data and / or still image data (original data) and provided as game videos. Specifically, the original data is used to detect the characteristics of each user contained in the original data (e.g., facial expressions of joy, anger, sadness, and happiness, age, gender, nationality, etc.), and deepfake videos are generated by replacing the user's face with the face of a model in a pre-prepared video template to match that of the model. If there are multiple users, the model in the video template to which each user's face will be combined is determined based on the user's age, gender, nationality, etc. In the case of facilities such as amusement parks, videos of parades of characters and cast members (performers, etc.) can be prepared as video templates, and game videos can be created in which the cast members' faces are replaced with the user's face. Note that to improve the accuracy of deepfake videos, dedicated filming can be performed. [Explanation of symbols]

[0097] 31...Touch panel display (display unit) 32...Camera (still image capture unit, moving image capture unit) 51...Image processing unit

Claims

1. a moving image capturing unit that acquires moving image data including first image data showing a subject; a still image capturing unit that acquires data for a still image in which the subject is captured after acquiring the first image data; an image processing unit that generates an edited video; Equipped with The image processing unit Acquire special image data generated based on the still image data; displaying at least a portion of the edited video, which is played back in the order of the first image data and the special image data; a background image different from the background image selected by the user is composited with the edited moving image; Filming equipment.

2. a moving image capturing unit that acquires moving image data including first image data and second image data in which a subject is captured; a still image capturing unit for acquiring still image data in which the subject is captured; an image processing unit that generates an edited video; Equipped with the moving image capturing unit acquires moving image data in the order of the first image data and the second image data; the still image capturing unit acquires the still image data after acquiring the first image data and before acquiring the second image data; The image processing unit Acquire special image data generated based on the still image data; displaying at least a portion of the edited moving image reproduced in the order of the first image data, the special image data, and the second image data; a background image different from the background image selected by the user is composited with the edited moving image; Filming equipment.

3. Further comprising a display unit, 3. The photographing device according to claim 1, wherein a countdown for photographing is displayed on the display unit when the still image data is acquired.

4. further comprising an illumination unit that irradiates the subject with light; the image processing unit controls the illumination unit to continuously output light having a predetermined brightness or higher at least while the moving image data is being acquired.

4. The imaging device according to claim 1.

5. Further comprising a display unit, The image processing unit displaying a display moving image based on at least the moving image data on the display unit as a live moving image showing a subject; At the timing when the still image data is acquired, a staged still image or staged video to which a predetermined staged effect has been applied is displayed on the display unit instead of the display video.

5. The imaging device according to claim 1.

6. acquiring first image data for a moving image including a subject; acquiring still image data containing a subject after acquiring the first image data; acquiring special image data generated based on the still image data; generating a moving image in which the first image data and the special image data are played in this order, and a background image different from the background image selected by the user is synthesized; An image generation method comprising:

7. acquiring first image data for a moving image including a subject; acquiring data for a still image including a subject after acquiring the first image data; acquiring second image data for a moving image including the subject after acquiring the still image data; acquiring special image data generated based on the still image data; generating a moving image in which the first image data, the special image data, and the second image data are played in this order, and a background image different from the background image selected by the user is synthesized; An image generation method comprising:

8. On the computer, acquiring first image data for a moving image including a subject; acquiring data for a still image including a subject after acquiring the first image data; acquiring special image data generated based on the still image data; generating a moving image in which the first image data and the special image data are played in this order, and a background image different from the background image selected by the user is synthesized; An image generation program that executes the following.

9. On the computer, acquiring first image data for a moving image including a subject; acquiring still image data containing a subject after acquiring the first image data; acquiring second image data for a moving image including the subject after acquiring the still image data; acquiring special image data generated based on the still image data; generating a moving image in which the first image data, the special image data, and the second image data are played in this order, and a background image different from the background image selected by the user is synthesized; An image generation program that executes the following.

Images