Display system, display method, and display program

Abstract

To provide a display system, a display method and a display program, capable of imparting a subject to be photographed a realistic photographing experience as if the subject is being photographed in a same space with a person or a character, etc.SOLUTION: In a display system 1, a processing unit 40 includes: a storage part 43 configured to store material dynamic images generated so that a material to be synthesized around a subject to be photographed enter around the subject while avoiding a display position of the subject in advance; and an operation part 42 configured to, in response to a command inputted from an input part 22 of a display device 20, extract a selected material dynamic image from the storage part 41, and synthesize the selected material dynamic image to a photographed dynamic image inputted from an imaging device, so as to generate a synthetic dynamic image in which the material enters around the subject and output to a display part 21 of the display device 20.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a display system, a display method, and a display program. [Background technology]

[0002] Conventionally, composite images have been generated by combining images of people, characters, backgrounds, etc. with images taken with an imaging device such as a digital camera or a camera-equipped smartphone (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-036312 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, there has been a demand for services that provide a realistic photography experience to the person being photographed, as if they were photographed in the same space as other people, characters, etc. However, the composite images described above do not provide a sufficient photography experience. The present disclosure has been made in consideration of such problems, and its purpose is to provide a display system, a display method, and a display program that allow the person being photographed to have a realistic photography experience as if they were being photographed in the same space as other people, characters, etc. [Means for solving the problem]

[0005] In order to solve the above problem, a display system according to one aspect of the present disclosure includes a display device, an imaging device that generates captured moving images of a person being photographed, an input device to which instructions are input, and a processing device that generates a composite moving image by compositing the captured moving images with material moving images that are moving images of materials to be composited around the person being photographed. In the display system according to one aspect of the present disclosure, the processing device includes a memory unit that stores material moving images that have been generated in advance so that the materials to be composited around the person being photographed will fit around the person being photographed while avoiding the display position of the person being photographed, and a calculation unit that extracts material moving images from the memory unit that have been selected in response to instructions input from the input device, composites the selected material moving images with the captured moving images input from the imaging device, generates a composite moving image in which the materials fit around the person being photographed, and outputs the composite moving image to the display device, and the display device displays the composite moving image.

[0006] A display method of a display system according to one aspect of the present disclosure generates a plurality of material videos that have been captured in advance so that the material to be composited around a person being photographed is captured around the person being photographed while avoiding the position of the person being photographed, generates a captured video of the person being photographed, extracts the selected material videos in response to an operation instruction to select the material to be composited around the person being photographed, composites the extracted material videos with the captured video to generate a composite video in which the material is composited around the person being photographed, outputs the composite video to a display device, and saves at least one of the composite video and a still image extracted from the composite video at a predetermined timing.

[0007] A display program for a display system according to one aspect of the present disclosure causes a computer to perform the following operations: generate a plurality of material videos that have been captured in advance so that the material to be composited around the subject avoids the subject's position and surrounds the subject; generate a captured video of the subject; extract selected material videos in response to operational instructions for selecting the material to be composited around the subject; composite the extracted material videos with the captured video to generate a composite video in which the material surrounds the subject; output the composite video to a display device; and save at least one of the composite video and still images extracted from the composite video at a predetermined timing. [Effects of the Invention]

[0008] According to an aspect of the present disclosure, a display system, a display method, and a display program are provided that provide a person being photographed with a realistic photography experience, as if the person being photographed and the material to be composited were being photographed in the same space. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram illustrating a configuration example of a display system according to a first embodiment of the present disclosure. [Figure 2] 1 is a block diagram illustrating a configuration example of a display system according to a first embodiment of the present disclosure. [Figure 3] FIG. 2 is a schematic diagram showing a material video for synthesis stored in advance in the display system according to the first embodiment of the present disclosure. [Figure 4] 3 is a schematic diagram showing the contents of a composition material video stored in advance in the display system according to the first embodiment of the present disclosure. FIG. [Figure 5] 3 is a schematic diagram showing the contents of a composition material video stored in advance in the display system according to the first embodiment of the present disclosure. FIG. [Figure 6] 3 is a schematic diagram showing the contents of a composition material video stored in advance in the display system according to the first embodiment of the present disclosure. FIG. [Figure 7A] FIG. 2 is a schematic diagram showing an example of a still image captured by the display system according to the first embodiment of the present disclosure. [Figure 7B] FIG. 2 is a schematic diagram showing an example of a still image captured by the display system according to the first embodiment of the present disclosure. [Figure 7C] FIG. 2 is a schematic diagram showing an example of a still image captured by the display system according to the first embodiment of the present disclosure. [Figure 8A] FIG. 2 is a schematic diagram showing the flow of a display method in the display system according to the first embodiment of the present disclosure. [Figure 8B] FIG. 2 is a schematic diagram showing the flow of a display method in the display system according to the first embodiment of the present disclosure. [Figure 8C] FIG. 2 is a schematic diagram showing the flow of a display method in the display system according to the first embodiment of the present disclosure. [Figure 8D] FIG. 2 is a schematic diagram showing the flow of a display method in the display system according to the first embodiment of the present disclosure. [Figure 8E] FIG. 2 is a schematic diagram showing the flow of a display method in the display system according to the first embodiment of the present disclosure. [Figure 8F] FIG. 2 is a schematic diagram showing the flow of a display method in the display system according to the first embodiment of the present disclosure. [Figure 8G] FIG. 2 is a schematic diagram showing the flow of a display method in the display system according to the first embodiment of the present disclosure. [Figure 8H] FIG. 2 is a schematic diagram showing the flow of a display method in the display system according to the first embodiment of the present disclosure. [Figure 9] 1 is a flowchart showing a configuration example of a display system according to a first embodiment of the present disclosure. [Figure 10] FIG. 10 is a block diagram showing a configuration example of a display system according to a second embodiment of the present disclosure. [Figure 11] FIG. 10 is a block diagram showing a configuration example of a display system according to a third embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0010] The present disclosure will be described below through embodiments, but the following embodiments do not limit the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention. Furthermore, the drawings are merely schematic illustrations of the invention according to the claims, and the configuration of each part may differ from the actual one.

[0011] 1. First embodiment (1.1) Basic configuration of the display system The structure of a display system 1 according to a first embodiment will be described below with reference to Figs. 1 to 9. First, the basic configuration and functions of each unit of the display system 1 will be described with reference to Figs. 1 and 2. Fig. 1 is an external view showing an example of the configuration of the display system 1. Fig. 2 is a block diagram showing an example of the configuration of the display system 1.

[0012] In this embodiment, the display system 1, as an example, captures a still image of the person being photographed together with three people selected by the person being photographed, and generates and displays a composite moving image in which the three people surround the person being photographed during the photographing process, thereby providing the person being photographed with a realistic photographing experience as if they were in the same space as the three people. The configuration of the display system 1 is not limited to this, and the material moving images that are composited around the person being photographed may be effect moving images related to characters or events such as toasting with beer or fireworks, and the number of materials to be composited is not limited to three people (three).

[0013] As shown in Figure 2, the display system 1 includes an imaging device 10 capable of capturing moving images of a subject, a display device 20 that displays a composite moving image obtained by combining the captured moving image captured by the imaging device 10 with a material moving image, an audio output unit 30, and a processing device 40 that performs processing to generate the composite moving image. Here, the display system 1 may be configured to include an image storage unit 43 as shown in FIG. 2, and may be configured to be connected to an external server (not shown) that includes an image storage unit, for example. The imaging device 10, the display device 20, the audio output unit 30, and the processing device 40 will be described below.

[0014] <Imaging device> The imaging device 10 is a light-receiving device that has the function of detecting a two-dimensional image on an imaging surface (on a CCD array surface) by capturing an image, and is, for example, a camera having an imaging element such as a CCD. The imaging device 10 is placed so as to face the same direction as the display surface of the display device 20, and generates moving images (hereinafter sometimes referred to as captured moving images) and still images of a person to be photographed standing in front of the display device 20. The imaging device 10 may be provided in any position as long as it can capture an image of a person to be photographed standing in front of the display device 20, and may be provided integrally with the display device 20. The moving images captured by the imaging device 10 are transmitted to the display device 20 in real time via the processing device 40 and displayed thereon. Also, the still images captured by the imaging device 10 are transmitted to the display device 20 via the processing device 40 and displayed thereon, or transmitted to an external server and stored thereon.

[0015] <Display device> The display device 20 displays moving images and still images captured by the imaging device 10. The display device 20 only needs to have a display function, and may be a touch panel having both a display function and an input function. The display device 20 may also have an audio output function. In this embodiment, the display device 20 is a touch panel having a display function, an input function, and an audio output function, but the display system 1 of the present disclosure is not limited to this configuration. That is, the display system 1 may include at least one of an input unit (such as a keyboard or a mouse) and an audio output unit (such as a speaker) that are provided separately from the display device 20. The display unit 21 of the display device 20 may display the moving images captured by the imaging device 10 in real time, or may display a composite moving image in which the captured moving images are combined with material moving images that serve as composite materials such as people and characters. The display device 20 may also display a composite moving image in which instruction information such as letters, figures, patterns, etc. that indicate instructions or precautions for the person being photographed are combined with the moving images.

[0016] (Input section) The input unit 22 of the display device 20 is, for example, an input function unit of a touch panel, and receives operation instructions corresponding to the positions of images, characters, etc. displayed on the display device 20 and the position pressed by the user. The input unit 22 transmits the input operation instructions to the processing device 40. When the input unit 22 is provided separately from the display device 20, the input unit 22 is configured by a keyboard, a mouse, buttons, a cross key, a remote control, or the like.

[0017] <Audio output section> The audio output unit 30 may output audio corresponding to the composite video. The audio output from the audio output unit 30 may be, for example, voices or sounds in the material video to be composited with the captured video (people's voices, characters' lines, fireworks sounds, etc.), audio indicating the movement of the material (character entrance sounds and movement sounds), etc. The audio output from the audio output unit 30 may also be, for example, operation instructions or a countdown sound ("3, 2, 1") indicating the timing to capture a still image.

[0018] <Processing equipment> The processing device 40 has a function of synthesizing a captured moving image with a material moving image, which is a moving image of a material to be synthesized around the subject, to generate a composite moving image. For example, the processing device 40 displays on the display device 20 a plurality of candidate materials that can be combined with the captured moving image, and allows the operator of the display system 1 (for example, the person being photographed or the administrator of the display system 1) to select a predetermined number of materials that they would like to capture as still images together. For example, the processing device 40 displays on the display device 20 photos of five people (persons A to E) that can be combined with the captured moving image. For example, the operator of the display system 1 selects and inputs, via the input unit 22, photos of three people (person A, person B, and person C) that they would like to photograph together from the photos of people A to E. As a result, the input unit 22 accepts an operation instruction in which person A, person B, and person C are selected and input in this order, and transmits the operation instruction to the processing device 40.

[0019] [Storage] The storage unit 41 stores material moving images to be composited into the captured moving images. The material moving images are, for example, people, characters, or effects that correspond to the installation environment (fireworks effects at a fireworks festival venue). The storage unit 41 stores material moving images that have been generated in advance so that the material to be composited around the subject avoids the subject's display position and blends in around the subject. This makes it possible to generate a realistic composite moving image in which the people and characters composited around the subject appear to exist in the same space as the subject and appear to have entered the screen without interfering with the subject.

[0020] The storage unit 41 also stores at least one material video, and if there are multiple materials, it stores multiple material videos for each material in the order of selection. For example, if the materials are person A, person B, and person C, the storage unit 41 stores multiple material videos in the order of selection of persons A to C. When there are multiple materials, the memory unit 41 stores, as multiple material videos, at least a first material video that is extracted when the first material is selected first, a second material video that is extracted when the first material is selected second, a third material video that is extracted when the second material is selected first, and a fourth material video that is extracted when the second material is selected second. When the first material is selected first and the second material is selected second, the first material video and the fourth material video are extracted from the memory unit 41.

[0021] 3, the storage unit 41 is provided with material video 1A when person A is selected first, material video 2A when person A is selected second, and material video 3A when person A is selected third. The storage unit 41 also stores material videos 1B, 2B, and 3B when person B is selected first to third, and material videos 1C, 2C, and 3C when person C is selected first to third. For example, when person A, person B, and person C are selected in this order as materials to be composited with the captured video, material videos 1A, 2B, and 3C stored in the storage unit 41 are selected and extracted from the storage unit 41. The above example is an example in which material videos of three persons A to C are stored, and the number of stored material videos varies depending on the number of materials. For example, if 1st to yth (y≦x) persons are selected from x persons, the storage unit 41 may store at least xPy material videos.

[0022] Here, the material moving images stored in the storage unit 41 are captured so that the later the material is selected, the later it appears on the screen. For example, the material video of the first selected material (e.g., person A) is captured so that person A appears on the screen immediately (0 seconds) after the start of the material video. As shown in Fig. 4(A), person A is generated to enter the screen from one side (e.g., the left side) and enter below and in front of the subject, avoiding the display position of the subject (the area where the subject is expected to be reflected), as shown by the dashed line. Person A, who appears on the screen, moves to a predetermined position and then performs a waiting action, such as waving his / her hand, as shown in FIG. 4(B). Finally, as shown in FIG. 4(C), a photographing operation for photographing a still image is performed, such as having person A take a predetermined pose in accordance with a predetermined timing for creating a still image. When a material moving image is selected first, the moving images shown in Figs. 4(A) to 4(C) are an example of moving images shot continuously.

[0023] On the other hand, the material video of the second selected material (for example, person B) is captured so that person B appears on the screen a predetermined time (for example, 10 seconds) after the start of the material video. Person B is captured so that he appears on the screen at least a few seconds (for example, 0 to 10 seconds) after the first selected person A appears on the screen. As shown in FIG. 5(A), person B is generated so that he appears on one side of the screen (for example, the right side) and enters to the side of the subject, avoiding the display position of the subject indicated by the dashed line. Person B, who appears on the screen, moves to a predetermined position and then performs a waiting action, such as waving his / her hand, as shown in FIG. 5(B). Finally, as shown in Fig. 5(C), person B takes a photograph in accordance with a predetermined timing for creating a still image. The photographing operation shown in Fig. 5(C) is performed at the same timing as the photographing operation of person A shown in Fig. 4(C), and the material moving images are captured. When the material is selected second, the material moving image is an example of the moving image shown in Fig. 5(A) to Fig. 5(C) that has been continuously shot.

[0024] Furthermore, the third selected material video (e.g., person C) is captured so that person C appears on the screen a predetermined time (e.g., 20 seconds) after the start of the material video. Person C is captured so that he appears on the screen at least several seconds (e.g., 0 to 20 seconds) after the first and second selected persons A and B appear on the screen. As shown in FIG. 6(A), person C is generated so that he appears on one side of the screen (e.g., the left side) and enters to the side of the subject, avoiding the display position of the subject indicated by the dashed line. Person C who appears on the screen moves to a predetermined position as shown in FIG. 6(B), and then performs a waiting action such as waving his / her hand. Finally, as shown in Fig. 6(C), person B takes a photograph in accordance with a predetermined timing for creating a still image. The photographing operation shown in Fig. 6(C) is performed at the same timing as the photographing operation of person A shown in Fig. 4(C), and the material moving images are captured. When the material is selected third, the material moving image is an example of the moving image shown in Fig. 6(A) to Fig. 6(C) that has been continuously shot.

[0025] In this way, material videos, which are generated so that the later the selection order, the later the material appears on the screen, are composited in real time with captured videos of the subject, thereby creating a realistic composite video in which the selected materials (people A to C) appear to be entering the same space as the subject. Also, by having the materials (people) in the material videos enter the video while avoiding the display position of the subject, unnaturalness after the captured video and material videos are composited is reduced, allowing for the creation of a more realistic composite video. It should be noted that the material video does not necessarily have to be a video generated so that the later the selection order, the later the material appears on the screen. For example, a presentation may be implemented in which the first selected material appears second or later (for example, last). For this reason, the speed at which a material appears in the material video needs only to be determined according to the presentation, and even if a material is selected early, it may appear later in the material video than other material videos.

[0026] The storage unit 41 may store audio corresponding to the material video. Examples of audio include the speaking voices and sounds of the material in the material video (people's speaking voices, characters' lines, fireworks sounds, etc.) and audio indicating the movement of the material (character entrance sounds, movement sounds, etc.). The audio may also be effect sounds or background music when the material appears on the screen of the display device 20, or a new song if the material is an artist. This allows appropriate audio to be associated with the composite video image, making it possible to create a more realistic composite video.

[0027] The storage unit 41 may store timing notification video or timing notification audio that notifies the subject of the timing to create a still image. The timing notification video is, for example, a video in which numbers count down to "0" indicating the timing to capture the image. The timing notification audio is, for example, audio in which numbers count down to "0" indicating the timing to capture the image. When both the timing notification video and the timing notification audio are combined with the captured video, it is preferable that the timings of the countdowns are adjusted to match.

[0028] The storage unit 41 may also store instruction images that show instruction information such as characters, figures, patterns, etc. that indicate instructions or precautions for the person being photographed. The instruction images are composited into the captured moving images at a predetermined timing. For example, after the material (people) to be composited is selected, text information instructing the person being photographed to "step back a little from the screen" is composited before the composite moving image is displayed.

[0029] [Calculation section] The calculation unit 42 includes an instruction processing unit 421 , a material acquisition unit 422 , a captured video processing unit 423 , a video synthesis unit 424 , a still image synthesis unit 425 , and a link generation unit 426 . Based on the operation instructions input from the input unit 22, the calculation unit 42 generates composite moving images to be displayed on the display device 20, generates still images to be stored on the server, generates connection destination information for downloading still images, etc. Each part of the calculation unit 42 will be described in detail below.

[0030] (Instruction processing unit) The instruction processing unit 421 receives an operation instruction transmitted from the input unit 22. The instruction processing unit 421 transmits an operation instruction to each unit of the calculation unit 42 in accordance with the received operation instruction.

[0031] (Material Acquisition Department) The material acquisition unit 422 extracts and acquires material moving images to be composited with the captured moving images from the storage unit 41 in response to operation instructions received from the instruction processing unit 421. Furthermore, when extracting material moving images to be composited with the captured moving images from the storage unit 41, if audio corresponding to the extracted material moving images is separately stored, the material acquisition unit 422 also extracts and acquires the corresponding audio.

[0032] (Captured video processing unit) The captured video processing unit 423 acquires the captured video input from the imaging device 10. The captured video processing unit 423 synthesizes instruction information indicating instructions and precautions for the subject to be photographed in response to an operation by the operator with the captured video, and also synthesizes the material video acquired by the material acquisition unit 422 with the captured video.

[0033] (Video synthesis section) The video synthesis unit 424 synthesizes instruction information indicating instructions and precautions for the subject to be photographed into the captured video in accordance with the operator's operation, and also synthesizes the material video acquired by the material acquisition unit 422 into the captured video. At this time, the video composition unit 424 determines the order in which the photographed person in the captured video and the material video images will be superimposed in accordance with instructions input from the input unit 22, and composites the captured video and the material video images in the determined superimposition order. For example, if persons A to C are selected in this order as materials to be composited, the material composite video image extracted when person A is selected first (see FIGS. 4(A) to 4(C)) is composited into the captured video as the topmost layer. Furthermore, the material composite video image extracted when person B is selected second (see FIGS. 5(A) to 5(C)) and the material composite video image extracted when person C is selected third (see FIGS. 6(A) to 6(C)) are composited into the captured video as the second and third layers from the top. Note that the captured video images are composited with each video image as the bottommost layer (fourth layer from the top).

[0034] The order in which the material moving images and the captured moving images are superimposed is not limited to the above-described manner, and may be different depending on the design of the selected material, etc. For example, the subject may be displayed in front of at least one of the material moving images. In this case, the area of ​​the subject is cut out from each frame of the captured moving image, and the material is composited so that it is a layer below the subject. Instruction information indicating instructions and precautions to the subject, such as a timing notification video that notifies the subject of the timing for generating a still image from the composite video, is synthesized with the captured video as the highest layer above each video. In addition, timing notification audio may be synthesized with the composite video as instruction information.

[0035] When the display system 1 allows the photographed person to download a composite video in which the photographed person and the selected material are photographed together, the video composition unit 424 stores the generated composite video as an image to be downloaded in the image storage unit 43. The video composition unit 424 may store a composite video that does not include the above-mentioned instruction information (for example, countdown numbers) in the image storage unit 43, or may store a composite video that still includes the instruction information in the image storage unit 43. In addition, the video synthesis unit 424 may store the entire composite video (everything from the start of synthesis of the captured video and the material to the end of synthesis) in the image storage unit 43, or may store a partial composite video that is a cut-out of only a part of the composite video in the image storage unit 43. Furthermore, if audio corresponding to the material video images is separately stored in the storage unit 41, the video synthesis unit 424 may also generate a synthesized video image by incorporating the corresponding audio.

[0036] (Still image synthesis section) The still image synthesis unit 425 extracts a still image from the composite moving image at a predetermined timing to generate a still image in which the subject and the selected material are captured together. The still image synthesis unit 425 generates a still image from the composite moving image at a predetermined timing notified to the subject by the timing notification moving image or timing notification audio of the composite moving image. The still image synthesis unit 425 transmits the generated still image to the display device 20 to cause the display device 20 to display the still image.

[0037] By performing this superimposition, a still image is generated, such as that shown in Fig. 7A, in which the subject (area indicated by dots) is surrounded by other subjects (area indicated by solid lines), as in a commemorative photograph of multiple people. Alternatively, as shown in Fig. 7B, a still image may be generated in which the subject is lined up in front of the subject, as in a commemorative photograph of multiple people. Furthermore, as shown in Fig. 7C, there may be multiple subjects. When the display system 1 allows the photographed person to download a still image in which the photographed person and the selected material are photographed together, the still image synthesis unit 425 stores the generated still image in the image storage unit 43 as an image to be downloaded.

[0038] (Link generation section) After the downloadable images are stored in the image storage unit 43, the link generation unit 426 generates connection destination information including a connection destination for the person to be photographed or the like to access the downloadable images stored in the image storage unit 43. The link generation unit 426 outputs the connection destination information to the display device 20. The connection destination information output to the display device 20 is displayed superimposed on the image displayed on the display device 20 so as to be a layer above the image. Alternatively, the link generation unit 426 may transmit the connection destination information to the moving image composition unit 424 or the still image composition unit 425, and the moving image composition unit 424 or the still image composition unit 425 may combine the connection destination information with the combined moving image or still image and output the combined image to the display device 20. Furthermore, the connection destination information may be displayed alongside (without overlapping with) the composite moving image or still image, or only the connection destination information may be displayed without displaying the composite moving image or still image.

[0039] The link generation unit 426 may generate connection destination information including an ID for identifying the image for download, and the connection destination information may include the ID for identifying the image for download as well as the connection destination for accessing the image for download. Such connection destination information may be, for example, a two-dimensional code such as a QR code (registered trademark) or a barcode such as CODE128.

[0040] (1.2) Display method The display method according to this embodiment will be described below. The display system 1 according to this embodiment can generate a realistic composite moving image when capturing a still image and display it on a display device, according to a display program that causes a computer to execute a pre-stored display method.

[0041] The display method according to this embodiment is executed at least by the following method. (a) generating a plurality of material moving images that are captured in advance so that the material to be composited around the subject avoids the position of the subject and fits around the subject; (b) Generate a moving image of the subject (c) Extracting the selected material video in response to an operation instruction for selecting the material to be composited around the subject. (d) The extracted material video is synthesized with the captured video to generate a composite video in which the material is inserted around the subject. (e) Outputting the composite video to a display device (f) At a predetermined timing, save at least one of the composite video and the still image extracted from the composite video.

[0042] The display method will be described in more detail below with reference to Figures 8A to 8H and 9 as well as Figure 1. Figures 8 and 9 are schematic diagrams and a flowchart illustrating the display method according to this embodiment. Note that the following describes the operation when a still image is saved and is downloaded by the subject.

[0043] First, in the display system 1, as shown in Figures 4 to 6, a plurality of material moving images are generated that are captured in advance so that materials to be composited around the subject are inserted around the subject while avoiding the subject's position (step S11). The generated material moving images are stored in the storage unit 41. Next, as shown in Fig. 8A, the display system 1 displays candidate materials (people) with whom the person being photographed can take a photo on the display unit 21 of the display device 20. As shown in Fig. 8B, the operator, such as the person being photographed, selects, for example, three people in order from the displayed plurality of people. In Fig. 8B, the numbers "1," "2," and "3" are displayed on the person photos in the order of selection. Once the selection of the person is complete, as shown in Fig. 8C, a captured moving image of the person imaged by the imaging device 10 is generated (step S12) and displayed on the display device 20. Note that in Fig. 8C, instructions to the person to be imaged are displayed as text information.

[0044] Thereafter, the video composition unit 424 extracts material videos selected for the first, second, and third people in response to an operation instruction to select materials to be composited around the subject (step S13). As shown in FIGS. 8D to 8F, the video composition unit 424 composites the extracted material videos with the captured video to generate a composite video in which the material selected for the first person is placed around the subject (FIG. 8D), a composite video in which the material selected for the second person is placed around the subject (FIG. 8E), and a composite video in which the material selected for the third person is placed around the subject (FIG. 8F) (step S14). The generated composite videos are output to the display device 20 (step S15). Finally, as shown in Fig. 8G, when a still image is extracted from the composite moving image, a timing notification moving image (countdown) is displayed to notify the user of the timing to create the still image at a predetermined timing. As shown in Fig. 8H, a still image is extracted from the composite moving image at a predetermined timing, and the still image is saved as an image for download. Link generating unit 426 also generates connection destination information for the save destination of the still image, and displays the connection destination information together with the still image on display device 20 (step S16). In this way, still images are captured through a realistic photography experience.

[0045] (1.3) Display Program A display program executed by the display system 1 according to this embodiment will now be described. The display system 1 can generate a realistic composite moving image when a still image is captured and display it on a display device in accordance with a program that causes a computer to execute at least the following operations (A) to (F). The following program is non-temporarily recorded on a recording medium such as a hard disk drive or memory, or an optical disc such as a DVD disc or Blu-ray (registered trademark). The following program may be distributed via the Internet. Furthermore, the following program may be recorded on a cloud server and executed via the Internet.

[0046] (A) generating a plurality of material moving images that are captured in advance so that materials to be composited around the subject are inserted around the subject while avoiding the position of the subject; (B) generating a moving image of the person being photographed; (C) Extracting selected material moving images in response to an operation instruction for selecting materials to be composited around the subject. (D) Synthesizing the extracted material moving image with the captured moving image to generate a composite moving image in which the material is inserted around the subject. (E) Outputting the composite moving image to a display device. (F) At a predetermined timing, storing at least one of the composite video and a still image extracted from the composite video. A display program that causes a computer to execute the above.

[0047] (1.4) Variations (1.4.1) Variation 1 When elements (people, etc.) are selected in a predetermined order, the display system 1 may display an image of a new element that has not been displayed as an option up until that point, making it selectable, or may select it automatically. Such a new element may be used as a so-called hidden character or a bonus character.

[0048] For example, the storage unit 41 stores a predetermined selection order of the material moving images, and the instruction processing unit 421 compares the selection order of the material input from the input unit 22 with the predetermined selection order stored in the storage unit 41. If the selection order of the material input from the input unit is the predetermined selection order, a control unit (not shown) displays an image of a new material that had not been displayed on the display device 20 until then on the display device 20. When the instruction processing unit 421 receives an operation instruction from the input unit 22 indicating that a new material has been selected, the material acquisition unit 422, the captured moving image processing unit 423, and the moving image synthesis unit 424 can each generate a composite moving image in which the material moving images of the new material have been synthesized.

[0049] (1.4.2) Variation 2 The display system 1 may be configured to display an advertising video during the process. For example, after the still image synthesis unit 425 generates a downloadable still image, a control unit (not shown) may cause the display device 20 to display an advertising video before displaying the connection destination information and the still image.

[0050] (1.4.3) Variation 3 The display system 1 may further include a voting function according to the selection order of the materials. For example, such a display system 1 allows a commemorative photo to be taken while voting by assigning a higher score to an earlier selected material.

[0051] (1.4.4) Variation 4 The display system 1 includes an image storage unit 43 in which still images are stored within the arithmetic device 40, but is not limited to such a configuration. For example, as shown in FIG. 10, the display system 1 may have a processing device 40 connected to a server 60 via a network 50, and the server 60 may include an image storage unit 61 therein.

[0052] (1.4.5) Variation 5 The display system 1 has a configuration in which the imaging device 10, the display device 20, and the audio output unit 30 are directly connected to the processing device 40, but is not limited to such a configuration. For example, the display system 1 may have a processing device 40 connected to the imaging device 10, the display device 20, and the audio output unit 30 via a network 50.

[0053] Although the present disclosure has been described above using embodiments, the technical scope of the present disclosure is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included in the technical scope of the present disclosure. [Explanation of symbols]

[0054] 1 Display System 1A~2C Material Video 10. Imaging device 20 Display device 21 Display section 22 Input section 30 Audio output section 40 Processing equipment 41 Storage section 42 Arithmetic section 421 Instruction Processing Unit 422 Material Acquisition Department 423 Captured video processing unit 424 Video Composition Unit 425 Still Image Composition Unit 426 Link Generation Unit 43 Image storage unit 60 servers 61 Image storage unit

Claims

1. A display device; an imaging device that generates a moving image of a person being photographed; an input device for inputting instructions; a processing device that generates a composite moving image by compositing the captured moving image with material moving images that are material moving images to be composited around the subject; Equipped with The processing device includes: a storage unit that stores the material moving images that are generated in advance so that the material to be composited around the subject is inserted around the subject while avoiding a display position of the subject; a calculation unit that extracts from the storage unit the material moving images selected in response to the instruction input from the input device, synthesizes the selected material moving images with the captured moving images input from the imaging device, generates a composite moving image in which the material is inserted around the subject, and outputs the composite moving image to the display device; and the display device displays the composite moving image; the storage unit stores the material video images of the plurality of materials, and stores the material video images for each material in accordance with a selection order; the calculation unit determines an order of superimposition of the photographed person in the captured moving image and the material moving images of the plurality of materials in response to the instruction input from the input device, and synthesizes the captured moving image and the material moving images of the plurality of materials so as to achieve the order of superimposition, the order of superimposition differing depending on the selected material; Display system.

2. The storage unit stores a material moving image of the material, the later the material is selected, the later the material is reflected on the screen. The display system of claim 1 .

3. the storage unit stores audio corresponding to the material video of the material, The calculation unit synthesizes the audio with the captured video.

3. A display system according to claim 1 or 2.

4. the storage unit stores a predetermined selection order of the material video images; When the selection order of the material moving images of the plurality of materials input from the input device is a predetermined selection order, the calculation unit extracts material moving images of other materials not displayed on the display device and synthesizes the extracted material moving images with the captured moving images to generate the synthesized moving image. A display system according to any one of claims 1 to 3.

5. the storage unit stores a timing notification moving image or a timing notification sound for notifying the subject of the timing for creating a still image; The calculation unit stores in the storage unit at least one of the composite moving image and the timing notification moving image or a still image extracted from the composite moving image at a predetermined timing notified to the photographed person by the timing notification sound. A display system according to any one of claims 1 to 4.

6. the calculation unit generates connection destination information including a connection destination for accessing the storage unit and outputs the connection destination information to the display device; The processing device causes the terminal that has accessed the storage unit to transmit at least one of the composite moving image and the still image. The display system of claim 5 .

7. 1. A computer-implemented display method comprising: The computer generating a plurality of material moving images of the material that are captured in advance so that the material to be composited around the subject avoids the position of the subject and enters around the subject, and storing the generated material moving images in a storage unit; generating a captured moving image of the person being photographed; extracting a material moving image of the selected material from the storage unit in response to an operation instruction from an input device to select the material to be composited around the subject; synthesizing the extracted material moving images with the captured moving images to generate a composite moving image in which the material is embedded around the subject; outputting the composite moving image to a display device; storing at least one of the composite moving image and a still image extracted from the composite moving image at a predetermined timing; the storage unit stores a plurality of material moving images of the material in accordance with a selection order for each of the materials; determining an order of superimposition of the person in the captured moving image and the material moving images of the plurality of materials in accordance with the operation instruction input from the input device, and synthesizing the captured moving image and the material moving images of the plurality of materials so as to achieve the order of superimposition, the order of superimposition differing depending on the selected material; Display method.

8. generating a plurality of material moving images of the material that are captured in advance so that the material to be synthesized around the subject avoids the position of the subject and enters around the subject, and storing the generated material moving images in a storage unit; generating a captured moving image of the person being photographed; extracting a material moving image of the selected material in response to an operation instruction from an input device to select the material to be composited around the subject; synthesizing the extracted material moving images with the captured moving images to generate a composite moving image in which the material is embedded around the subject; outputting the composite moving image to a display device; storing at least one of the composite moving image and a still image extracted from the composite moving image at a predetermined timing; on the computer, the storage unit stores a plurality of material moving images of the material in accordance with a selection order for each of the materials; A display program that determines the order in which the subject in the captured video and the material video images of the plurality of materials are superimposed in accordance with the operation instructions input from the input device, and combines the captured video with the material video images of the plurality of materials to achieve the order in which they are superimposed, the order of superimposition differing depending on the material selected.

Images