Programs, imaging equipment

Abstract

To provide a program which allows a user to share and experience the same space as a performer and can record the experience.SOLUTION: In an imaging system, a program causes a terminal to function as: reception means which receives content data including video data for augmented reality including a fill signal of a performer and a key signal and voice data from a management server, and stores the data in a storage unit; content selection means which displays a content list and accepts selection of desired content; video composition means which combines the fill signal of the performer and a captured video by using the key signal of the video data for augmented reality of the selected content, generates and displays a composite video including a user and the performer and records at least a portion of the composite video as a recording image; voice output means which outputs the voice of the performer in synchronization with the composite video displayed on a display unit by using the selected voice data; transmission means which transmits the recording image to a management device for storage; and storage place presentation means which receives storage place information and displays the same on the display unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a program , Imaging device In particular, a program that photographs the user , Imaging device Regarding. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been an automatic photo creation device for amusement use that takes a photograph of a subject, including a user, with a camera, and outputs a composite image, in which the photographed image is combined with an additional image, as a printed photograph.

[0003] However, in the above-mentioned automatic photo creation device, the device manufacturer creates a separate image source as an additional image and stores it in the device in advance, and the user uses it in editing work. Therefore, the user has no choice but to use the additional image prepared in advance by the device manufacturer, and cannot get a full sense of satisfaction.

[0004] Therefore, an automatic photo creation device has been invented that can register the captured image of the preceding subject and its edited image as a new additional image to be added to the captured image of the user as the following subject (Patent Document 1). The preceding subject is a person who has added value for which publicity rights and merchandising rights can be granted, such as a celebrity. This allows a photo to be taken of the user alongside the celebrity, providing a sense of satisfaction not available in the past. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2008-005401 A Summary of the Invention [Problem to be solved by the invention]

[0006] Incidentally, the additional image of the automatic photo creation device is a still image, and the purpose of the automatic photo creation device is to provide a photo in which the user and a celebrity or the like are side by side.

[0007] However, the above-mentioned automatic photo creation device does not allow the user to have the experience of sharing the same space as a celebrity, etc., and is limited to simply providing a composite photo, which does not give the user a sufficient sense of satisfaction.

[0008] Therefore, the present invention provides a program that allows a user to have the experience of sharing the same space as a performer such as a celebrity, and also allows the user to obtain a recorded image of that experience. [Means for solving the problem]

[0009] One aspect of the present invention is a computer program having a camera that photographs a user, a display unit, and a memory unit, the program causing the computer to function as: a receiving means for receiving content data including augmented reality video data and audio data including a performer's fill signal and key signal from a management device that manages content, and storing the received content data in the memory unit; a content selection means for displaying a content list of content using the content data on the display unit and accepting a selection of content desired by the user from the content list; a video synthesis means for using a key signal of the augmented reality video data of the content data of the content selected by the user to synthesize the performer's fill signal and video of the user photographed by the camera to generate a composite video including the user and the performer, displaying the composite video on the display unit, and recording at least a part of the composite video as a recorded image; an audio output means for using audio data of the content data of the content selected by the user to output the voice of the performer in synchronization with the composite video displayed on the display unit; a transmitting means for transmitting the recorded image to the management device for storage; and a storage location presentation means for receiving storage location information indicating the storage location of the recorded image from the management device and displaying information indicating the storage location on the display unit. Effect of the Invention

[0010] The present invention allows a user to have the experience of sharing the same space as a performer, and also allows the user to obtain a recorded image of that experience. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of the overall configuration of an imaging system according to this embodiment. [Diagram 2] FIG. 2 is a block diagram of the photographing device 1. [Diagram 3] FIG. 3 is a diagram for explaining the synthesis process of the synthesized image performed by the image processor 154. As shown in FIG. [Figure 4] FIG. 4 is a diagram showing an example of the content database. [Diagram 5] FIG. 5 is a diagram showing an example of the setting data. [Figure 6] FIG. 6 is a diagram showing the external appearance of the photographing device 1. As shown in FIG. [Figure 7] FIG. 7 is a block diagram of the management server 2. [Figure 8] FIG. 8 shows an example of the imaging device management database. [Figure 9] FIG. 9 is a block diagram of the payment server 3. [Figure 10] FIG. 10 is a sequence diagram between devices. [Figure 11] FIG. 11 is a flowchart showing the operation of the setting process (Step 1) of the photographing device 1. [Figure 12] FIG. 12 is a flowchart showing the operation of the management process (Step 2) of the management server 2. [Figure 13] FIG. 13 is an operational flowchart of the photographing process (Step 3). [Figure 14] FIG. 14 shows an example of a content selection screen displayed on the operation input unit 13. In FIG. [Figure 15] FIG. 15 is an example of a usage fee screen displayed on the operation input unit 13. [Figure 16]FIG. 16 is an example of a screen displaying a two-dimensional code indicating the address of the storage location. [Figure 17] FIG. 17 shows an example of a case where a recorded image downloaded to the terminal 4 is displayed on the display of the terminal 4. In FIG. [Figure 18] FIG. 18 is a diagram showing an example of the overall configuration of an imaging system according to the second embodiment. [Figure 19] FIG. 19 is a block diagram of the performer photographing device 5. [Figure 20] FIG. 20 is a block diagram of the management server 2 according to the second embodiment. [Figure 21] FIG. 21 shows an example of the imaging device management database in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] <First embodiment> [Overall configuration] Fig. 1 is a diagram showing an example of the overall configuration of a photography system in this embodiment. As shown in Fig. 1, the photography system includes a photography device 1, a management server 2, a payment server 3, and a terminal 4. The photography device 1, the management server 2, the payment server 3, and the terminal 4 can be connected to a communication line N and can communicate with each other.

[0013] The communication line N means a communication path that allows data communication. In other words, the communication line N includes a dedicated line (dedicated cable) for direct connection, a LAN such as Ethernet (registered trademark), a telephone communication network, a cable network, the Internet, and other communication networks, regardless of whether the communication method is wired or wireless.

[0014] The imaging device 1 is installed in facilities such as event venues and movie theaters, and generates a composite image by combining a captured image of a user (subject) with a content image. The content image is an augmented reality image (e.g., a video) of entertainers (cast members of dramas and movies, idols, etc.) and athletes (collectively referred to as performers hereinafter). The imaging device 1 also has a digital signage function. Basically, there are multiple imaging devices 1, and they are installed in facilities such as event venues and movie theaters.

[0015] The management server 2 is a server that manages the content images and advertisements used by the image capturing device 1, and stores the recorded images to be provided to the user (subject).

[0016] The settlement server 3 is a server that handles settlement of the usage fee for the photographing device 1.

[0017] The terminal 4 is a terminal carried by a user (subject), and can connect to a communication line N via a wireless communication base station or the like and perform data communication with the management server 2. The terminal 4 is, for example, a smartphone, a mobile phone, a personal computer, a tablet computer, or the like. Basically, there are multiple terminals 4, and each terminal 4 is operated by each user (subject). The terminal 4 has at least a function of receiving image data, storing or displaying the image data, a photographing function, and the like.

[0018] [Device configuration] The following describes the configuration of the photographing device 1. FIG.

[0019] In FIG. 2, 10 is a camera, 11 is a display, 12 is a speaker, 13 is an operation input unit, 14 is a short-range wireless communication unit, 15 is a processing unit, 16 is a transmitting / receiving unit, and 17 is a memory unit.

[0020] The camera 10 is a camera that captures a user (subject) and the background of the space in which the user (subject) exists. The image captured by the camera 10 (including both still images and videos) will be referred to as a captured image below. This captured image is input to the processing unit 15.

[0021] The display 11 displays an image obtained by combining the image captured by the camera 10 and the content image.

[0022] The speaker 12 outputs the sound of the content.

[0023] The operation input unit 13 is for the user (subject) to input various operations related to photography, and outputs an operation input signal corresponding to the operation input to the processing unit 15. The function of the operation input unit 13 can be realized by, for example, elements operated by the user's fingers, such as a keyboard, a mouse, a touch operation pad, a home button, a button switch, a joystick, or a trackball, as well as elements that detect motion or posture, such as an acceleration sensor, an angular velocity sensor, a tilt sensor, or a geomagnetic sensor. The operation input unit 13 of this embodiment is a touch operation panel equipped with a display on which operation information is displayed.

[0024] The short-distance wireless communication unit 14 is a reader / writer for a contactless IC card used for payment of the usage fee.

[0025] The processing unit 15 comprehensively controls the operation of the imaging device 1 based on the programs and content data stored in the memory unit 17, the operation input signal from the operation input unit 13, and the like. The functions of the processing unit 15 can be realized by electronic components such as a microprocessor such as a CPU or a GPU, an ASIC, an IC memory, and the like. The processing unit 15 includes, as main functional units, a management unit 151, an operation control unit 152, a payment processing unit 153, a video processing unit 154, a signage control unit 155, an audio control unit 156, and a storage location presentation unit 157.

[0026] The management unit 151 manages the settings and data of the camera 1. The administrator performs the necessary settings for the camera 1 after authentication using the account and password assigned to the camera 1. A typical setting for the camera 1 is the setting of the content to be used in the camera 1. The content is downloaded from the management server 2 and stored in the storage unit 17. There are two types of content download: an automatic update mode in which content is downloaded automatically, and a manual update mode in which the administrator selects and downloads the content he or she desires. The administrator sets either of these modes, and the content is downloaded and stored in the camera 1.

[0027] Content includes content video that is combined with footage shot by the user (subject), and signage video (advertising video) used for digital signage. Content video is video of performers such as entertainers (cast members of dramas and movies, idols, etc.) and athletes, and is video data for augmented reality. Content video is basically video. Signage video is advertising video, and includes both video and still images. Content data includes content video and metadata related to those videos (identification information, usage fees, etc.). Similarly, signage data includes signage video and metadata related to those videos (identification information, etc.).

[0028] The operation control unit 152 displays the details of the content (for example, thumbnail images) and operation information on the operation input unit 13. In addition, the operation control unit 152 receives an operation signal from the operation input unit 13.

[0029] The payment processing unit 153 receives payment information from the non-contact IC card read by the short-range wireless communication unit 14, and transmits the payment information to the payment server 3. In addition, when the payment is completed, it receives payment completion information from the payment server 3.

[0030] The image processor 154 receives an image of the user (subject) captured by the camera 10, and generates a composite image by superimposing the content image of the content selected by the user (subject) on the captured image.

[0031] The generation of a composite video performed by the video processing unit 154 will now be described. In order to generate a composite video, three types of video signals are required: a shot video, a fill signal, and a key signal. The fill signal is a content video of a performer of a content selected by a user (subject). The key signal is a signal that specifies an area in which the content video, which is a fill signal, is superimposed. In this embodiment, the fill signal and the key signal are video data for augmented reality.

[0032] Fig. 3 is a diagram for explaining the synthesis process of the synthesized image performed by the image processor 154. In the synthesis process, the synthesized image is generated by fitting the image of the performer of the fill signal into an area of ​​the entire area of ​​the shot image that is specified based on the key signal. Note that Fig. 3 is a diagram for explaining the synthesis process of a certain predetermined frame, and in reality, since the shot image and the content image are moving images, the synthesis process is performed on a frame-by-frame basis.

[0033] Also, if the positional relationship between the user (subject) and performer in the shooting space is known, the overlapping portion of the superimposed fill signal (performer's image) and the user (subject) area is synthesized with priority given to the one located in the front. In this way, it is possible to produce a more natural image of the virtual space. The positional relationship between the user (subject) and performer can be determined using conventional methods such as infrared measurement and image analysis of the video.

[0034] The video processor 154 also has a function of recording an image at a certain time in the composite video (moving image) as a still image. This recorded image is stored in a storage location of the management server 2, which will be described later. Note that the recorded image is not limited to a still image, and may be all or part of the composite video (moving image).

[0035] The signage control unit 155 uses the signage data to display an advertisement on the display 11 during the time when the image capturing device 1 is not being used for image capturing.

[0036] The audio control unit 156 uses the audio data included in the content data to output from the speaker 12 the voice of the performer on the video, the audio of usage instructions, and the like when shooting the video of the user (subject).

[0037] The storage location presenting unit 157 notifies the user (subject) of the storage location of the recorded image described above. One method of notification is to display a two-dimensional code (QR code (registered trademark) or the like) indicating the address of the storage location of the recorded image on the display 11. However, the method is not limited to this, and the address of the storage location may be displayed directly on the display 11, or another method may be used.

[0038] The transmitter / receiver 16 transmits and receives data between the management server 2 and the payment server 3 via the communication line N.

[0039] The storage unit 17 stores various data necessary for the image capturing device 1. For example, this includes a content database and setting data.

[0040] FIG. 4 is a diagram showing an example of a content database. The database shown in FIG. 4 stores content data of performers used for shooting with users and signage data used as advertisements. The content data includes content identification information (ID), a content name, video data for augmented reality (including a fill signal and a key signal), audio data, and metadata. The signage data includes signage identification information (ID), an advertisement name, video data, audio data, and metadata. Note that FIG. 4 is an example and is not limited to this.

[0041] Fig. 5 is a diagram showing an example of the setting data. The setting data shown in Fig. 5 includes the account of the camera device 1, an administration password, whether or not automatic updating is enabled, an advertisement start time (the time elapsed since the camera device 1 was last used), and auxiliary data. Note that Fig. 5 is an example, and is not limited to this.

[0042] The appearance of the above-mentioned photographing device 1 is shown in FIG.

[0043] Next, a description will be given of the configuration of the management server 2. FIG.

[0044] In FIG. 7, 20 is an input unit, 21 is a transmitting / receiving unit, 22 is a processing unit, and 23 is a storage unit.

[0045] The input unit 20 allows the administrator to input various operations, and outputs an operation input signal corresponding to the operation input to the processing unit 22. The functions of the input unit 20 can be realized by elements that are operated by the user's fingers, such as a keyboard, a mouse, a touch operation pad, a home button, a button switch, a joystick, or a trackball, as well as elements that detect movement or posture, such as an acceleration sensor, an angular velocity sensor, an inclination sensor, or a geomagnetic sensor.

[0046] The transmitting / receiving unit 21 transmits and receives data to and from the photographing device 1 via the communication line N.

[0047] The processing unit 22 comprehensively controls the operation of the management server 2 based on the programs and content data stored in the storage unit 23, and operation input signals from the input unit 20. The functions of the processing unit 15 can be realized by electronic components such as a microprocessor such as a CPU or GPU, an ASIC, and an IC memory. The processing unit 22 includes a content management unit 121 and a captured data storage management unit 122 as its main functional units.

[0048] The content management unit 121 manages the content data to be set in the camera device 1. Specifically, the content used in the camera device 1 is managed using a camera device management database stored in the storage unit 23. Fig. 8 is an example of the camera device management database. The camera device management database shown in Fig. 8 records, for each camera device 1, identification information of the camera device, an account, a password, whether or not automatic updates are enabled, and identification information of available content.

[0049] The photographic data storage management unit 122 stores the recorded images photographed by the photographing device 1 in the memory 23, and notifies the photographing device 1 of the address of the storage location.

[0050] Next, a description will be given of the configuration of the payment server 3. FIG.

[0051] In FIG. 9, 30 is a transmitting / receiving unit, 31 is a payment processing unit, and 32 is a storage unit.

[0052] The transmitting / receiving unit 30 transmits and receives data to and from the photographing device 1 via the communication line N.

[0053] The payment processing unit 31 receives payment information from the photographing device 1, performs payment processing based on the program and payment data stored in the memory unit 32, and transmits payment completion information to the photographing device 1. The payment processing unit 31 can be realized by electronic components such as a microprocessor such as a CPU or GPU, an ASIC, an IC memory, etc. Note that payment of fees using a contactless IC card can be made using a conventional method.

[0054] [Operation of each device] The operation of the first embodiment will be described with reference to Fig. 10, which is a sequence diagram between devices.

[0055] First, a setting process is performed to make the image capturing device 1 available (Step 1). Then, in response to a setting request from the image capturing device 1, the management server 2 performs a management process and transmits content data and signage data (Step 2).

[0056] Here, the operation of the setting process (Step 1) of the photographing device 1 will be described with reference to a flowchart.

[0057] First, the administrator of the image capturing apparatus 1 displays the management screen by operating the operation input unit 13. The operation control unit 152 displays the management screen on the operation input unit 13 (Step 100).

[0058] The administrator operates the operation input unit 13 to input identification information (account) and a password (Step 101).

[0059] The management unit 151 verifies the input identification information (account) and password (Step 102), and if authentication is successful (Step 103), the process proceeds to selection of an update mode. On the other hand, if authentication is not successful, the setting process ends.

[0060] If authentication is successful, automatic update mode and manual update mode are displayed on the management screen, and the administrator selects one of the modes.

[0061] When the administrator selects the automatic update mode (Step 104), content data and signage data available for use by the image capturing device 1 are transmitted from the management server 2, and the management unit 151 stores the content data and signage data in the content database of the storage unit 17, and completes the content setting. Then, a setting completion notice is transmitted to the management server 2.

[0062] On the other hand, if the administrator selects the manual update mode (Step 104), a list of content data and signage data available for use by the image capture device 1 is transmitted from the management server 2, and the management unit 151 displays the list information of the content data and signage data (Step 105). The administrator operates the operation input unit 13 to select the content data and signage data to be used from the list information (Step 106). Then, the management unit 151 downloads the selected content data and signage data from the management server 2 (Step 107), stores the selected content data and signage data in the content database of the storage unit 17, and completes the content setting (Step 108). Then, a setting completion notification is transmitted to the management server 2.

[0063] Next, the operation of the management process (Step 2) of the management server 2 will be described with reference to a flowchart.

[0064] The management server 2 verifies the identification information (account) in response to the setting request from the photographing device 1 (Step 200). If the identification information (account) is registered (Step 201), the management server 2 performs processing corresponding to the mode request from the photographing device 1.

[0065] If the mode requested by the camera device 1 is the manual update mode (Step 202), a list of content data and signage data corresponding to the content ID or signage ID written in the available content field of the account of the camera device 1 that made the setting request in the camera device management database of the storage unit 23 is transmitted (Step 203). When selection information of the content data and signage data is received from the camera device 1, the selected content data and signage data are transmitted to the camera device 1 (Step 204). Then, when a setting completion notification is received from the camera device 1, the management process is terminated (Step 205).

[0066] On the other hand, if the mode requested by the camera device 1 is the automatic update mode, the camera device management database in the storage unit 23 sets a flag in the automatic update yes / no field of the account of the camera device 1 that made the setting request to "ON" (Step 206). Then, among the contents registered in the content database, the content data and signage data corresponding to the content ID or signage ID written in the usable content field of the account of the camera device 1 that made the setting request are searched for (Step 207), and the usable content data and signage data are transmitted (Step 208). Then, when a setting completion notification is received from the camera device 1, the management process is terminated (Step 205).

[0067] Furthermore, for a camera device 1 of an account for which automatic updates are enabled, if there is a change in the available content, the content data or signage data corresponding to the ID listed in the available content field is automatically sent to the camera device 1, and the content of the camera device 1 is automatically updated.

[0068] Returning to the explanation of the sequence diagram in FIG.

[0069] Once the settings of the photographing device 1 are complete, a user (subject) is able to use the photographing device 1. Then, when the user (subject) starts using the photographing device 1, the photographing device 1 executes a photographing process (Step 3).

[0070] Here, the operation of the photographing process (Step 3) will be described with reference to a flowchart in Fig. 13. The photographing process (Step 3) is shown in Fig. 13 as an operational flowchart.

[0071] The operation control unit 152 of the imaging device 1 displays a list of contents on the operation input unit 13 (Step 300). Fig. 14 is an example of a content selection screen displayed on the operation input unit 13. The example of Fig. 14 is an example of a screen where three types of contents, content AAA, content BBB, and content CCC, can be selected.

[0072] A user of the image capturing device 1 selects a desired content from the list of contents displayed on the operation input unit 13. The selection is performed by touching the desired content from the list of contents (Step 301).

[0073] When content is selected, a screen showing the usage fee for the content is displayed on the screen of operation input unit 13 (Step 302). Fig. 15 is an example of a usage fee screen displayed on operation input unit 13. In the example of Fig. 15, the usage fee for content AAA is 600 yen, and this is an example of a screen requesting that an IC card be touched to short-range wireless communication unit 14.

[0074] When the user touches the IC card to the short-range wireless communication unit 14 according to the instructions on the usage fee screen, the payment processing unit 153 receives the payment information for the fee (Step 303) and transmits the payment information to the payment server 3 (Step 304).

[0075] The payment processing unit 153 of the photographing device 1 receives the payment completion information from the payment server 3 (Step 305), displays on the operation input unit 13 that the payment has been completed, and notifies the user that photographing will begin (Step 306).

[0076] When the camera starts to capture the user (subject), the captured image is displayed on the display 11. Next, the image processor 154 superimposes the image data for virtual reality of the selected content on the captured image to generate a composite image (Step 307). Then, the image processor 154 displays the composite image (moving image) on the display 11 (Step 308). At this time, the voice of the performer is also output from the speaker based on the audio data of the content. For example, a voice such as "This is AAA. Thank you for participating in the photo session today" is output. In this way, an image of the performer and the user existing together in the same space is displayed on the display 11 (see the composite image in FIG. 3), and the user can also hear the voice, so that the user can have a simulated experience of sharing the same space with the performer. Then, the performer announces the timing of the commemorative photo shoot, and a recording image (still image) is taken (Step 309).

[0077] When the shooting is completed, the storage location presenting unit 157 uploads the still image to the management server (Step 310), and displays the address of the storage location on the screen of the operation input unit 13 using a two-dimensional code (Step 311). Fig. 16 is an example of a screen on which a two-dimensional code indicating the address of the storage location is displayed.

[0078] This is the end of the description of the photographing process.

[0079] Returning to the explanation of the sequence diagram in FIG.

[0080] Step 4 is a payment process performed by the payment server 3. The payment information of the user's IC card transmitted from the photographing device 1 is received, and payment completion information is transmitted to the photographing device 1 based on the payment information.

[0081] Step 5 is a storage process performed by the management server 2. The management server 2 stores the recorded image (still image) transmitted from the image capture device 1, and transmits the address of the storage location to the image capture device 1.

[0082] The user uses the photographing function of terminal 1 to photograph the two-dimensional code displayed on the screen of operation input unit 13, and accesses the address indicated by the two-dimensional code (Step 6). Terminal 1 then downloads the photographed recorded image (still image) to terminal 1 (Step 7). Figure 17 shows an example of the case where the recorded image downloaded to terminal 4 is displayed on the display of terminal 4.

[0083] On the other hand, if the user does not use the photographing device 1 for a certain period of time (e.g., 3 minutes), the signage control unit 155 of the photographing device 1 retrieves video data and audio data from the signage data in the content database of the memory unit 17, displays an advertisement using the video data on the display 11, and outputs audio using the audio data from the speaker 12 (Step 8).

[0084] This concludes the explanation of the operation of the first embodiment.

[0085] In the first embodiment, the performer's video (moving image) and the user's video are synthesized and displayed on the display, and the audio can also be heard, so the user can have the experience of sharing the same space as the performer. In addition, the recorded images recorded as a memento of the experience are stored in the management server, and the user can download them to their terminal, which improves the convenience of sharing via SNS, for example, and also reduces costs because no physical printing is required.

[0086] Furthermore, in the first embodiment, the management server collectively manages the content used in the photographing device, thereby realizing instantaneous setting of the content used in the photographing device and flexible registration.

[0087] Furthermore, since the image capturing device according to the first embodiment is also equipped with a digital signage function, it is possible to effectively utilize the time when the image capturing device is not in use.

[0088] <Second embodiment> A second embodiment will now be described. Fig. 18 is a diagram showing an example of the overall configuration of an imaging system in the second embodiment.

[0089] In the second embodiment, in addition to the features of the first embodiment, a performer shooting device 5 is provided which shoots live footage of the performers and generates content data (fill signal, key signal, and audio data) from the live footage to be used in the shooting device 1.

[0090] Fig. 19 is a block diagram of the performer shooting device 5. In Fig. 19, 50 is a camera, 51 is a microphone, 52 is a display, 53 is a transmitting / receiving section, 54 is a processing section, and 55 is a storage section.

[0091] The camera 50 is a camera that captures live images of the performers. Images captured by the camera 50 will be referred to as live images. The live images are input to a processing unit 54.

[0092] The microphone 51 picks up the voice of the performer and outputs the picked up voice to the processing unit 54 .

[0093] The display 52 displays a live image captured by the camera 50.

[0094] The transmitting / receiving unit 53 transmits and receives data to and from the management server 2 via the communication line N.

[0095] The processing unit 54 comprehensively controls the operation of the performer shooting device 5 based on a program stored in the storage unit 55. The functions of the processing unit 54 can be realized by electronic components such as a microprocessor such as a CPU or a GPU, an ASIC, an IC memory, etc. The processing unit 54 includes a fill signal generating unit 151, a key signal generating unit 152, and a live content data generating unit 153 as its main functional units.

[0096] The fill signal generation unit 151 generates a fill signal of a performer in real time from the live video captured by the camera 50. The key signal generation unit 152 generates a key signal of a performer in real time from the live video captured by the camera 50. For this processing, for example, chromakey technology can be used.

[0097] The live content data generating unit 153 generates live content data including a fill signal of the performer, a key signal, and the voice of the performer picked up by the microphone 51. This live content data is transmitted to the management server 2 in real time via the transmitting / receiving unit 53.

[0098] The management server 2 according to the second embodiment will be described. Fig. 20 is a block diagram of the management server 2 according to the second embodiment. The management server 2 according to the second embodiment differs from the management server 2 according to the first embodiment in that a real-time delivery unit 123 is added.

[0099] The real-time distribution unit 123 streams the live content data received from the performer shooting device 5 to a specified shooting device 1 in real time. The shooting device 1 to which the data is to be distributed is determined using the shooting device management database stored in the storage unit 23. FIG. 21 is an example of the shooting device management database in the second embodiment. The shooting device management database shown in FIG. 21 has a field for indicating whether or not live streaming is performed in addition to the first embodiment. The real-time distribution unit 123 transmits the received live content data to the shooting device 1 for which the live streaming field in the shooting device management database has a flag of "Yes".

[0100] When the image capturing device 1 receives the live content data from the management database 2, it stores the data in the storage unit 17 and starts capturing an image of the user (subject) with the camera. The captured image is displayed on the display 11. Next, the image processing unit 154 uses a key signal of the live content data to combine a fill signal with the captured image of the user (Step 307 in FIG. 13). Then, the image processing unit 154 displays the combined image (moving image) on the display 11 (Step 308 in FIG. 13). Other processes are the same as those in the first embodiment.

[0101] In the second embodiment, content data is generated from live footage of a performer, and the management device distributes the content data live to each camera. This makes it possible for a single performer to share a space with multiple users in different locations at the same time.

[0102] Although the present invention has been described above with reference to preferred embodiments, the present invention is not necessarily limited to the above-described embodiments, and can be modified and embodied in various ways within the scope of the technical concept thereof. [Explanation of symbols]

[0103] 1. Imaging device 2 Management Server 3. Payment Server 4. Terminal 5 Performer filming equipment 10. Camera 11 Display 12 Speaker 13 Operation input section 14 Near Field Wireless Communication Department 15 Processing section 16 Transmitter / receiver 17 Memory section 20 Input section 21 Transmitter / receiver 22 Processing section 23 Memory section 30 Transmitter / receiver 31 Payment Processing Unit 32 Storage section

Claims

1. A program for a computer including a camera for photographing a user, a display unit, and a storage unit, The program causes the computer to a receiving means for receiving content data including augmented reality video data including a performer's video and a key signal for designating an area on which the performer's video is to be superimposed from a management device for managing content, and storing the content data in the storage unit; an image compositing means for generating a composite image including the user and the performer by combining the image of the performer and the image of the user captured by the camera using the key signal, displaying the composite image on the display unit, and recording at least a part of the composite image as a record image; a transmission means for transmitting the recorded image to the management device; a storage location presenting means for receiving storage location information indicating a storage location of the recorded image from the management device and displaying the information indicating the storage location on the display unit; A program that functions as a

2. the content data includes voice data of the performer; the program causes the computer to function as an audio output means for outputting the voice of the performer in synchronization with the composite image displayed on the display unit, using the audio data; The program according to claim 1.

3. The audio data includes audio of the performer's guidance and a timing for starting shooting of still images, the audio output means outputs, using the audio data, audio of the performer's guidance and a timing for starting shooting in synchronization with the composite image displayed on the display unit; The image synthesis means records a still image of the synthesized image as the recorded image in accordance with a timing to start shooting based on the voice of the performer. The program according to claim 2.

4. A camera for photographing a user; A display unit; A storage unit; a receiving unit that receives content data including augmented reality video data including a performer's video and a key signal that specifies an area on which the performer's video is to be superimposed from a management device that manages content, and stores the content data in the storage unit; an image synthesis unit that uses the key signal to synthesize an image of the performer and an image of the user captured by the camera to generate a synthetic image including the user and the performer, displays the synthetic image on the display unit, and records at least a portion of the synthetic image as a record image; a transmission unit that transmits the recorded image to the management device; a storage location display unit that receives storage location information indicating a storage location of the recorded image from the management device and displays the information indicating the storage location on the display unit; An imaging device comprising:

Images