Remote photography system and remote photography method

Abstract

To provide a video distribution photography service that is not affected by a viewer's viewing communication environment and that provides high-quality still images (photographs) without including miss-shots regardless of the shutter timing. [Solution] Still images are output based on high-quality moving image data that has been shot and edited, so that the shutter output does not produce rough images such as screenshots. Also, still images for the shutter are prepared in advance by removing still images that are considered to be miss-shots from among a plurality of still images that are constructed based on a specified frame rate, and still images that are written out corresponding to the time of shutter operation do not include images of closed eyes, etc. Therefore, even amateur viewers who do not have the shooting techniques of professional cameramen can obtain still images (photos) without miss-shots, and only still images that are permitted by the party that manages the copyrights of the subject images can be provided to the viewers.

Description

[Technical field]

[0001] The present invention relates to a remote photography system and a remote photography method. [Background technology]

[0002] In recent years, applications have emerged that allow users to receive video images captured by a camera via a network, watch them, and send commands equivalent to pressing the shutter at the desired timing, giving the user the experience of taking pictures as if they were actually taking pictures of the subject right in front of them. Viewers can virtually experience the act of filming without actually going to the shooting location, and can get the sense of realism as if they were shooting the subject themselves. Moreover, because it is remotely controlled, filming is possible no matter how far away the location is, and there is no limit on the number of people at the shooting location that makes it impossible to film. Therefore, it is expected that the need for remote filming will continue to grow in the future.

[0003] As a prior document based on a similar concept, for example, there is the following patent document (see Patent Document 1). The photo session system described in Patent Document 1 is configured so that when shooting conditions such as zooming in are sent to a proxy photographer (human or device) who actually photographs the subject at the shooting site, the proxy photographer adjusts the shooting conditions based on the shooting instructions. In addition, a remote photography system has been proposed in which video images captured at a live venue or the like are simultaneously streamed to viewer terminals via a server, and a finger action equivalent to a shutter release is performed on the viewer terminal for a favorite scene (see Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2003-209741 A [Patent Document 2] Patent No. 7288641 Summary of the Invention [Problem to be solved by the invention]

[0005] The invention described in Patent Document 1 is basically targeted at photo sessions with an extremely small number of viewers. Therefore, the proxy photographer can accept requests from viewers and change the shooting conditions each time. However, since the remote photo session system targeted by the present invention is premised on the participation of a large number of viewers, it is practically impossible to accept photo shooting conditions that meet the diverse requests of each viewer. Unlike Patent Document 1, as the number of viewers participating in the photo session system increases, it becomes impossible to proceed with the photo session if it were to respond to the requests of all viewers regarding the designation of the subject to be photographed, the shooting angle, the magnification, etc.

[0006] The invention described in Patent Document 2 is premised on the participation of many viewers, and each viewer can freely decide the desired shooting scene and change the shooting angle, magnification, etc. However, the configuration is such that the shot video data is uploaded to a communication network in real time, received by a server, and then instantly downloaded to the viewer terminal. This uploading and downloading is performed sequentially at a predetermined time interval (for example, 5 seconds, 30 seconds, etc.), and the information on the shutter timing time by each viewer is uploaded to the server in real time every time the shutter is operated, which increases the network load. Therefore, when the network communication environment is poor, the viewed video may be paused or the video may be discontinuously distributed, which may make it difficult to stably distribute the video to the viewer with high quality.

[0007] Also, when people are streaming videos, the viewer may take the picture when they close their eyes, or the subject may move and the shot may be blurred. These are usually shots that should be removed as missed shots, and are not still images that viewers want to obtain. In addition, copyrights and neighboring rights are generated for photos, images, and performances of artists, and it is known that major artists, in particular, have a strong desire to avoid images of NG cuts being exposed on the market as much as possible.

[0008] Therefore, the present invention aims to provide a video distribution shooting service that is not affected by the viewer's viewing communication environment, and that provides high-quality still images (photographs) without any missed shots or NG cuts regardless of the shutter timing. [Means for solving the problem]

[0009] In order to achieve the above object, a remote photography system and method according to the present invention distribute a video for viewing, which is created based on a video image captured by a photography means, to image display terminals of a plurality of users via a communication network, (a) if any effect processing has been applied to the captured video, generating a video without the effect processing; (b) decomposing the moving image into a plurality of still images based on a predetermined frame rate and outputting the still images; (c) generating a reconstructed still image based on still images obtained by removing some still images from the plurality of still images; By doing so, a still image for shutter output is generated, When it is determined that the plurality of users have performed a finger action equivalent to a shutter operation on the image display terminal while viewing the video for viewing, a still image corresponding to the timing of the shutter operation is identified from the still images for shutter output; The specified still image is displayed on an image display terminal of the user.

[0010] The reconstructed still image is characterized in that a still image determined to be an eye-blink or a still image not permitted to be provided to the user is removed from the reconstructed still image. Effect of the Invention

[0011] The remote photography system and method according to the present invention outputs still images based on high-quality video data that has been shot and edited, so that the shutter output does not produce rough images such as screenshots. In addition, still images for shuttering are prepared in advance by removing those treated as miss-shots and those that will become NG cut images from among a plurality of still images that are constructed based on a predetermined frame rate, and only still images provided to the viewer are written out from among these. Therefore, no matter what time the shutter is operated, the still images written out will not contain miss-shot images or NG cut images. Even amateur viewers without advanced photography skills can take pictures at the same level as professional cameramen, and only still images that are permitted by the party that manages the copyrights of the subject images can be provided to the viewer. [Brief description of the drawings]

[0012] [Figure 1] 1 is a diagram showing an overall configuration of an embodiment of a remote photography system; [Diagram 2] 11 is a flowchart showing a process of generating a still image for shutter output. [Diagram 3] FIG. 3A shows the relationship between the video to be viewed and frame images for which cuts to be removed have been specified, and FIG. 3B shows the relationship between shutter timing and still images to be acquired. [Figure 4] FIG. 13 shows an example of a multi-angle screen displayed on a viewing terminal. [Diagram 5] FIG. 13 is a diagram for explaining switching between different display areas based on the same moving image. [Figure 6] FIG. 11 is a diagram illustrating an example of a shutter indicator. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] An embodiment of a remote photography system according to the present invention will be described below with reference to the drawings. The remote photography system 100 is configured by a mutual relationship between a photography event management company 1, a platform management company 2, and a plurality of users 3, and is configured to transmit and receive various data via a communication network 4 such as the Internet. Note that, in this embodiment, photography at a photography venue is described as an example, but the photography does not have to be an indoor space such as a photography venue (including a studio or live venue), and may be taken at any outdoor location (for example, a film location).

[0014] The photography event management company 1 plans the date and time of the photo session, the photography location, and the models and artists who will be the subjects at the photography venue, and announces that the remote photo session will be held through its website, SNS, etc. The platform management company 2, which has a contract with the photography event management company 1 in advance, is a business entity that provides the platform for the remote photography system 100, and is responsible for all technical support required to realize the planned photo session. Since the platform management company 2 provides the platform to the photography event management company 1 on an OEM basis, the photo session is recognized by the user 3 as being held by the photography event management company 1. 1 treats the photography event management company 1 and the platform management company 2 as separate entities, but the effects of the present invention will not change even if the photography event management company 1 and the platform management company 2 are configured as the same entity to configure the remote photography system 100. Also, the platform management company 2 may notify users of the event on behalf of the photography event management company 1.

[0015] The photography event management company 1 accepts applications for participation in a remote photography session from users via a communication network 4. The photography event management company 1 edits the captured video and accompanying audio (hereinafter referred to as "captured video") to create a video for viewing, and stores it in an information processing device (including, for example, a server or a television editing machine, hereinafter referred to as "server"). The video for viewing uploaded from the server is provided to the user 3 via the communication network 4. In this embodiment, the platform management company 2 owns and manages the server, but it may be a server within the photography event management company 1, or may be a virtual server on the cloud. Hereinafter, the server is also referred to as a "cloud server."

[0016] At the shooting location, one or more shooting devices 6 (hereinafter referred to as "cameras 6") for shooting the subject are installed, and preparations are made for shooting video and audio recording. At the shooting location, a person may hold the camera 6 and shoot, or the camera 6 may be automatically controlled without human intervention by a command signal from a server. Also, in this embodiment, an example is shown in which the subject is shot with multiple cameras 6 (including, for example, multiple cameras installed around the subject at 180 degrees or 360 degrees), but shooting with a single camera 6 is also possible.

[0017] Promotional videos and music videos are edited, but the filmed video stored in the server in the present invention is also edited for video and still images using a video / still image editor. The filmed video is appropriately edited and provided to the user 3 as a video to be viewed. There are various editing methods, but typical ones include multi-camera editing, which switches between scenes by simultaneously playing back footage shot from various angles by multiple cameras 6, noise removal, overlaying arbitrary images, and text insertion. Other editing methods include arbitrary editing processes such as image stabilization and the addition of special visual and audio effects. In this embodiment, the images to be viewed are generated by editing the shot moving images, but there may be cases where the shot moving images are directly distributed to the viewer as the images to be viewed.

[0018] Participants 3, who are users participating in the photo session, have viewing terminals 3-1 to 3-N (hereinafter referred to as "viewing terminal 3N") and view images for viewing via communication network 4. When receiving distribution of images for viewing, viewing terminal 3N is connected to communication network 4. When distribution of images for viewing begins, participants 3 who have registered for participation view the images on their own viewing terminals 3N, and since icon 7 equivalent to a shutter operation is displayed on the application screen of viewing terminal 3N, participants 3 press icon 7 at any timing to perform a so-called shutter operation.

[0019] By operating the shutter, the participant 3 can obtain a still image (sometimes called a "frame image") of his / her favorite scene. The present invention is characterized by the method of writing out this still image, which will now be described. First, it is necessary to prepare a still image for shutter output, which is different from the video to be viewed, before viewing. Figure 2 is a flowchart showing the process of generating a still image for shutter output.

[0020] As shown in FIG. 2, the video to be viewed stored in the server is read (step S20). As described above, the video to be viewed is edited in various ways, so a moving image is generated with the effects applied to the image and sound removed (step S21). The effects include image synthesis, color expression, and echo processing, and specifically, for example, adding some kind of effect such as adding an environmental effect such as thunder or rain, giving a blurred or uneven effect to the completed image, or using special sounds such as scratching or horns. In step S21, a process is performed to remove the effects related to visual effects (however, the process of removing the effects related to sound is not excluded). In the case of a conventional general remote shooting system, if the liquid crystal screen of the viewing terminal 3N supports FHD (1920×1080 pixels), high-quality still images (frame images) are not extracted and provided. In contrast, the remote photography system 100 of this embodiment captures images based on ultra-high resolution, high definition video quality such as 8K (7680 x 4320 pixels) or 4K (3840 x 2160 pixels), and generates high-quality video by removing effects from the high-quality viewing video in order to provide high-definition still images such as 8K or 4K to the participant 3 even if the LCD screen of the viewing terminal 3N is of FHD quality.

[0021] Next, from the video generated in step S21, multiple still images based on a predetermined frame rate are output (step S22). That is, the video is decomposed into multiple frame images. When the distributed video is 4K images and 30 fps (a frame rate consisting of 30 images per second), each frame image can be identified by the elapsed time added 1 / 30 = 0.0333 seconds from the start time of the video distribution for viewing. Note that in other embodiments, the effect may not be removed (i.e., step 21 may not be performed) and the process may proceed directly from step 20 to step 22.

[0022] Next, some still images are removed from the multiple frame images created in step S22 (step S23). The still images to be removed include those containing closed eyes, inappropriate poses, etc. In addition, NG cut images that are not permitted by the party managing the copyright, such as the artist, are also removed. Hereinafter, these are collectively referred to as NG cuts. FIG. 3(A) shows the relationship between the edited video for viewing and a plurality of frame images designated as NG cuts that are determined to be removed. FIG. 3(A) shows an example of still images written out from a video for viewing of 30 frames per second with effects removed, in which frames 4, 5, 11, 12, 13, 21, 22, and 27 are designated as NG cuts due to reasons such as eye closure. A reconstructed still image composed of a plurality of frame images from which such NG cuts have been omitted is stored in the server (step S24). Note that it is also possible to make the reconstructed still images correspond to NG cuts by artificially omitting the NG cuts through software processing using flags, tables, etc. so that it is possible to identify which frames are NG cuts, without actually removing some of the still images corresponding to the NG cuts.

[0023] In this embodiment, which frame images are designated as NG cuts are decided manually, but the selection of NG cuts may also be performed automatically using an image recognition application such as face recognition software or eye tracking software, or an AI application.

[0024] Next, the reconstructed still image created in step S24 is retouched (step S25) to construct a still image for shutter output, which is stored in the server (step S26). Retouching includes, for example, image processing such as adjusting the skin color of the subject, making the skin condition finer, correcting parts of the face or body such as enlarging the eyes, and changing the background color or the color of the clothes. It may also include processing for adding and deleting objects not included in the reconstructed still image, such as brightening only specific parts, erasing unnecessary objects, and compositing absentees into a group photo, and there are no particular restrictions on the type or content of retouching. Note that retouching is not necessarily required, and may be performed as necessary.

[0025] After preparing the still image for shutter output in this manner, the video for viewing is distributed to the participants 3. The distribution start time of the video for viewing is centrally managed by a server connected to the communication network 4, and the shutter operation time of each participant 3 is managed in relation to the start time of the video to be distributed. In other words, the elapsed time from the start time of the video to be distributed represents the shutter operation time. When the video for viewing is distributed to multiple participants simultaneously, the server manages a single start time common to each participant, but when the start time is shifted for each participant, the server manages the start time corresponding to each participant.

[0026] The time when the participant 3 participating in the photo session operates the shutter on the video received on their viewing terminal 3N is transmitted to the server in real time and recorded on the server side. The time is treated as a UNIX (registered trademark) timestamp in a format of seconds or milliseconds, and it is possible to identify the frame image corresponding to the time when the participant 3 operated the shutter based on the elapsed time from the start time of the distributed video (which is also recorded as a UNIX (registered trademark) timestamp).

[0027] Even if a latency delay occurs due to the communication environment of the viewing terminal 3N, the remote photography system 100 of this embodiment maintains low latency so that communication for recording the shutter operation time is kept within milliseconds. Even if a participant operates the shutter while a video for viewing is being distributed and a problem occurs such as a disconnection from the Internet while on the move or entering a space such as a building with poor communication environment, the viewing terminal temporarily caches the shutter operation time in the platform installed in the viewing terminal 3N for video distribution, and automatically resynchronizes when the connection is restored. Therefore, measures are taken to prevent the server from failing to record the operation time even though a participant operates the shutter.

[0028] The video for viewing is displayed on the viewing terminal 3N, and the participant 3 can press the icon 7 on the viewing terminal 3N at the timing of his / her choice while watching the video to obtain a still image of his / her favorite scene. However, a feature of the present invention is that the still image obtained does not always strictly match the shutter timing. Figure 3(B) is a diagram showing the relationship between the shutter timing by the participant 3 and the still image obtained.

[0029] The 30th frame in FIG. 3(B) is related to FIG. 3(A), and the frames 4, 5, 11, 12, 13, 21, 22, and 27 are NG cuts. If the shutter timing T1 of participant 3 matches the 4th frame (or can be considered to match within a certain time range, and so on), the 4th frame is an NG cut, so the still image of the 3rd frame, which is a non-NG cut closest to T1, is extracted. Similarly, if the shutter timing T2 of participant 3 matches the 11th frame, the still image of the 10th frame, which is a non-NG cut closest to T2, is extracted. The same applies to shutter timing T4. Of course, if the shutter timing of participant 3 corresponds to a still image of a non-NG cut, the still image of that frame is extracted (for example, the 17th frame of T3 or the 29th frame of T6). Furthermore, if the shutter timing T5 of participant 3 is the 27th frame, then since the 27th frame is a NG shot, it is determined whether the 26th or 28th frame, which is a non-NG shot, is closest to the shutter timing in question, by how many milliseconds.

[0030] Taking 4K30fps as an example, the time lag between frames is only 0.0333 seconds as mentioned above, so participant 3 perceives that a still image of the shutter timing has been cut out, and does not recognize that frames around the shutter timing that do not strictly match have been cut out. Therefore, when participant 3 presses icon 7 to take the shutter while watching the video for viewing, he or she can experience as if a high-quality still image corresponding to the shutter timing has been taken, and furthermore, since the still image obtained is extracted from the shutter output still image that does not include NG shots such as blinking, it is guaranteed that it does not include miss shots. In addition, the artist management side can prevent NG shot images from being distributed on the market.

[0031] The still image (frame image) extracted by operating the shutter is displayed in real time on the viewing terminal 3N, and the latest still image is displayed. The reason why the image corresponding to the time when the shutter was operated during shooting is displayed, rather than after the end of the distribution of the video for viewing, is that the participant 3 can immediately check the extracted frame image on the viewing terminal 3N, and can immediately reshoot if the expected image was not captured. The same feeling as being able to check the image immediately after shooting on the LCD monitor of a digital camera when shooting normally can be experienced in the shooting operation of the remote shooting system 100 of this embodiment, and it is possible to get a sense of realism in shooting.

[0032] However, instead of displaying only the most recent still image, the captured still images may be displayed in a sequentially added manner, or if the screen size of the viewing terminal 3N is small and the display area for the video to be viewed is small, the captured still images may be displayed together after viewing has ended in a scroll display. Although it has been described that one still image is cut out by operating the shutter, it goes without saying that the mechanism may be such that, if the icon 7 is held down, corresponding still images are cut out continuously, and the video is essentially played.

[0033] When the viewer 3 presses the shutter 7 at a desired timing, a charge may be made according to the number of times the shutter is pressed, or a shutter count limit may be set, such as 100 times or 200 times, in the distribution of the video for viewing 1. The shutter fee may be free, or a bulk fee may be set for every 100 times.

[0034] The number of shutter operations by the participant 3 while watching the video for viewing is statistical data based on the actual actions of the participant 3, which leads to quantifying emotions through shutter operations. For example, if the photoshoot is a fashion show, styling data can be compiled, making it possible to understand the trends in clothing that many participants prefer. Also, if the photoshoot is an open model audition, popularity data can be compiled, and if the photoshoot is featuring influencers, popular points can be analyzed by looking at the facial expressions and poses that are frequently captured, making it possible to apply them to other models. Therefore, the photoshoot event management company 1 can sell the number of shutter operations sent to the server.

[0035] Also, the still image captured by the shutter operation can be understood for each participant 3. Furthermore, the remote photography system 100 of this embodiment incorporates information for identifying the participant 3 who operated the shutter into each still image, and then provides the still image to each participant 3. For example, "Captured by ABC" (ABC is the ID, name, etc. unique to each participant) is superimposed and displayed in small font at the bottom of each still image. This gives each participant 3 the feeling that the still image is unique to him or her.

[0036] Furthermore, if the participant 3 processes this identification information so that it cannot be erased, there is an advantage that even if the still image is distributed without permission from the copyright holder, etc., the participant 3 who leaked it without permission can be identified from the identification information. Note that the superimposition may be in the form of a watermark or hidden display so that it is not immediately obvious that the identification information has been incorporated into the still image.

[0037] 4 shows an example of a screen displayed on the viewing terminal 3N of a participant who participates in a photo session and watches the viewing videos. The remote photography system 100 of this embodiment photographs a subject with multiple cameras 6. Therefore, multiple viewing videos in which the subject is photographed from angles corresponding to the number of cameras are displayed on the viewing terminal 3N. Specifically, as shown in FIG. 4, different viewing videos are displayed on the screen, divided into multiple sections 41-45. That is, this is an example of a multi-angle screen in which videos for viewing from multiple cameras are simultaneously split and displayed on the viewing terminal 3N. This matches the number of cameras used in the photo session, and each camera has a different position, direction, and angle relative to the subject, resulting in different videos for viewing.

[0038] The participant 3 selects an image from a desired camera from among the videos for viewing from the multiple cameras 6 displayed on the viewing terminal 3N, for example by tapping on the display area of ​​the image, and only the image from that camera is enlarged and displayed 45 on all or part of the screen, and the participant 3 can press the shutter button 7 at any time. If the participant 3 wishes to select an image from a different camera 6, he or she can repeat the clicking operation from the multiple videos for viewing shown in FIG.

[0039] A multi-angle screen display as shown in FIG. 4 is very convenient for a photo shoot with many participants 3. This is because each viewer can select a video from a camera with their preferred angle (shooting angle and position), and the video can be adapted to the preferences of almost all participants. Furthermore, the present invention adjusts the angle by switching the displayable area from the viewpoint of accurately responding to the needs of many participants. In other words, the screen resolution on the viewing terminal of the participants is generally set to FHD (1920 x 1080 pixels), but in actual video shooting, for example, the displayable area can be changed by shooting based on the image quality of ultra-high resolution and high definition video of 8K (7680 x 4320 pixels) or 4K (3840 x 2160 pixels).

[0040] Figure 5 shows an example of the image range for each of FHD, 4K, and 8K. Each participant 3 can use finger operations such as tapping and pinching to change the area on the viewing terminal, or mouse operations to move between the displayable area outside the first area, the FHD range 51, to the second area (4K) 52 and the third area (8K) 53, so that each viewer can flexibly adjust the angle of view (wide angle, standard, telephoto). As a result, it is possible to provide an experience that makes it feel as if the viewer themselves were using the camera 6 at the shooting site to adjust the angle of view.

[0041] It goes without saying that the resolution of the video to be shot is not fixed or limited to 8K or 4K, but will be increased in line with developments in communication technology, liquid crystal display technology, etc. Furthermore, the settings of the shooting size and framing ratio when the viewer changes the displayable area on the viewing terminal can be changed to any value desired by each viewer in accordance with the framing of the liquid crystal monitor of the viewing terminal.

[0042] The change in the displayable area by switching the image quality described above is particularly useful when multiple viewers take pictures based on an image captured by a single camera. This is a photoshoot with one camera and many viewers. It is difficult to meet the needs of many viewers with a fixed angle of one camera, but the present invention allows each viewer to freely select the area size on their viewing terminal based on the video captured by a single camera. However, this is also effective in the case of using multiple cameras as in this embodiment. Since it is equivalent to shooting with multiple cameras multiplied by N, it is possible to precisely respond to the shooting operation instructions such as zooming in / out that each viewer desires, no matter how large the number of viewers.

[0043] The present invention allows viewers to take pictures at their own convenience from the distribution of videos for viewing, but it is premised on the assumption that many viewers are watching "at the same time." In such a viewing situation, an image taken at the time when many participants 3 take pictures is often considered to be a scene that should be taken, that is, an optimal scene to be cut out.

[0044] However, each participant in a video for viewing that is remotely shot does not know when other participants are taking pictures. If you go to an actual shooting venue to take pictures, you can tell that many other people will be taking pictures, so you can recognize that now is a good time to take a picture and take a picture. However, with a remote shooting system like the present invention, you cannot know when other people will be taking pictures, so there is a possibility that you will regret later that you should have taken a picture.

[0045] Therefore, the remote photography system of the second embodiment includes a configuration that utilizes the fact that the time of each participant's shutter operation is transmitted to the server in real time, and allows the shutter status of other participants to be grasped in a visible display in real time. For example, as shown in Fig. 6, shutter indicators 61-65 are provided on each of the multi-angle screens 41-45, and an indicator value indicating the current total number of shutters is displayed. This indicates the total number of shutters from the current time to 5 seconds ago, for example, and is updated every 5 seconds. Here, 5 seconds is just an example, and may be set to any number of seconds. For example, participant A had planned to take a picture from the video for viewing with a camera angle corresponding to section 41, but when he sees shutter indicator 62 on the multi-angle screen, he realizes that many participants are taking pictures from the video for viewing with a camera angle corresponding to section 42. Viewer A can then switch from the camera angle of section 41 to the camera angle of section 42, and take pictures of the scenes that other viewers are focusing on in the same way.

[0046] As a method of displaying the indicator other than that shown in Fig. 6, for example, when a camera with a certain ratio of the participants (e.g. more than half) has shuttered, the screen frame 41-45 on the multi-angle screen corresponding to that camera is highlighted, or the size of the screen frame 41-45 is relatively enlarged to display it prominently, etc. Also, an indicator showing the number of shutters as a curve graph may be used.

[0047] The remote shooting system of the third embodiment is characterized in that a server generates 3D data from video image data captured by multiple cameras 6 capturing 360 degrees around a subject using volumetric technology, and distributes the data to a viewing terminal 3N. Volumetric technology uses a 360-degree green screen as the background for filming, shoots the subject, and generates 3D data after filming. By filming against a green screen, video data of the subject can be synthesized into a rendered virtual background such as VR (virtual reality), AR (augmented reality), or MR (mixed reality), and image processing and effects can be added freely.

[0048] This allows participants to experience the freedom to move around freely from any angle or viewpoint, and to operate the shutter. By using volumetric shooting data, it is possible to switch between free viewpoint images and multiple free viewpoint images, such as the camera slipping between subjects as if in a game, looking down on them from mid-air.

[0049] The remote photography system according to the above-mentioned embodiments enables one video stream distributed to a large number of viewers to meet the requests of all viewers, such as shooting angle, position, zoom in / out, and other shooting operation instructions. It also supports viewers to cut out the best shot image from a free viewpoint. Furthermore, it enables virtual photo sessions in a virtual reality world (such as the metaverse) and the management of a photo studio.

[0050] The above-mentioned server processing may be executed by a mobile phone, a personal computer, or a data relay. The present invention also includes within its scope the programs installed or loaded into a computer through various recording media, such as optical disks such as CD-ROMs, magnetic disks, and semiconductor memories, or by downloading via a communication network, and these storage media.

[0051] Furthermore, the viewing terminal that communicates with the remote photography system via the communication network is a computer connected to a network such as the Internet or a dedicated line. Specific examples include PCs (Personal Computers), mobile phones, smartphones, PDAs (Personal Digital Assistants), tablets, and wearable terminals. A business scheme including the remote photography system is formed by setting the PC terminal and the mobile terminal connected to the communication network by wire or wirelessly so as to be able to communicate with each other. [Explanation of symbols]

[0052] 1. Photo event management company 2. Platform operator 3 participants 3N viewing terminal 4. Communication Network 6. Camera 7 Shutter icon 100 Remote photography system

Claims

1. A remote photography system that provides a simulated photography experience by distributing a video for viewing, which is created based on a video captured by a photography means, to image display terminals of a plurality of users via a communication network, (a) if any effect processing has been applied to the captured video, generating a video without the effect processing; (b) decomposing the moving image into a plurality of still images based on a predetermined frame rate and outputting the still images; (c) generating a reconstructed still image based on still images obtained by removing some still images from the plurality of still images; By doing so, a still image for shutter output is generated, When it is determined that the plurality of users have performed a finger action equivalent to a shutter operation on the image display terminal while viewing the video for viewing, a still image corresponding to the timing of the shutter operation is identified from the still images for shutter output; displaying the specified still image on an image display terminal of the user; A remote photography system comprising:

2. The remote photography system according to claim 1 , wherein in (c), from the reconstructed still image, a still image determined to be an eye-blinking image or a still image that is not permitted to be provided to the user is removed.

3. The remote photography system of claim 1, further comprising at least one of generating the captured video as the video without removing the effect processing even if the captured video has been subjected to effect processing, or performing retouching processing on the reconstructed still image.

4. A plurality of the imaging means are provided, 2. The remote photography system of claim 1, wherein a viewing video from a desired photographing means can be selected from among the viewing videos corresponding to each photographing means displayed simultaneously on each image display terminal of the multiple users, and a displayable area of ​​the viewing video is dynamically switched for each user according to the specification of each of the multiple users during distribution of the viewing video.

5. 5. The remote photography system according to claim 4, wherein an indicator that enables a user to recognize in real time a situation in which another user is performing a shutter operation on the video for viewing is displayed on the image display terminal.

6. The remote photography system according to claim 1 , further comprising analyzing preferences of the plurality of users based on the number of finger actions corresponding to the shutter operation.

7. 2. The remote photography system according to claim 1, wherein the video image captured by the photography means is synthesized in a digital virtual space displaying an arbitrary background and delivered to the image display terminal.

8. 2. The remote photography system according to claim 1, wherein a still image displayed on the image display terminal of the user includes information for identifying the user.

9. A remote shooting method executed by an information processing device that distributes a video for viewing created based on a captured video image acquired by a shooting means to image display terminals of multiple users via a communication network, comprising: (a) if any effect processing has been applied to the captured video, generating a video without the effect processing; (b) decomposing the moving image into a plurality of still images based on a predetermined frame rate and outputting the still images; (c) generating a reconstructed still image based on still images obtained by removing some still images from the plurality of still images; A still image for shutter output is generated by When it is determined that the plurality of users have performed a finger action equivalent to a shutter operation on the image display terminal while viewing the video for viewing, a process of identifying a still image corresponding to the timing of the shutter operation from among the still images for shutter output; A process of displaying the specified still image on an image display terminal of the user; A remote photography method in which the above is performed.

Images