Remote shooting system and remote shooting method

Abstract

This video streaming service aims to provide high-quality still images (photographs) that are unaffected by the viewer's internet connection environment, and that do not include any misfires regardless of the shutter timing. [Solution] Because still images are output based on high-quality video data captured and edited, the shutter output will not be a low-resolution image like a screenshot. Furthermore, a still image for the shutter is prepared in advance by removing any mis-shots from multiple still images composed based on a predetermined frame rate, so that the still image written in response to the shutter operation does not include images with closed eyes or other imperfections. Therefore, even amateur viewers who do not possess the shooting skills of a professional photographer can obtain still images (photographs) without mis-shots, and only still images permitted by those managing the copyright of the subject images can be provided to the viewer.

Description

Technical Field

[0001] The present invention relates to a remote shooting system and a remote shooting method.

Background Art

[0002] In recent years, applications have emerged that allow users to receive and view moving images captured by a camera via a network and send an instruction equivalent to pressing the shutter at a desired timing, thereby obtaining an experience as if shooting a subject right in front of them. Viewers can simulate the shooting action without actually going to the shooting location and can experience a sense of presence as if they were shooting the subject themselves. Moreover, since it is a remote operation, shooting is possible regardless of how far away the location is physically, and there is no situation where shooting becomes impossible due to a limit on the number of people at the shooting site. Therefore, the need for remote shooting is expected to increase in the future.

[0003] As a prior art document based on a similar concept, for example, there is the following patent document (see Patent Document 1). The shooting meeting system described in Patent Document 1 is configured to send shooting conditions such as zooming up to a shooting agent (human or device) that actually shoots a subject at the shooting site, and the proxy shooter adjusts the shooting conditions based on the shooting instruction. In addition, a remote shooting system has been proposed that distributes moving images captured at a live venue or the like to viewer terminals via a server in a batch and executes a finger action equivalent to a shutter operation on the viewer terminal for a favorite scene (see Patent Document 2).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

[0005] The invention described in Patent Document 1 is basically intended for photo shoots with a very small audience. Therefore, the substitute photographer can accept requests from the audience and change the shooting conditions each time. However, since the remote photo shoot system covered by the present invention is based on the premise that a large number of viewers will participate, it is practically impossible to accept shooting conditions that match the diverse requests of each viewer. Unlike Patent Document 1, as the number of viewers participating in the photo shoot system increases, it becomes impossible to proceed with the photo shoot if all viewers' requests for shooting subjects, shooting angles, magnification, etc., are met.

[0006] The invention described in Patent Document 2 is based on the premise that a large number of viewers will participate, and each viewer can freely decide on their desired shooting scene and change the shooting angle, magnification, etc. However, the configuration involves uploading the recorded video data to a communication network in real time, receiving it on a server, and then instantly downloading the video data to the viewer's terminal. This upload and download is performed sequentially at predetermined time intervals (for example, 5 seconds, 30 seconds, etc.), and in addition, information on the shutter timing time by each viewer is uploaded to the server in real time each time the shutter is operated, which results in a large network load. Therefore, if the network communication environment is poor, problems arise in that it is difficult to deliver high-quality and stable video to viewers, such as the video being paused or the video being streamed discontinuously.

[0007] Furthermore, in live video streams of people, viewers often take photos at the moment the subject's eyes are closed, or the trajectory of a moving subject is captured in the image, resulting in blurry footage. These are generally considered mis-shots that should be removed, not still images that viewers want. In addition, copyrights and related rights apply to photographs, images, and performances of artists, and it is known that there is a strong desire to avoid, as much as possible, the exposure of unusable images to the market, especially for major artists.

[0008] Therefore, the present invention aims to provide a video streaming shooting service that is not affected by the viewer's viewing and communication environment, and that provides high-quality still images (photographs) that do not include mis-shots or unusable cuts regardless of the shutter timing. [Means for solving the problem]

[0009] To achieve the aforementioned objective, the remote shooting system and method according to the present invention distributes a video for viewing, created based on captured video images acquired by a shooting means, to multiple users' image display terminals via a communication network. (a) If any effect processing has been applied to the captured video, a video without the effect processing will be generated. (b) The video is decomposed into a plurality of still images based on a predetermined frame rate and output, (c) A reconstructed still image is generated based on the still images obtained by removing some of the multiple still images mentioned above. This generates a still image for shutter output, If it is determined that multiple users perform a finger action equivalent to a shutter operation on the image display terminal while viewing the aforementioned video, the still image corresponding to the timing of the shutter operation is identified from the shutter output still images. The identified still image is displayed on the user's image display terminal.

[0010] Furthermore, the reconstructed still image is characterized in that still images in which the user's eyes are closed or still images that are not permitted to be provided to the user have been removed. [Effects of the Invention]

[0011] The remote shooting system and method according to the present invention output still images based on high-quality video data captured and edited, so that the shutter output does not consist of low-resolution images like so-called screenshots. Furthermore, a set of still images for the shutter is prepared in advance by removing images that are treated as mis-shots or unacceptable cuts from a plurality of still images composed based on a predetermined frame rate, and only still images from this set are written out to be provided to the viewer. Therefore, no matter when the shutter is operated, the still images written out will not include mis-shot images or unacceptable cuts. Even amateur viewers without advanced shooting skills can take photos at the same level as professional photographers, and only still images permitted by the copyright management of the subject images can be provided to the viewer. [Brief explanation of the drawing]

[0012] [Figure 1] This diagram shows the overall configuration of one embodiment of a remote imaging system. [Figure 2] This is a flowchart illustrating the process of generating a still image for shutter output. [Figure 3] Figure 3(A) shows the relationship between the video for viewing and the frame images in which cuts to be removed are specified, and Figure 3(B) shows the relationship between the shutter timing and the still image to be acquired. [Figure 4] This diagram shows an example of a multi-angle screen displayed on a viewing device. [Figure 5] This diagram illustrates how to switch between different display areas based on the same video image. [Figure 6] This figure shows an example of a shutter indicator. [Modes for carrying out the invention]

[0013] Hereinafter, an embodiment of a remote photography system according to the present invention will be described while referring to the drawings. FIG. 1 shows the overall configuration of the remote photography system 100. The remote photography system 100 is composed of the interrelationship among a photography event operating company 1, a platform operating company 2, and a plurality of users 3, and is configured to transmit and receive various data via a communication network 4 such as the Internet. In this embodiment, although the photography at the photography venue will be described as an example, it is not necessary that the venue must be an indoor space such as a photography venue (including studios, live venues, etc.), and photography at any outdoor location (for example, a filming location, etc.) may also be possible.

[0014] The photography event operating company 1 plans the date and time of the photography event, the photography location, models, artists, etc. who will be the subjects at the photography venue, and notifies that a remote photography event will be held through a homepage, SNS, etc. The platform operating company 2 that has contracted with the photography event operating company 1 in advance is an entity that provides the platform of the remote photography system 100 and is responsible for all technical support necessary to realize the planned photography event. Since the platform operating company 2 provides the platform to the photography event operating company 1 on an OEM basis, the photography event is recognized by the user 3 as being implemented by the photography event operating company 1. Note that the remote photography system 100 shown in FIG. 1 treats the photography event operating company 1 and the platform operating company 2 as separate entities, but there is no change in the operational effects of the present invention even if the photography event operating company 1 and the platform operating company 2 constitute the remote photography system 100 as the same entity. Also, the event notice to the user may be made by the platform operating company 2 instead of the photography event operating company 1.

[0015] The photography event management company 1 accepts applications from users to participate in the remote photography session via the communication network 4. The photography event management company 1 edits the captured moving images and the accompanying audio (hereinafter referred to as "captured moving images") to create a viewing video and stores it in an information processing device (including, for example, a server or an editing machine of a TV, etc. Hereinafter, it is described as a "server"). The viewing video uploaded from the server is provided to the user 3 via the communication network 4. In this embodiment, the platform operation company 2 owns and manages the server, but it may be a server within the photography event management company 1, or even a virtual server on the cloud. Hereinafter, the server is also referred to as a "cloud server".

[0016] At the photography venue, one or more photographing devices 6 (hereinafter referred to as "cameras 6") for photographing the subject are installed, and preparations for photographing and recording moving images are made. At the photography venue, a person may hold the camera 6 to take pictures, or the camera 6 may be automatically controlled without human intervention according to a command signal from the server. In this embodiment, an example of photographing a subject with a plurality of cameras 6 (including installing a plurality of cameras around the subject, such as 180 degrees or 360 degrees) is shown, but it may also be photographing with a single camera 6.

[0017] Promotional videos and music videos are video-edited, but the captured moving images stored in the server in the present invention are also edited for video and still images using a video / still image editor. The appropriately edited captured moving images are provided to the user 3 as a viewing video. There are various editing methods, but typical ones include multi-cam editing where scenes are switched one after another by switching scenes while playing back videos taken from various angles with a plurality of cameras 6 simultaneously, noise removal, overlaying arbitrary videos, text insertion, etc. It also includes arbitrary editing processes such as shake correction and addition of special visual and acoustic effects. In this embodiment, the one generated by editing the captured moving images is used as the viewing image, but there may be cases where the captured moving images are directly distributed to viewers as the viewing images. [[ID=eleven]]

[0018] Participant 3, a user participating in the photo shoot, possesses a viewing device 3-1 to 3-N (hereinafter referred to as "viewing device 3N") and will view the images via the communication network 4. When receiving the images for viewing, the viewing device 3N must be connected to the communication network 4. When the distribution of the images for viewing begins, the registered participant 3 will view the images on their respective viewing device 3N, and an icon 7, which corresponds to the shutter operation, will be displayed on the app screen of the viewing device 3N. Participant 3 will press icon 7 at any time to perform the so-called shutter operation.

[0019] By operating the shutter, participant 3 will obtain a still image (sometimes called a "frame image") of their favorite scene. The present invention is characterized by its method of exporting these still images, which will be explained below. First, it is necessary to prepare still images for shutter output, which are different from the video to be viewed, in advance before viewing. Figure 2 is a flowchart showing the process of generating still images for shutter output.

[0020] As shown in Figure 2, the video for viewing stored on the server is read (step S20). As mentioned above, the video for viewing has undergone various video editing, so a video is generated with the effects applied to the image and sound removed (step S21). Effects include video compositing, color expression, and echo processing, but specifically, they include adding environmental effects such as thunder and rain, applying blurring or bumpy effects to the finished image, or using special sounds such as scratches or horns. In step S21, the process of removing effects related to visual effects is performed (however, the process of removing effects related to sound is not excluded). In the case of conventional remote shooting systems, if the LCD screen of the viewing terminal 3N is FHD (1920 x 1080 pixels) compatible, there is no need to extract and provide high-resolution still images (frame images). In contrast, the remote shooting system 100 of this embodiment shoots based on the image quality of ultra-high resolution, high-definition video such as 8K (7680 x 4320 pixels) or 4K (3840 x 2160 pixels). Even if the LCD screen of the viewing terminal 3N is FHD quality, a high-quality video is generated by removing effects from a high-quality video for viewing in order to provide high-definition still images such as 8K or 4K to the participant 3.

[0021] Next, multiple still images based on a predetermined frame rate are output from the video generated in step S21 (step S22). In other words, the video is decomposed into multiple still images. If the streamed video is 4K and 30fps (a frame rate consisting of 30 images per second), each still image can be identified by the elapsed time obtained by adding 1 / 30 = 0.0333 seconds from the start time of the video streaming for viewing. In other embodiments, the effects may not be removed (i.e., step 21 may not be performed), and the process may proceed directly from step 20 to step 22.

[0022] Next, some still images are removed from the multiple frame images created in step S22 (step S23). The still images to be removed include those with closed eyes or inappropriate posing. Also, NG cut images that are not acceptable to the copyright holders of artists, etc., are removed. Hereafter, these will be collectively referred to as NG cuts. Figure 3(A) shows the relationship between an edited video for viewing and multiple frame images designated as NG cuts that should be removed. Figure 3(A) uses still images exported from a video for viewing with 30 frames per second and no effects removed as an example, with frames 4, 5, 11, 12, 13, 21, 22, and 27 designated as NG cuts due to reasons such as eyes being closed. The server stores a reconstructed still image composed of multiple frame images from which such NG cuts have been removed (step S24). Alternatively, instead of actually removing some still images that correspond to NG cuts, the reconstructed still image may be created by using software processing with flags or tables to identify which frames are NG cuts and simulate the removal of NG cuts.

[0023] In this embodiment, the selection of which frames to designate as NG cuts is done manually, but the selection of NG cuts may be automated using image recognition applications such as face recognition software or eye-tracking software, or AI applications.

[0024] Next, the reconstructed still image created in step S24 is retouched (step S25) to construct a still image for shutter output and store it on the server (step S26). Retouching includes, for example, image processing such as adjusting the skin tone of the subject, refining the skin texture, correcting facial or body parts such as enlarging the eyes, and changing the background color or clothing color. It may also include processing to add and delete objects not included in the reconstructed still image, such as brightening only specific parts, removing unwanted objects, or compositing absentees into a group photo, and there are no particular restrictions on the type or content of retouching. It should be noted that retouching is not always required and should be done as needed.

[0025] After preparing the still images for shutter output in this manner, the viewing video is distributed to participant 3. The start time of the viewing video distribution is centrally managed by a server connected to the communication network 4, and the shutter operation time for each participant 3 is managed in relation to the start time of the distributed video. In other words, the elapsed time from the start time of the distributed video represents the shutter operation time. When the viewing video is distributed to multiple participants simultaneously, the server manages one common start time for all participants, but when the start times are staggered for each participant, the server manages the start time corresponding to each participant.

[0026] The time at which each participant 3 takes a shutter operation on the video received by their viewing device 3N during the photo shoot is transmitted to the server in real time and recorded on the server side. This time is treated as a UNIX® timestamp in seconds or milliseconds format, and based on the elapsed time starting from the start time of the distributed video (which is also recorded as a UNIX® timestamp), it is possible to identify the frame image corresponding to the time when participant 3 took a shutter operation.

[0027] Furthermore, even if latency delays occur due to the communication environment of the viewing terminal 3N, the remote shooting system 100 of this embodiment maintains low latency so that communication for recording the shutter operation time is kept within milliseconds. Even if a participant operates the shutter while streaming a video for viewing, and a problem occurs such as being on the move or entering a space with a poor communication environment, such as a building, causing the internet connection to be lost, the platform installed on the viewing terminal 3N for video streaming temporarily caches the shutter operation time on the viewing terminal side, and automatically resynchronizes once the connection is restored. Therefore, measures are taken to ensure that the server does not fail to record the operation time even if the participant operates the shutter.

[0028] Participant 3 can view a video on the viewing terminal 3N, and by pressing icon 7 on the viewing terminal 3N at their desired timing while watching the video, they can acquire a still image of their favorite scene. However, a characteristic of the present invention is that the acquired still image does not always precisely coincide with the shutter timing. Figure 3(B) shows the relationship between the shutter timing by participant 3 and the acquired still image.

[0029] The 30 frames in Figure 3(B) are related to Figure 3(A), and frames 4, 5, 11, 12, 13, 21, 22, and 27 are NG shots. If participant 3's shutter timing T1 matches frame 4 (or can be considered to match within a predetermined time range, and so on), since frame 4 is an NG shot, the still image of frame 3, which is the closest non-NG shot to T1, is extracted. Similarly, if participant 3's shutter timing T2 matches frame 11, the still image of frame 10, which is the closest non-NG shot to T2, is extracted. The same applies to shutter timing T4. Of course, if participant 3's shutter timing corresponds to a still image of a non-NG shot, the still image of that frame is extracted (for example, frame 17 of T3 or frame 29 of T6). Furthermore, if participant 3's shutter timing T5 is at frame 27, then frame 27 is an unacceptable shot. Therefore, the system determines which of the non-unacceptable shots, frame 26 or frame 28, is closer to that shutter timing by a fraction of a second and makes a decision.

[0030] Taking 4K30fps as an example, the time lag between frames is only 0.0333 seconds, as mentioned above. Therefore, participant 3 perceives that a still image at the exact shutter timing has been extracted, and does not recognize that frames around the shutter timing, which do not strictly match, have been extracted. Consequently, when participant 3 presses icon 7 to take a picture while watching the video, they can experience taking a high-resolution still image that perfectly matches the shutter timing. Moreover, since the acquired still image is extracted from the shutter output still image, which does not include any NG shots such as closed eyes, it is guaranteed that no mis-shots are included. Furthermore, this also prevents images of NG shots from circulating in the market for artist management.

[0031] The still images (frame images) captured by the shutter operation are displayed in real time on the viewing terminal 3N, showing the most recent still image. The reason for displaying the image corresponding to the time the shutter was operated during shooting, rather than after the end of the video distribution for viewing, is to allow participant 3 to immediately check the frame images they have captured on the viewing terminal 3N and to immediately retake the shot if the expected image has not been captured. The same feeling as being able to check the image immediately after shooting on the camera's LCD monitor when shooting with a digital camera can be experienced in the shooting operation of the remote shooting system 100 of this embodiment, making it possible to obtain a sense of immediacy during shooting.

[0032] However, instead of just displaying the most recent still image, the system may also display the captured still images sequentially. Furthermore, if the screen size of the viewing terminal 3N is small and the display area for the video is small, the system may display all the captured still images together in a scrolling format after the video has finished playing. It goes without saying that although it is explained that one still image is extracted when the shutter is pressed, if icon 7 is pressed and held down, the corresponding still images will be extracted in succession, effectively creating a video.

[0033] Furthermore, when viewer 3 presses shutter 7 at a desired time, a charge may be applied based on the number of shutter presses, or a limit on the number of shutter presses may be set for the distribution of the viewing video 1, for example, 100 or 200 times. Also, the shutter fee may be free, or a bulk fee may be set for every 100 shutter presses, for example.

[0034] The number of times participant 3 takes a photo while watching a video becomes statistical data based on participant 3's actual actions, allowing for the quantification of emotions expressed through the use of the shutter. For example, if the photo shoot is a fashion show, styling data can be compiled, making it possible to understand the clothing preferences of many participants. Also, if the photo shoot is a public model audition, popularity data can be compiled, and if an influencer participates, the expressions and poses that receive the most shutter clicks can be analyzed to identify popular points that can then be applied to other models. Therefore, the photo shoot event management company 1 can sell the number of shutter clicks sent to the server.

[0035] Furthermore, the still images acquired through shutter operation can be tracked for each of the 3 participants. In addition, the remote shooting system 100 of this embodiment incorporates information identifying the participant 3 who operated the shutter into each still image before providing that still image to each participant 3. For example, "Captured by ABC" (where ABC is each participant's unique ID or name, etc.) is superimposed in small font at the bottom of each still image. This gives each participant 3 the feeling that it is their own unique still image.

[0036] Furthermore, if participant 3 processes this identification information in a way that makes it impossible to erase, even if the still image is distributed without the permission of the copyright holder, it has the advantage that participant 3 who leaked it without permission can be identified from the identification information. The superimposed display may be in the form of a watermark or hidden so that it is not immediately apparent that the identification information is incorporated into the still image.

[0037] Figure 4 shows an example of the screen displayed on a viewing terminal 3N of a participant who is taking part in a photo shoot and watching a video for viewing. The remote shooting system 100 of this embodiment shoots the subject with multiple cameras 6. Therefore, multiple videos for viewing, each showing the subject from an angle corresponding to the number of cameras, are displayed on the viewing terminal 3N. Specifically, as shown in Figure 4, different videos for viewing are displayed on the screen, divided into multiple sections 41-45. In other words, this is an example of a multi-angle screen where multiple viewing videos from different cameras are simultaneously displayed on the viewing terminal 3N in a split-screen format. This corresponds to the number of cameras used in the photo shoot, and since the position, orientation, and angle of each camera relative to the subject are different, each video will be displayed for viewing.

[0038] Participant 3 selects an image from a desired camera by tapping the display area of ​​the video feed from multiple cameras 6 shown on the viewing terminal 3N. Only the image from that camera is then enlarged and displayed on the entire screen or a portion of it 45, and Participant 3 can press the shutter button 7 at any time they like. If they wish to select an image from another camera 6, they can repeat the process by clicking on the multiple video feeds shown in Figure 4.

[0039] The multi-angle screen display shown in Figure 4 is extremely convenient for photo shoots involving a large number of participants. This is because each viewer can select video from their preferred camera angle (shooting angle and position), thus accommodating the preferences of almost all participants. Furthermore, the present invention adjusts the angle by switching the displayable area, from the perspective of accurately meeting the needs of a large number of participants. In other words, although the screen resolution on the participants' viewing terminals is generally set to FHD (1920 x 1080 pixels), the actual video shooting is based on ultra-high resolution and high-definition video quality, such as 8K (7680 x 4320 pixels) or 4K (3840 x 2160 pixels), allowing for changes to the displayable area.

[0040] Figure 5 shows examples of image ranges for FHD, 4K, and 8K. Each participant 3 can move between displayable areas, including the second area (4K) 52 and the third area (8K) 53, which are outside the first area (FHD) 51, by using finger operations such as tapping and pinching or mouse operations on their viewing terminal to change the area. This allows for flexible adaptation to the desired field of view (wide-angle, standard, telephoto) for each viewer. As a result, it is possible to provide viewers with an experience as if they were adjusting the field of view themselves using the camera 6 at the shooting location.

[0041] Furthermore, the resolution of the recorded video is not fixed or limited to 8K or 4K, and it goes without saying that it will increase in line with advancements in communication technology and LCD display technology. In addition, the settings for the shooting size and framing ratio when viewers change the displayable area on their viewing device can be changed to any value desired by each viewer, in accordance with the framing of the LCD monitor on the viewing device.

[0042] The ability to change the displayable area by switching image quality, as described above, offers significant convenience, especially when multiple viewers are taking pictures based on images captured by a single camera. This is like a photo shoot with one camera and many viewers. A fixed angle from a single camera makes it difficult to accommodate the wishes of many viewers, but according to the present invention, each viewer can freely select the display area size on their viewing terminal based on the moving image from a single camera. However, this is also effective in cases where multiple cameras are used, as in this embodiment. Since it is equivalent to multiple cameras shooting at an N-fold magnification, it will be possible to respond precisely to each viewer's instructions for shooting operations such as zooming in and out, no matter how large the number of viewers.

[0043] The present invention allows viewers to take a picture at their preferred timing from a streamed video, but it is based on the premise that a large number of viewers are watching "simultaneously." In such a viewing situation, the images taken at the moment when multiple participants 3 are taking pictures are often considered to be the optimal scenes to capture, i.e., to be extracted images.

[0044] However, each participant in a remotely filmed video for viewing does not know when other participants are taking pictures. If you are actually at the filming location, you can see that many other people are taking pictures, so you can recognize when it's a good opportunity to take a picture and take your own. However, with a remote filming system like the present invention, you cannot know when others are taking pictures, so you may later regret not taking a picture.

[0045] Therefore, the remote shooting system of the second embodiment includes a configuration that utilizes the fact that the time of each participant's shutter operation is transmitted to the server in real time, allowing the shutter status of other participants to be seen in real time on a display. For example, as shown in Figure 6, shutter indicators 61-65 are provided on each of the multi-angle screens 41-45, and an indicator value representing the current total number of shutters is displayed. This indicates, for example, the total number of shutters from the present time to 5 seconds ago, and is updated every 5 seconds. Here, 5 seconds is just an example and can be set to any number of seconds. Suppose participant A planned to take a picture from the viewing video with the camera angle corresponding to section 41, but upon seeing the shutter indicator 62 on the multi-angle screen, realized that many participants were taking pictures from the viewing video with the camera angle corresponding to section 42. Viewer A can then switch from the camera angle of section 41 to the camera angle of section 42 and take a picture of the scene that other viewers are focusing on in the same way.

[0046] Other methods for displaying the indicator besides those shown in Figure 6 include, for example, highlighting the corresponding screen frames 41-45 on the multi-angle screen if a certain percentage of participants (e.g., more than half) are taking pictures with a camera, or making the size of screen frames 41-45 relatively larger to make them more noticeable. Alternatively, the indicator could be a curve graph showing the number of shutter clicks.

[0047] The remote shooting system of the third embodiment is characterized in that, using volumetric technology, a server generates 3D data from the data of captured video images taken from multiple cameras 6 that capture a 360-degree view of the subject, and distributes it to a viewing terminal 3N. Volumetric technology involves setting up a 360-degree green screen as the shooting background, photographing the subject, and then generating 3D data afterward. By shooting against a green screen, video data of the subject can be composited into a virtual background such as VR (Virtual Reality), AR (Augmented Reality), or MR (Mixed Reality), allowing for flexible image processing and the addition of effects.

[0048] This allows participants to experience the freedom to move freely in all directions—forward, backward, left, right, up, and down—from any angle and viewpoint while operating the shutter. Using volumetric shooting data, it's possible to switch between free-viewpoint footage and multiple free-viewpoint footage, such as having the camera pass through subjects as if in a video game, or viewing them from above.

[0049] The remote shooting systems described above, based on multiple embodiments, enable a single video stream delivered to a large audience to respond to all viewer requests, such as instructions for shooting operations including shooting angle, position, and zoom in / out. Furthermore, it can assist viewers in freely selecting the optimal shot. Additionally, it enables the operation of virtual photo shoots in virtual reality worlds (such as the metaverse) and the management of such photo studios.

[0050] The processing performed by the server described above may also be carried out by a mobile phone, personal computer, or data relay device. Furthermore, the present invention includes programs installed or loaded onto a computer by downloading them via various recording media such as optical discs like CD-ROMs, magnetic discs, and semiconductor memory, or via communication networks, as well as these storage media, within the scope of the invention.

[0051] Furthermore, the viewing terminals that communicate with the remote shooting system via the communication network are computers connected to a network such as the internet or a dedicated line. Specifically, examples include PCs (Personal Computers), mobile phones and smartphones, PDAs (Personal Digital Assistants), tablets, and wearable devices. The business scheme, including the remote shooting system, is formed by configuring PC terminals and mobile terminals connected to the communication network via wired or wireless connections to enable communication with each other. [Explanation of Symbols]

[0052] 1. Filming event management company 2. Platform operating company 3 participants 3N viewing terminal 4. Communication Network 6 cameras 7 Shutter icon 100 Remote Imaging Systems

Claims

1. A remote shooting system that provides a simulated shooting experience by distributing a video for viewing, created based on video footage acquired by a shooting device, to multiple users' image display terminals via a communication network, (a) If any effect processing has been applied to the captured video, a video without the effect processing will be generated. (b) The video is decomposed into a plurality of still images based on a predetermined frame rate and output, (c) A reconstructed still image is generated based on the still images obtained by removing some of the multiple still images mentioned above. This generates a still image for shutter output, If it is determined that multiple users perform a finger action equivalent to a shutter operation on the image display terminal while viewing the aforementioned video, the still image corresponding to the timing of the shutter operation is identified from the shutter output still images. The identified still image is displayed on the user's image display terminal. A remote shooting system characterized by the following features.

2. The remote shooting system according to claim 1, wherein, through (c) above, the reconstructed still image has been devoid of any still image that is determined to show the user with their eyes closed or any still image that is not permitted to be provided to the user.

3. The remote shooting system according to claim 1, comprising at least one of the following: generating the captured video as the video without removing the effect processing even if the captured video has been processed with an effect; or applying retouching to the reconstructed still image.

4. Equipped with multiple aforementioned imaging means, The remote shooting system according to claim 1, wherein viewing videos corresponding to each shooting means are simultaneously displayed on each of the multiple users' image display terminals, and a viewing video from the desired shooting means can be selected from among them, and the displayable area of ​​the viewing video is dynamically switched for each user according to the specifications of each of the multiple users during the distribution of the viewing video.

5. The remote shooting system according to claim 4, wherein an indicator that can recognize in real time when another user is operating the shutter on the aforementioned video for viewing is displayed on the image display terminal.

6. The remote shooting system according to claim 1, further comprising analyzing the preferences of the multiple users based on the number of finger actions corresponding to the shutter operation.

7. The remote shooting system according to claim 1, which synthesizes the captured video images acquired by the shooting means into a digital virtual space displaying an arbitrary background and distributes them to the image display terminal.

8. The remote shooting system according to claim 1, wherein the still image displayed on the user's image display terminal includes information that identifies the user.

9. A remote shooting method performed by an information processing device that distributes a video for viewing, created based on captured video images obtained by a shooting device, to multiple users' image display terminals via a communication network, (a) If the captured video has been subjected to any effect processing, the process of generating a video without the effect processing, (b) A process for decomposing the video into a plurality of still images based on a predetermined frame rate and outputting them, (c) A process to generate a reconstructed still image based on still images obtained by removing some of the multiple still images mentioned above, This generates a still image for shutter output. When it is determined that multiple users have performed a finger action equivalent to a shutter operation on the image display terminal while viewing the aforementioned video, the process involves identifying a still image corresponding to the timing of the shutter operation from among the still images for shutter output. The process of displaying the identified still image on the user's image display terminal, A remote shooting method in which this is performed.

Images