Information processing device, information processing method, and program

Abstract

An information processing device according to the present technology comprises an association processing unit that associates a partial image section, which is a partial section of a captured moving image content obtained by the image capturing of an event, with a user-related image that is an image related to a user.

Description

[Technical Field]

[0001] The present technology relates to an information processing device, a method thereof, and a program, and in particular to a technology for processing captured video content obtained by capturing an event. [Background technology]

[0002] Various techniques have been proposed for processing captured video content obtained by capturing an event. For example, Patent Document 1 below discloses a technique for changing the display state of broadcast content captured from an event in accordance with the reaction of users as viewers. Specifically, Patent Document 1 discloses a technique for changing the display state of broadcast information broadcast from a broadcast station to a viewer terminal in accordance with the result of compiling individual information sent from each of multiple viewer terminals to the broadcast station. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-344928 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, for events where user participation is generally expected, such as live music events, it is required to increase the sense of real participation in the event in order to improve user satisfaction.

[0005] The present technology has been developed in consideration of the above circumstances, and aims to improve users' sense of participation in events. [Means for solving the problem]

[0006] The information processing device according to the present technology includes a linking processing unit that links a partial image section, which is a partial section of captured video content obtained by capturing an event, with a user-related image, which is an image related to a user. The events referred to here are primarily events in which user participation is generally expected, such as live music events. User participation here refers not only to actual participation in an event with an audience, but also to virtual participation in an event without an audience (for example, displaying a user image at the event venue to make it appear as if the user is participating). User-related images here may include images of a user actually participating in the event, or images of a user virtually participating at the event venue. By linking the partial image sections of the captured video content with user-related images as described above, it becomes possible to provide content in which user-related images, such as images captured of users who are actually or virtually participating as described above, are inserted into the partial image sections that constitute the user's captured section in the captured video content of the event as image content to be distributed to the user.

[0007] In addition, the information processing method according to the present technology is an information processing method in which an information processing device links a partial image section, which is a part of a captured video content obtained by capturing an event, with a user-related image, which is an image related to a user. In addition, the program related to the present technology is a program that can be read by a computer device and causes the computer device to realize a function of linking a partial image section, which is a part of a captured video content obtained by capturing an event, with a user-related image, which is an image related to a user. These information processing methods and programs realize the information processing device according to the present technology. [Brief explanation of the drawings]

[0008] [Figure 1]1 is a diagram illustrating an example of the configuration of an image processing system including an information processing device according to a first embodiment of the present technology. [Figure 2] FIG. 1 is an explanatory diagram illustrating an example of the arrangement of cameras and display devices in an event venue. [Figure 3] FIG. 2 is an explanatory diagram of a tiling image according to an embodiment. [Figure 4] FIG. 1 is a block diagram illustrating an example of a hardware configuration of a computer apparatus according to an embodiment. [Figure 5] FIG. 2 is an explanatory diagram of functions of the information processing apparatus according to the first embodiment; [Figure 6] FIG. 2 is an explanatory diagram of a user subject image in the first embodiment. [Figure 7] 3A and 3B are explanatory diagrams of an example of content generation and distribution control in the first embodiment. [Figure 8] 10 is a flowchart showing an example of a specific processing procedure for realizing an image processing method according to a first embodiment. [Figure 9] 10A and 10B are explanatory diagrams of a display example for making the display of a user image of a specific user stand out in a tiling image. [Figure 10] 10 is an explanatory diagram of another display example for making the display of a user image of a specific user stand out in a tiling image. FIG. [Figure 11] FIG. 10 is an explanatory diagram of an example of camera placement in an image processing system according to a second embodiment. [Figure 12] FIG. 10 is a diagram showing an example of a user subject image in the second embodiment. [Figure 13] FIG. 10 is an explanatory diagram of functions of an information processing apparatus according to a second embodiment. [Figure 14] 10 is a flowchart illustrating a process for generating a user subject image in the second embodiment. [Figure 15] FIG. 10 is an explanatory diagram of an example of a business model using the image processing system of the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present technology will be described in the following order with reference to the accompanying drawings. <1. First embodiment> (1-1. Image Processing System as First Embodiment) (1-2. Hardware configuration of computer equipment) (1-3. Image Processing Method as First Embodiment) (1-4. Processing Procedure) (1-5. Modifications of the First Embodiment) 2. Second Embodiment <3. Modifications> <4. Program> <5. Summary of embodiments> <6. This Technology>

[0010] <1. First embodiment> (1-1. Image Processing System as First Embodiment) FIG. 1 shows an example of the configuration of an image processing system including an information processing device 1 according to a first embodiment of the present technology. As shown in the figure, the image processing system includes an information processing device 1, multiple cameras 2, a switcher 3, a display device 4, and multiple user terminals 5. The information processing device 1 and the user terminals 5 are configured as, for example, computer devices equipped with a CPU (Central Processing Unit). In this case, the user terminals 5 may be in the form of devices such as smartphones, tablet terminals, and personal computers.

[0011] Here, the image processing system of this embodiment is configured to be able to capture an event using a camera 2 to generate captured video content, and to distribute video content based on the captured video content to a user terminal 5 via a network NT. Here, the network NT is a communication network such as the Internet or a LAN (Local Area Network).

[0012] In this image processing system, the information processing device 1, the cameras 2, the switcher 3, and the display device 4 are placed in an event venue where the event is held, while the user terminals 5 are assumed to be placed in locations other than the event venue, such as the user's home.

[0013] Events that are imaged by the image processing system of this embodiment are, for example, live music events, and other events in which user participation is generally expected. User participation here refers to not only actual participation in an event with an audience, but also virtual participation in an event without an audience. In this embodiment, virtual participation means displaying a user image at the event venue, making it appear as if the user is actually participating. The user image referred to here means an image showing the user, such as an image of the user, but details of the user image will be explained later.

[0014] The first embodiment is an embodiment that assumes that the user's participation in the event is the above-mentioned virtual participation.

[0015] Each camera 2 is configured as an imaging device that has an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor and captures images. When distinguishing between multiple cameras 2, the codes are written by adding a "- (hyphen)" and a number to the end of the code as shown in the figure, such as "2-1", "2-2", ..., "2-n". Here, the number n of cameras 2 to be arranged is arbitrary. In the drawing, the number n of cameras 2 to be arranged is at least 3, but this is merely for convenience of illustration, and the number n of cameras 2 to be arranged is not limited to this.

[0016] In the image processing system, images of the event venue are taken from multiple viewpoints by multiple cameras 2, and the images taken by each camera 2 are input to a switcher 3. The switcher 3 selects and outputs one image from the multiple input images based on the operation. Hereinafter, the image selected and output by the switcher 3 will be referred to as the PGM (program) image.

[0017] In this example, the PGM image output from the switcher 3 corresponds to the captured video content obtained by capturing an event. As shown in the figure, captured video content as a PGM image is input to an information processing device 1.

[0018] The switcher 3 also outputs tally information to the information processing device 1. The tally information is information indicating which camera 2 the switcher 3 is selecting as the PGM image. The captured video content as an output image of the switcher 3 can be distributed via a network such as the Internet or transmitted by broadcast waves, or the captured video content can be recorded on a predetermined recording medium.

[0019] The display device 4 is a display device that displays a user image to enable the user to virtually participate in an event. For example, a display device such as an LED (Light Emitting Diode) display, an LCD (Liquid Crystal Display), or an organic EL (Electro-Luminescence) display can be used as the display device 4. Alternatively, a projector device that projects an image onto a predetermined projection target such as a screen can also be used as the display device 4. The display device 4 displays information such as images under the control of the information processing device 1.

[0020] As will be described later, in this embodiment, the user image displayed on the display device 4 to realize virtual participation is an image of the user. In this example, the image of the user is obtained by capturing an image with a camera provided in the user terminal 5, and the user image thus captured by the user terminal 5 is transmitted to the information processing device 1 via the network NT. The information processing device 1 causes the display device 4 to display the user image received from the user terminal 5.

[0021] An example of the arrangement of the cameras 2 and display devices 4 at the event venue will be described with reference to FIG. In the following description, it is assumed that the event to be imaged by the image processing system of the embodiment is a live music event. FIG. 2 shows an example of the arrangement of the cameras 2 and the display devices 4 when the target event is a live music event.

[0022] As shown in the figure, the event venue (live venue) in this case is equipped with a stage, an audience seating area, and FOH (Front of House). Performers such as musicians and singers perform on the stage. The seating area is located behind the stage and is a space that can accommodate an audience. The FOH is located behind the audience area and is a space where lighting and other elements related to the live performance and various devices for controlling the sound of the venue are located. Personnel from the concert organizers, such as directors and staff, can enter the FOH.

[0023] As shown in the figure, the display device 4 is placed on the stage in this example. Specifically, the display device 4 in this case is placed at the front end of the stage (the end farthest from the audience seating) with the display surface facing the audience seating.

[0024] With this arrangement, as shown in the example of FIG. 3, when the stage is viewed from the audience seating area, the user image is displayed behind the performers.

[0025] 3, in this example, an arrangement image in which user images of multiple users are arranged side by side is displayed on the display device 4. Specifically, as shown in the figure, a tiling image in which user images of multiple users are arranged side by side in tiles is displayed.

[0026] In the case of a live performance without an audience, the display device 4 can be placed inside the audience area. This is desirable because it allows the positional relationship between the user and the performers to be the same as if the user were actually participating.

[0027] In Figure 2, the cameras 2 are positioned such that three of them (cameras 2-1, 2-2, and 2-3 in the figure) are placed in the space between the stage and the audience area (the space known as the front fence). This makes it possible to capture the performers on stage within the field of view from a position closer than FOH. As shown in the figure, these three cameras 2 are placed in the center in the left-right direction (the direction perpendicular to the front-to-back direction) and at both the left and right ends.

[0028] In addition, another one of the cameras 2 (referred to as camera 2-n as shown in the figure) is placed in a position different from the above-mentioned three cameras 2-1, 2-2, and 2-3. In this example, camera 2-n is a camera for capturing an image of a user displayed on display device 4. In this example, camera 2-n is placed in the FOH area, but this is merely an example, and camera 2-n can also be placed in the audience area.

[0029] (1-2. Hardware configuration of computer equipment) The information processing device 1 and the user terminal 5 shown in FIG. 1 can be configured as a computer device 70 having a hardware configuration as described below.

[0030] FIG. 4 is a block diagram showing an example of the hardware configuration of the computer device 70. 4, a CPU 71 of a computer device 70 executes various processes in accordance with programs stored in a nonvolatile memory unit 74, such as a read-only memory (ROM) 72 or an electrically erasable programmable read-only memory (EEP-ROM), or programs loaded from a storage unit 79 into a random access memory (RAM) 73. The RAM 73 also stores data necessary for the CPU 71 to execute various processes, as appropriate. The CPU 71, ROM 72, RAM 73, and nonvolatile memory unit 74 are interconnected via a bus 83. The bus 83 is also connected to an input / output interface 75.

[0031] An input unit 76 is connected to the input / output interface 75. This input unit 76 comprehensively represents devices that obtain various types of input information, such as controls, operation devices, and sensor devices. For example, various types of operators and operation devices such as a keyboard, a mouse, keys, a dial, a touch panel, a touch pad, a remote controller, etc. may be assumed as components for obtaining operation input information in the input unit 76. The operation input information obtained by the input unit 76 is interpreted by the CPU 71.

[0032] Here, a camera can be cited as an example of a sensor device included in the input unit 76. In particular, when the computer device 70 is used as the user terminal 5 and an image of the user is used as the user image, a camera is provided as a sensor device in the input unit 76.

[0033] Furthermore, the input / output interface 75 is connected integrally or separately to a display unit 77 such as an LCD or organic EL (Electro-Luminescence) display, and an audio output unit 78 such as a speaker. The display unit 77 is a display unit that displays various information, and is configured, for example, by a display device provided in the housing of the computer device 70, or a separate display device connected to the computer device 70, or the like. The display unit 77 displays images for various image processing, moving images to be processed, etc. on the display screen based on instructions from the CPU 71. Furthermore, the display unit 77 displays various operation menus, icons, messages, etc., that is, GUI (Graphical User Interface), based on instructions from the CPU 71.

[0034] The input / output interface 75 may be connected to a storage unit 79 configured with a hard disk or solid-state memory, or a communication unit 80 configured with a modem or the like. The communication unit 80 performs communication processing via a transmission path such as the Internet, and communication with various devices via wired / wireless communication, bus communication, and the like.

[0035] A drive 81 is also connected to the input / output interface 75 as required, and a removable recording medium 82 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory is appropriately mounted thereon. Drive 81 allows data files such as image files and various computer programs to be read from removable recording medium 82. The read data files are stored in storage unit 79, and images and sounds contained in the data files are output on display unit 77 and audio output unit 78. Furthermore, computer programs and the like read from removable recording medium 82 are installed in storage unit 79 as needed.

[0036] In such a computer device 70, software can be installed via network communication by the communication unit 80 or via a removable recording medium 82. Alternatively, the software may be stored in advance in the ROM 72, the storage unit 79, or the like.

[0037] Here, when the computer device 70 is used as the information processing device 1, for example, the display device 4 shown in Figure 1 is connected to the input / output interface 75, and the CPU 71 can control the display operation of the display device 4 via the input / output interface 75.

[0038] (1-3. Image Processing Method as First Embodiment) Figure 5 is an explanatory diagram of the functions possessed by the information processing device 1, and shows the camera 2-n, the display device 4, and multiple user terminals 5, along with functional blocks of various functions possessed by the information processing device 1 related to the image processing method of the first embodiment. In this example, the functions of the various functional blocks indicated by the reference character F in the drawing are realized by software processing of a CPU 71 in a computer device 70 serving as the information processing device 1.

[0039] As shown in the figure, the information processing device 1 has functions as a target user selection unit F1, a user image acquisition unit F2, a tiling image generation unit F3, a user subject image generation unit F4, a linking processing unit F5, and a content generation and distribution control unit F6.

[0040] The target user selection unit F1 selects users whose user images will be displayed on the display device 4 from among users who will virtually participate in the event, specifically, in this example, users who have purchased participation tickets for virtual participation in the event. Here, in this example, the user images of all virtual participating users (i.e., all users who are defined as having their user images displayed on the display device 4) are displayed on the display device 4 during the period from the start to the end of the event. For this purpose, the target user selection unit F1 determines the number of tiling images to be generated, the display period of each tiling image, and the users whose user images will be displayed in each tiling image, based on information on the length of time from the start to the end of the event, information on the total number of virtual participating users for the event, and information on the number of user images that can be displayed at one time in the tiling image mentioned above (in other words, information on the number of area divisions in the tiling image), so that the condition that user images are displayed on the display device 4 for all virtual participating users is satisfied. Hereinafter, a user whose user image is displayed in the tiling image will be referred to as a "display target user."

[0041] When a new tiling image needs to be displayed, the target user selection unit F1 selects a display target user for the new tiling image in accordance with the allocation for each tiling image described above. The target user selection unit F1 outputs information indicating the display target users selected in this way to the user image acquisition unit F2, the user subject image generation unit F4, and the content generation and distribution control unit F6.

[0042] The user image acquisition unit F2 performs processing to acquire user images from the user terminals 5 of the display target users. Figure 5 illustrates how user images are obtained from the user terminal 5 of each user to be displayed when the number of selected users to be displayed (i.e., the number of area divisions in the tiling image) is three, but this is merely an example for explanatory purposes, and the number of users to be displayed that can be selected at one time is not limited to three.

[0043] In this example, the user image displayed on the display device 4 is a captured image obtained by the user terminal 5 capturing an image of the user. Here, the user image uses an image currently being captured by the user terminal 5. This makes it possible to reflect the state of the display target user on the display device 4 at the event venue in substantially real time.

[0044] The user image acquisition unit F2 outputs each user image acquired from the user terminal 5 of the display target user to the tiling image generation unit F3.

[0045] The tiling image generating unit F3 generates a tiling image in which the user images input from the user image acquiring unit F2 are arranged in a tiled pattern, and causes the display device 4 to display the generated tiling image.

[0046] The user subject image generating unit F4 receives an image captured by the camera 2-n, that is, an image captured by capturing the display image of the display device 4 within the angle of view, and generates a user subject image for each display target user.

[0047] FIG. 6 is an explanatory diagram of a user subject image. Here, an example of a user subject image to be generated when the display target users are three users A, B, and C, and tiling images of these three users are displayed on the display device 4 will be described. In this case, the tiling image has three regions divided horizontally, with the leftmost region being the display region for the user image of user A, the central region being the display region for the user image of user B, and the rightmost region being the display region for the user image of user C.

[0048] 6A, 6B, and 6C show examples of generating user subject images of user A, user B, and user C, respectively. For example, as shown in the figures, it is conceivable to generate user subject images so that the user images of the respective target users are positioned in the center of the image frame. Specifically, for the image captured by camera 2-n capturing the display device 4 on which the tiling image is displayed, for user A, an image cut out so that the user image in the leftmost area of ​​the tiling image is positioned in the center of the image frame is used as the user subject image. For user B and user C, images cut out so that the user images in the central region and the rightmost region of the tiling image are positioned in the center of the image frame are set as the user subject images.

[0049] It should be noted that, with regard to the user subject image, positioning the user image of the target user at the center of the image frame is merely an example. Furthermore, although the example given here is that the user's subject image is generated by image clipping, the user's subject image can also be obtained by adjusting the composition of the camera 2 by panning, tilting, and zooming.

[0050] 5, the user subject image generation unit F4 receives information indicating which user's user image is arranged in which area of ​​the tiling image from the tiling image generation unit F3. Based on this information, the user subject image generation unit F4 can generate the user subject image of each display target user as exemplified above.

[0051] In this example, the user subject image generating unit F4 generates the user subject image for each display target user as described above in a time-division manner within the display period of the tiling image. Specifically, within the display period of the tiling image, the user subject image of user A is generated for a predetermined period, then the user subject image of user B is generated for a predetermined period, and then the user subject image of user C is generated for a predetermined period.

[0052] The user subject image generation unit F4 outputs information indicating the period during which each user subject image generated sequentially within the display period of the tiling image to the linking processing unit F5 as information on the "subject image generation period." Furthermore, the user subject image generating unit F4 outputs the image ID of the generated user subject image to the linking processing unit F5 together with the information on the subject image generation period.

[0053] The linking processing unit F5 links partial image sections, which are partial sections of the captured video content (PGM images in this example), with user-related images, which are images related to the user. Here, the user-related image corresponds to the user subject image generated by the user subject image generating unit F4 in this example. The linking processing unit F5 in this example identifies an image section in the PGM image (captured video content) that corresponds to each subject image generation period based on information on the subject image generation period for each user subject image of each display target user input from the user subject image generation unit F4. Such an image section in the PGM image that corresponds to the generation period of the user subject image will be referred to as a "subject image generation corresponding section" below. The linking processing unit F5 performs processing to link the image ID of each user subject image input from the user subject image generating unit F4 with information on the subject image generation section for each user subject image identified as described above. The subject image generation section corresponds to an example of a "partial image section" according to the present technology.

[0054] The content generation and distribution control unit F6 generates video content by inserting an image based on the user's subject image into the subject image generation corresponding section in the PGM image based on the linking information between the subject image generation corresponding section (an example of a partial image section) and the user's subject image (an example of a user-related image) generated by the linking processing unit F5. At the same time, the content generation and distribution control unit F6 performs distribution control so that the generated video content is distributed to the user terminal 5.

[0055] In this example, moving image content is generated by inserting an image based on a user's subject image into a section of the PGM image corresponding to subject image generation, as described above. However, one example of this moving image content is one generated by inserting the user's subject image itself into a section of the PGM image corresponding to subject image generation. Alternatively, the moving image content may be one in which a processed image of the user's subject image is inserted into a section of the PGM image corresponding to subject image generation. Furthermore, the user's subject image may be inserted in a picture-in-picture format into an image in a section of the PGM image corresponding to subject image generation. In the following description, it is assumed that the video content is generated by inserting the user's subject image itself into the subject image generation section in the PGM image.

[0056] A specific example of content generation and distribution control by the content generation and distribution control unit F6 will be described with reference to FIG. In FIG. 7 as well, it is assumed that the users whose user images are being displayed in the tiling image are User A, User B, and User C. In the figure, the sections denoted by the symbol "c" represent the subject image generation corresponding sections in the PGM image. Subject image generation corresponding section c2 is an image section corresponding to the subject image generation period for the user subject image of user A, subject image generation corresponding section c3 is an image section corresponding to the subject image generation period for the user subject image of user B, and subject image generation corresponding section c4 is an image section corresponding to the subject image generation period for the user subject image of user C.

[0057] As shown in the figure, in this example, the video content to be distributed to user A is generated by inserting a user subject image of user A into subject image generation corresponding section c2, and the video content to be distributed to user B is generated by inserting a user subject image of user B into subject image generation corresponding section c3. Furthermore, the video content to be distributed to user C is generated by inserting a user subject image of user C into subject image generation corresponding section c4.

[0058] In this example, for each user subject image of each user whose user image is currently being displayed in the tiling image, multiple video contents are generated in which images based on the user subject image are inserted into the subject image generation section of each user subject image in the PGM image. In other words, this generates a plurality of moving image contents in which, for each user's subject image, images based on the user's subject image are inserted into different partial image sections in the PGM image. This makes it possible to insert a user's subject image for each user into the PGM image in a time-division manner. This makes it suitable for generating video content for each user about a live event.

[0059] Also, as can be seen by referring to FIG. 7, in this example, the video content generated by the content generation and distribution control unit F6 is distributed to the user associated with the user subject image inserted into the video content. This allows video content in which an image based on a user-subjected image is inserted into a PGM image to be appropriately delivered to the user associated with the user-subjected image, i.e., in this example, the user appearing in the user-subjected image.

[0060] In addition, in this example, the content generation and distribution control unit F6 controls the distribution of a PGM image without a user subject image inserted to users whose user image is not displayed in the tiling image (other than users A, B, and C in the figure). In other words, the content generation and distribution control unit F6 controls the distribution of PGM images to other users who are not associated with the user-related image inserted into the video content. This prevents video content in which user images of other users (in this case, users A, B, and C) are inserted from being distributed to users whose own user images are not inserted in the video content. Furthermore, since PGM images without other users' user images inserted are distributed to users other than users A, B, and C, it is possible to prevent subjects that users want to see, such as performers at a live music concert, from being blocked by other users' user images.

[0061] (1-4. Processing Procedure) Next, with reference to the flowchart in FIG. 8, a specific example of a processing procedure for realizing the image processing method according to the first embodiment described above will be described. The process shown in FIG. 8 is executed by a CPU 71 in a computer device 70 serving as the information processing device 1. It should be noted that when the process shown in Figure 8 starts, it is assumed that the number of tiling images to be generated, the display period of each tiling image, and the allocation of the target users to display each tiling image have already been completed, as explained as the function of the target user selection unit F1 mentioned above.

[0062] First, in step S101, the CPU 71 waits for a processing start condition to be met. Specifically, in this example, the CPU 71 waits for the start timing of an event to arrive.

[0063] For example, when it is determined that the start timing of an event has arrived and the processing start condition has been met, the CPU 71 proceeds to step S102 to select M target users. This is processing to select, as target users, M users assigned to a tiling image to be newly displayed, based on the display target user assignment information in each tiling image by the function of the target user selection unit F1. In this example, M is the same as the number of divided regions in the tiling image.

[0064] Although not shown in the drawing, when M target users are selected in step S102, the CPU 71 resets a target user identifier m, which will be described later, to an initial value (1 in this example).

[0065] In step S103 following step S102, the CPU 71 starts acquiring images from the terminals of the target users. That is, acquisition of user images (captured images of the users in this example) from the user terminals 5 of the M target users starts.

[0066] In step S104 following step S103, the CPU 71 performs a process of starting display of a tiling image, i.e., a process of causing the display device 4 to start displaying a tiling image in which the user images of the M target users whose acquisition has started in step S103 are arranged in a tiling manner.

[0067] In step S105 following step S104, the CPU 71 sends a distribution advance notice to the m-th user, where "m" is an identifier (referred to as "target user identifier m") for identifying each of the M target users selected in step S102, and its initial value is "1." In step S105, the CPU 71 executes a notice of advance notice of distribution of video content to the user terminal 5 of the user specified by this target user identifier m.

[0068] In step S106 following step S105, the CPU 71 performs processing to generate a subject image of the m-th user. That is, for the m-th user, a subject image of the user is generated based on the image captured by the camera 2-n.

[0069] In step S107 following step S106, the CPU 71 performs processing to link the subject image with the partial image section of the PGM image. That is, in this example, processing to link the image ID of the user subject image generated in step S106 with information on the subject image generation section of the PGM image for the user subject image.

[0070] In step S108 following step S107, the CPU 71 controls so that the video content in which the subject image has been inserted into the linked section in the PGM image is distributed to the m-th user. That is, the CPU 71 controls so that the video content in which the user subject image generated in step S106 has been inserted into the subject image generation corresponding section in the PGM image that has been linked in the processing of step S107 is distributed to the user terminal 5 of the m-th user.

[0071] After executing the process of step S108, the CPU 71 proceeds to step S109 and determines whether the target user identifier m is M or greater. If the target user identifier m is not equal to or greater than M in step S109, the CPU 71 increments the target user identifier m by 1 in step S111, and returns to step S105. This will result in a distribution preview notification and the generation and distribution of video content corresponding to the next user among the M target users (i.e., in this example, the display target user whose user image is currently being displayed in the tiling image).

[0072] On the other hand, if the target user identifier m is equal to or greater than M in step S109, the CPU 71 proceeds to step S110 to determine whether or not the processing end condition is met. Specifically, in this example, it is determined whether or not the end timing of the event has arrived.

[0073] In step S110, if it is determined that the end timing of the event has not arrived and the processing end condition has not been met, for example, the CPU 71 returns to step S102. As a result, for the new M target users whose user images will be displayed in the next tiling image, processing for displaying the tiling image (S103 to S104) and processing for generating and distributing video content for each target user (S105 to S109) are performed.

[0074] On the other hand, if it is determined in step S110 that the processing termination condition is met, the CPU 71 terminates the series of processing steps shown in FIG.

[0075] (1-5. Modifications of the First Embodiment) Here, the following modifications of the first embodiment are possible. In the above, an example was given in which tiling images were displayed for the entire event section and video content with user-focused images inserted was distributed, but a prohibited section may be set for the display of these tiling images and the distribution of video content. For example, a prohibited section may be set and a common image as a PGM image may be distributed to all virtual participating users during the prohibited section.

[0076] Furthermore, it is not essential to display the user images of all virtual participating users, and it is also possible to configure the system so that users can refuse to have their user images sent from the user terminal 5 or displayed on the display device 4. Furthermore, it is also conceivable that the user of the information processing device 1 can refuse the display of a user image from a malicious user, for example.

[0077] Furthermore, it is also possible to dynamically change the display mode of a tiling image. For example, a configuration may be considered in which the display mode of a user image in a tiling image is determined based on behavior management information that manages the behavior history of a virtual participating user regarding an event. The behavioral management information referred to here includes, for example, management information related to a user's purchasing behavior of an event ticket, management information related to the user's tipping behavior to performers when the event is a live music concert, and management information related to a user's posting behavior on SNS (Social Networking Service) sites such as the event's official website, and any other information that manages a user's behavioral history related to an event.

[0078] For example, the CPU 71 of the information processing device 1 determines the display mode of the user image in the tiling image for that user based on ticket price information stored in a predetermined memory device such as the storage unit 79, i.e., information indicating the price of the participation ticket purchased by the user. Specifically, it is conceivable to perform control so that the display of the user image in the tiling image stands out for users who have purchased expensive tickets (for example, above a predetermined price).

[0079] Alternatively, the CPU 71 of the information processing device 1 can determine the display mode of the user image in the tiling image for the user based on tip amount information stored in a predetermined memory device such as the storage unit 79, i.e., information indicating the amount of tipping made by the user to the event. Specifically, it is conceivable to perform control so that the display of the user image in the tiling image stands out for users who have made large tipping actions (for example, a predetermined amount or more).

[0080] As an example of display for making the display of the user image of a specific user stand out in the tiling image, for example, as illustrated in FIG. 9, a display area for the user image of the specific user may be enlarged. Alternatively, although not shown, it is also conceivable to set the color of the frame of the display area of ​​the user image of a specific user to a different color from the color of the frames of the other display areas.

[0081] It is also conceivable to perform control to make a user image of a specific user stand out in the tiling image based on factors other than factors related to the user's behavior. For example, as shown in FIG. 10, it is conceivable to perform control such that the user image of the user whose birthday it is may stand out.

[0082] In the above example, a user subject image is generated for each individual display target user in the tiling image, but a user subject image can also be generated for each of multiple display target users. For example, when multiple users participate in an event as a group, an image including user images of all display target users constituting the group within an image frame can be generated as the user subject image for the group. In this case, it is also conceivable to distribute video content generated in common for the group (video content into which user-captured images for the group are inserted) to each user constituting the group.

[0083] Furthermore, the user subject image may be generated as an image in which the virtual participating user (user image displayed on the display device 4) and the performer are both shown.

[0084] In addition, since communication delays may occur between the information processing device 1 and the user terminal 5, when using an image of the user as the user image, it may be possible to adjust the timing of obtaining the user image from the user terminal 5, taking into account the communication delays.

[0085] 2. Second Embodiment Next, a second embodiment will be described. The second embodiment is an embodiment that assumes that users actually participate in the event. In the following description, parts that are the same as parts that have already been described will be given the same reference numerals and description thereof will be omitted.

[0086] In the second embodiment, the event in question is a live performance with an audience. In the image processing system of the second embodiment, as shown in FIG. 11, a camera 2-n' capable of capturing an image of the audience seating area from the front side (stage side) is provided as the camera 2. In the second embodiment, the image captured by this camera 2-n' is used as the user subject image of the actual participating user.

[0087] FIG. 12 shows an example of a user subject image obtained by capturing an image of a specific user participating in an event in the audience area using a camera 2-n'.

[0088] Fig. 13 is an explanatory diagram of the functions of an information processing device 1A provided in an image processing system as the second embodiment. Fig. 13 also shows a camera 2-n' provided in the image processing system as the second embodiment, along with a functional block showing the functions of the information processing device 1A as the second embodiment. Although not shown, the image processing system of the second embodiment is similar to the image processing system shown in FIG. 1 in that it includes cameras 2-1 to 2-3 other than camera 2-n′, and a switcher 3 that selects images captured by each camera 2 and outputs them as PGM images. However, in FIG. 13, cameras 2 other than camera 2-n′ and the switcher 3 are not shown.

[0089] As shown in the figure, the information processing device 1A has functions as a target user selection unit F1A, a user subject image generation unit F4A, a linking processing unit F5A, and a content generation unit F7. The target user selection unit F1A sequentially selects users who are actually participating in the event, and outputs information indicating the selected users to the user subject image generation unit F4A. In this example, the target user selection unit F1A selects users so that all participating users are selected within the period from the start to the end of the event.

[0090] The user subject image generation unit F4A generates an image of the user selected by the target user selection unit F1A within an image frame based on the image captured by the camera 2-n' as a user subject image for that user. In this case, the seat position information IC is used to generate the user subject image. The seat position information IC is information that corresponds to information indicating the seat position of each participating user as a ticket purchaser. The user subject image generation unit F4A acquires information on the seat position of the selected user based on the information indicating the selected user input from the target user selection unit F1A and this seat position information IC, and controls the composition of the camera 2-n' based on the acquired seat position information to generate a user subject image as an image capturing the selected user within the image frame. It should be noted that the generation of the user subject image here may involve a cutout process for the image captured by the camera 2-n'.

[0091] Here, the user subject image generation unit F4A generates a user subject image for each user selected sequentially by the target user selection unit F1A from the start to the end of the event, and for each user subject image generated sequentially in this manner, the user subject image generation unit F4A outputs information indicating the period during which each image was generated to the linking processing unit F5A as subject image generation period information. Furthermore, the user subject image generating unit F4A outputs the image ID of the generated user subject image to the linking processing unit F5A together with the information on the subject image generation period.

[0092] The linking processing unit F5A links a partial image section, which is a partial section of the captured video content (PGM image), with a user-related image, which is an image related to the user (user-subjected image in this example). Specifically, the linking processing unit F5A identifies an image section in the PGM image that corresponds to each subject image generation period based on the subject image generation period information for each user subject image input from the user subject image generation unit F4A. The image section identified in this way is also referred to as the "subject image generation corresponding section." The linking processing unit F5A performs processing to link the image ID of each user subject image input from the user subject image generating unit F4A with information on the subject image generation section for each user subject image identified as described above.

[0093] The content generation unit F7 generates video content by inserting an image based on the user's subject image into the subject image generation section in the PGM image based on the linking information between the subject image generation section and the user's subject image by the linking processing unit F5A. In this example, the content generating unit F7 generates video content in which a user's subject image is inserted into a subject image generation section for each user selected by the target user selecting unit F1A.

[0094] FIG. 14 is a flowchart of the process of generating a user subject image in the second embodiment. The process shown in FIG. 14 is executed by the CPU 71 in the computer device 70 serving as the information processing device 1A.

[0095] First, in step S201, the CPU 71 waits for a processing start condition (for example, the arrival of an event start timing) to be satisfied, and in response to the satisfaction of the processing start condition, performs processing to select a target user in step S202. This corresponds to the processing of the target user selection unit F1A described above.

[0096] In step S203 following step S202, the CPU 71 generates a subject image of the selected user. That is, by processing as the above-described user subject image generating unit F4A, the CPU 71 generates a user subject image for the user selected in step S202.

[0097] In step S204 following step S203, the CPU 71 determines whether all target users have been processed, that is, in this example, determines whether user subject images have been generated for all users who are actual event participants. If not all target users have been processed, the CPU 71 returns to step S202, whereby the process is repeated until user subject images are generated for all target users.

[0098] On the other hand, if it is determined that all target users have been processed, the CPU 71 ends the series of processes shown in FIG.

[0099] Here, in the second embodiment, the information processing device 1A obtains video content with user-subjected images inserted for actual participants in each event, and user-subjected image content (user-subjected image content), and it is conceivable to use these contents to build a business model such as that illustrated in Figure 15.

[0100] First, in the figure <1> As shown in the figure, a user X who actually participated in the event downloads a subject image content in which he or she appears from, for example, information processing device 1A. At this time, the download can be free of charge or can be made for a fee.

[0101] User X, who downloaded his own subject image content, <2> As shown in the figure, it is conceivable to post the photographed image content to, for example, a social networking site.

[0102] In this way, the image content of User X posted on the SNS site may be viewed by User Y, who is an acquaintance of User X (see in the figure). <3> ). In this case, by viewing the image content of user X, user Y becomes interested in the event that user X participated in, and is more likely to purchase the video content generated for the event (see in the figure). <4> ).

[0103] According to the second embodiment, for example, such a business model can be constructed.

[0104] In the second embodiment, an example was given in which a user subject image was generated for each user, but as in the first embodiment, in cases where multiple users participate in an event as a group, it is possible to generate a user subject image for each of the multiple users.

[0105] Also, in the second embodiment, it is conceivable to provide a prohibited section for generating a user subject image.

[0106] <3. Modifications> Here, the embodiment is not limited to the specific examples described above, and various modified configurations can be adopted. For example, in the above example, an information processing device (information processing device 1 or 1A) according to an embodiment is placed at an event venue, but the information processing device according to an embodiment may also be placed at a location other than the event venue, for example as a cloud server, etc. In this case, the PGM image from the switcher 3 installed at the event venue and the images captured by the cameras 2-n and 2-n' (images used to generate the user subject image) are transmitted to the information processing device via the network. Furthermore, it is not necessary for the switcher 3 to be installed at the event venue; for example, if the switcher 3 is implemented by a software program on an information processing device rather than a hardware device, it is possible to adopt a configuration in which the functions of the switcher 3 are implemented on a cloud server.

[0107] Furthermore, in the above, an example was given in which multiple user images are displayed as tiling images on the display device 4, but the arrangement of multiple user images on the display device 4 is not limited to a tiled arrangement, and it is sufficient that at least multiple user images are arranged side by side.

[0108] In the above example, the tiling image is updated in conjunction with a change in the target user of the target user selection unit F1 of the information processing device 1. That is, the information processing device 1 determines the timing of updating the tiling image. However, the tiling image can also be updated based on input information from the user terminal 5.

[0109] Furthermore, in the explanation so far, an example has been given of the event to be imaged being a live music event, but this technology can also be suitably applied to other events to be imaged, including events such as musicals where the performances are held on a stage (either indoors or outdoors), program recordings in a studio, and sports events such as baseball, soccer, basketball, and volleyball.

[0110] <4. Program> The information processing device (1 or 1A) has been described as an embodiment, and the program of the embodiment is a program that causes a computer device such as a CPU to execute processing as the information processing device 1 or information processing device 1A.

[0111] The program of the embodiment is a program that can be read by a computer device and enables the computer device to realize the function of linking a partial image section, which is a part of a captured video content obtained by capturing an event, with a user-related image, which is an image related to a user. That is, this program corresponds to a program that causes a computer device to execute the processing described with reference to FIG. 8 and the like.

[0112] Such a program can be stored in advance in a computer-readable recording medium, such as a ROM, HDD (Hard Disk Drive), or SSD (Solid State Drive). Alternatively, the program can be temporarily or permanently stored in a removable recording medium such as a semiconductor memory, a memory card, an optical disk, a magneto-optical disk, or a magnetic disk. Such removable recording medium can also be provided as a so-called package software. In addition, such a program can be installed onto a personal computer or the like from a removable recording medium, or can be downloaded from a download site to a required information processing device such as a smartphone via a network such as a LAN or the Internet.

[0113] <5. Summary of embodiments> As described above, the information processing device (same as 1 or 1A) as an embodiment is equipped with a linking processing unit (same as F4, F4A) that links a partial image section, which is a part of the captured video content obtained by capturing an event, with a user-related image, which is an image related to the user. The events referred to here are primarily events in which user participation is generally expected, such as live music events. User participation here refers not only to actual participation in an event with an audience, but also to virtual participation in an event without an audience (for example, displaying a user image at the event venue to make it appear as if the user is participating). User-related images here may include images of a user actually participating in the event, or images of a user virtually participating at the event venue. By linking the partial image sections of the captured video content with user-related images as described above, it becomes possible to provide content in which user-related images, such as images captured of users who are actually or virtually participating as described above, are inserted into the partial image sections that constitute the user's captured section in the captured video content of the event as image content to be distributed to the user. Therefore, it is possible to improve the user's sense of participation in the event.

[0114] In addition, the information processing device as an embodiment is equipped with a content generation unit (content generation / distribution control unit F6, content generation unit F7) that generates video content in which an image based on a user-related image is inserted into a partial image section in the captured video content based on linking information between the partial image section and the user-related image generated by the linking processing unit. Examples of images based on user-related images include the user-related image itself, an image obtained by processing a user-related image, or an image containing a user-related image such as an image in which a user-related image is inserted into a specified image in a picture-in-picture format. According to the above configuration, it is possible to provide content as distribution image content to users in which images based on user-related images, such as images captured of users who are actually participating or virtually participating, are inserted into partial image sections that are the user's image capture sections in the event's captured video content. Therefore, it is possible to improve the user's sense of participation in the event.

[0115] Furthermore, the information processing device of the embodiment is provided with a distribution control unit (content generation / distribution control unit F6) that controls the video content generated by the content generation unit to be distributed to users associated with user-related images (see Figure 7). This allows video content in which an image based on a user-related image is inserted into a partial image section in the captured video content to be appropriately delivered to a user associated with the user-related image (e.g., a user appearing in the user-related image).

[0116] Furthermore, in the information processing device as the embodiment, the distribution control unit controls so that the captured video content is distributed to other users who are not associated with the user-related image (see FIG. 7). This prevents video content in which a user-related image of a user who is not a third party is inserted from being distributed to a user in whose partial image section an image based on the user-related image is not inserted. At this time, the other users are delivered captured video content without any other user-related images inserted, which prevents the subject that the user actually wants to see, such as a performer at a live music concert, from being blocked by other user-related images.

[0117] In addition, in the information processing device as an embodiment, there are multiple user-related images, each of which is an image related to a different user, and the content generation unit generates multiple video contents for each user-related image by inserting images based on the user-related image into different partial image sections in the captured video content (see Figures 7 and 8). This makes it possible to insert user-related images for each user into the captured video content in a time-division manner. This makes it suitable for generating video content for each user about a live event.

[0118] Furthermore, in the information processing device according to the embodiment, the user-related image is an image based on a user image that represents a user. The image representing the user as referred to here is a concept that includes not only an image of the user, but also an image that identifiably represents the user, such as an avatar image of the user. As described above, by using a user-related image based on a user image representing the user, the user can feel more realistically as if he or she is participating in the event.

[0119] Furthermore, in the information processing device according to the embodiment, the user-related image is an image obtained by capturing a user image displayed at the event venue. This allows the user to virtually participate in an event, thereby improving the sense of reality that the user is actually participating in the event.

[0120] In addition, in an information processing device as an embodiment, user images of multiple users are displayed at the event venue, and the user-related image is an image that depicts the user image of the target user among the user images displayed at the event venue. This allows users receiving video content to recognize that their own user images are being displayed at the event venue. Therefore, it is possible to improve the user's sense of participation in the event.

[0121] Furthermore, in the information processing device according to the embodiment, the user image is an image of the user. This makes it possible to use an image of the user as the user-related image, thereby improving the user's sense of participation in the event.

[0122] Furthermore, in the information processing device according to the embodiment, the user-related image is an image based on a user-captured image, which is an image captured about the user. The user-captured images referred to here not only include images of users actually participating in an event with an audience, but also images of users virtually participating in an event without an audience (images of users displayed at the event venue). This makes it possible to use an image of the user as the user-related image, thereby improving the user's sense of participation in the event.

[0123] In the information processing device according to the embodiment, the user-related image is an image cut out from the user-captured image so as to include a predetermined number of users. This allows users receiving video content to recognize that they are actually or virtually participating in the event. Therefore, it is possible to improve the user's sense of participation in the event.

[0124] Furthermore, in the information processing device according to the embodiment, the predetermined number is one. This allows the user to feel more real about participating in the event when the user participates in the event individually.

[0125] Furthermore, in the information processing device as an embodiment, the predetermined number is two or more. This allows for cases where multiple users participate in an event as a group, and improves the users' sense of participation in the event.

[0126] In addition, in the information processing device as an embodiment, the user-related image is an image captured of a user image as an image showing a user displayed at the event venue, and the device is equipped with an arrangement image generation unit (tiling image generation unit F3) that generates an arrangement image in which user images of multiple users are arranged side by side as an image to be displayed at the event venue. This allows the virtual participating users to be displayed more efficiently than when the user images of each user are displayed in a time-division manner.

[0127] Furthermore, in the information processing device as the embodiment, the layout image generation unit determines the display mode of the user image in the layout image based on the behavior management information that manages the behavior history related to the user's events. According to the above configuration, the display mode of the user image in the layout image can be appropriately determined according to the user's degree of contribution to the event, etc.

[0128] Furthermore, in an information processing device as an embodiment, the behavior management information includes ticket price information indicating the price of the participation ticket for the event purchased by the user, and the layout image generation unit determines the display mode of the user image in the layout image based on the ticket price information. This allows the display mode of user images in the layout image to be appropriately determined according to the amount of the participation ticket purchased by the user, such as displaying the user image of a user who has purchased a high-value ticket larger.

[0129] In addition, in the information processing device as an embodiment, the behavior management information includes tip amount information indicating the amount of tipping made by the user to the event, and the layout image generation unit determines the display mode of the user image in the layout image based on the tip amount information. This allows the display mode of user images in the layout image to be appropriately determined depending on the amount of tip by the user, such as by displaying the user image of a user who has made a large tip in a larger size.

[0130] Furthermore, the information processing method as an embodiment is an information processing method in which an information processing device links a partial image section, which is a part of a captured video content obtained by capturing an event, with a user-related image, which is an image related to a user. This information processing method can also provide the same functions and effects as the information processing device of the above embodiment.

[0131] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0132] <6. This Technology> The present technology can also be configured as follows. (1) A linking processing unit is provided for linking a partial image section, which is a part of a captured video content obtained by capturing an event, with a user-related image, which is an image related to the user. Information processing device. (2) a content generation unit that generates video content by inserting an image based on the user-related image into the partial image section in the captured video content based on linking information between the partial image section and the user-related image generated by the linking processing unit; The information processing device according to (1) above. (3) a distribution control unit that controls the video content generated by the content generation unit to be distributed to a user associated with the user-related image; The information processing device according to (2) above. (4) The distribution control unit controls the distribution of the captured video content to other users who are not associated with the user-related image. The information processing device according to (3) above. (5) a plurality of said user-related images, each of said images being associated with a different user; The content generation unit generates a plurality of video contents by inserting images based on the user-related image into different partial image sections of the captured video content for each of the user-related images. The information processing device according to any one of (2) to (4). (6) The user-related image is an image based on a user image as an image representing the user. The information processing device according to any one of (1) to (5). (7) The user-related image is an image obtained by capturing the user image displayed at the venue of the event. The information processing device according to (6) above. (8) user images of a plurality of users are displayed at the venue of the event; The user-related image is an image of a target user among the user images displayed at the venue of the event. The information processing device according to (7) above. (9) The user image is an image of the user. The information processing device according to any one of (6) to (8). (10) The user-related image is an image based on a user-captured image, which is a captured image of the user. The information processing device according to any one of (1) to (5). (11) The user-related image is an image cut out from the user-captured image so as to include a predetermined number of users. The information processing device according to (10) above. (12) The predetermined number is 1. The information processing device according to (11) above. (13) The predetermined number is 2 or more. The information processing device according to (11) above. (14) the user-related image is an image obtained by capturing a user image displayed at the venue of the event as an image showing the user; an arrangement image generating unit that generates an arrangement image in which the user images of a plurality of users are arranged side by side as an image to be displayed at the venue of the event; The information processing device according to any one of (1) to (9). (15) The layout image generation unit determines a display mode of the user image in the layout image based on behavior management information that manages a behavior history of the user related to the event. The information processing device according to (14) above. (16) The behavior management information includes ticket price information indicating the price of a ticket to the event purchased by the user; The layout image generation unit determines a display mode of the user image in the layout image based on the ticket price information. The information processing device according to (15) above. (17) The behavior management information includes tip amount information indicating the amount of tipping made by the user to the event, The layout image generation unit determines a display mode of the user image in the layout image based on the tip amount information. The information processing device according to (15) or (16). (18) The information processing device A partial image section, which is a part of a captured video content obtained by capturing an event, is linked to a user-related image, which is an image related to the user. Information processing methods. (19) A computer readable program, The computer device is made to realize a function of linking a partial image section, which is a part of a captured video content obtained by capturing an event, with a user-related image, which is an image related to the user. program. [Explanation of symbols]

[0133] 1,1A Information processing equipment 2,2-1,2-2,2-3,2-n,2-n' Camera 3 Switcher 4 Display device 5. User terminal NT Network 70 Computer Equipment 71 CPU 72 ROM 73 RAM 74 Non-volatile memory section 75 Input / Output Interface 76 Input section 77 Display section 78 Audio output section 79 Memory section 80 Communications Department 81 Drive 82 Removable Recording Media 83 Bus F1, F1A target user selection section F2 User image acquisition section F3 Tiling image generation unit F4, F4A User subject image generation unit F5, F5A pegging processing section F6 Content generation and distribution control unit F7 Content Generation Unit IC audience seat location information

Claims

1. a linking processing unit that links a partial image section, which is a part of a captured video content obtained by capturing an event, with a user-related image, which is an image related to the user; The user-related image is an image based on a user image displayed at the venue of the event as an image showing the user. Information processing device.

2. a content generation unit that generates video content by inserting an image based on the user-related image into the partial image section in the captured video content based on linking information between the partial image section and the user-related image generated by the linking processing unit; The information processing device according to claim 1 .

3. a distribution control unit that controls the video content generated by the content generation unit to be distributed to a user associated with the user-related image; The information processing device according to claim 2 .

4. The distribution control unit controls the distribution of the captured video content to other users who are not associated with the user-related image. The information processing device according to claim 3 .

5. a plurality of said user-related images, each of said images being associated with a different user; The content generation unit generates a plurality of video contents by inserting images based on the user-related image into different partial image sections of the captured video content for each of the user-related images. The information processing device according to claim 2 .

6. user images of a plurality of users are displayed at the venue of the event; The user-related image is an image of a target user among the user images displayed at the venue of the event. The information processing device according to claim 1 .

7. The user image is an image of the user. The information processing device according to claim 1 .

8. The user-related image is an image based on a user-captured image, which is a captured image of the user. The information processing device according to claim 1 .

9. The user-related image is an image cut out from the user-captured image so as to include a predetermined number of users. The information processing device according to claim 8 .

10. The predetermined number is 1.

10. The information processing device according to claim 9.

11. The predetermined number is 2 or more. The information processing device according to claim 9 .

12. A layout image generating unit that generates a layout image in which the user images of multiple users are arranged side by side as an image to be displayed at the venue of the event. The information processing device according to claim 1 .

13. The layout image generation unit determines a display mode of the user image in the layout image based on behavior management information that manages a behavior history of the user related to the event. The information processing device according to claim 12.

14. The behavior management information includes ticket price information indicating the price of a ticket to the event purchased by the user; The layout image generation unit determines a display mode of the user image in the layout image based on the ticket price information. The information processing device according to claim 13.

15. The behavior management information includes tip amount information indicating the amount of tipping made by the user to the event, The layout image generation unit determines a display mode of the user image in the layout image based on the tip amount information. The information processing device according to claim 13.

16. The information processing device A partial image section, which is a partial section of a captured video content obtained by capturing an event, is linked to a user-related image, which is an image related to a user and is based on a user image, which is an image showing the user, displayed at the venue of the event. Information processing methods.

17. A computer readable program, The computer device realizes a function of linking a partial image section, which is a partial section of a captured video content obtained by capturing an event, with a user-related image, which is an image related to a user and is based on a user image that represents the user and is displayed at the venue of the event. program.

Images