Information processing device, information processing method, and program

Abstract

To make it easier for a viewer to view objects included in a video. [Solution] The information processing device 2 has an acquisition processing unit 231 that acquires a first video, a video generation unit 236 that generates a second video by cutting out an object area including at least a part of the target object from the video area of ​​the first video, a sound source generation unit 237 that generates a second sound source that emphasizes the sound of the target object included in the first sound source, which is the sound source of the first video, and a transmission unit 238 that transmits the first video, the second video synchronized with the first video, and the second sound source generated by the sound source generation unit to a terminal.

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] BACKGROUND ART Services for distributing moving images have been known in the past. Patent Document 1 discloses a technology for distributing moving images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-274531 Summary of the Invention [Problem to be solved by the invention]

[0004] A video viewer may not only watch the video as a whole, but also focus on an object included in the video. Therefore, there is a demand for a mechanism that makes it easier for viewers to view the object included in the video.

[0005] The present invention has been made in consideration of these points, and aims to make it easier for viewers to view objects included in moving images. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention includes a video acquisition unit that acquires a first video, a video generation unit that generates a second video by cutting out an object area including at least a part of a target object from the video area of ​​the first video, a sound source generation unit that generates a second sound source that emphasizes the sound of the target object contained in a first sound source that is the sound source of the first video, and a transmission unit that transmits the first video, the second video synchronized with the first video, and the second sound source generated by the sound source generation unit to a terminal.

[0007] The sound source generation unit may generate the second sound source by adjusting the volume of the sound of the target object to at least one of a high volume and a low volume for the sound of other objects other than the target object among the plurality of objects included in the first video, as the second sound source that emphasizes the sound of the target object.

[0008] The information processing device may further have a target object identification unit that identifies an object selected by a user using the terminal from a plurality of objects included in the first video as the target object, and the video generation unit may generate the second video corresponding to the target object identified by the target object identification unit.

[0009] The information processing device may further have a user information acquisition unit that acquires the user's level of interest in at least one of a plurality of objects included in the first video, and a target object identification unit that identifies the target object from among the plurality of objects based on the level of interest acquired by the user information acquisition unit, and the video generation unit may generate the second video corresponding to the target object identified by the target object identification unit.

[0010] The information processing device may further have a memory unit that stores information indicating a specified object in association with information indicating a similar object defined as an object similar to the specified object, the user information acquisition unit may acquire the interest level corresponding to the similar object associated with at least one of the plurality of objects, and the target object identification unit may further identify the target object from among the plurality of objects based on the interest level for the similar object acquired by the user information acquisition unit.

[0011] The target object identification unit may identify, as the target object, an object of which the interest level is equal to or greater than a predetermined threshold value, from among the plurality of objects.

[0012] The video generation unit may generate a plurality of the second videos, each of which has a different target object, and the sound source generation unit may further generate the second sound source by adjusting the volume of the sound of a target object among the plurality of target objects, the target object having a relatively high level of interest, to at least one of a high volume and a low volume of the sound of a target object among the plurality of target objects, the target object having a relatively low level of interest.

[0013] The user information acquisition unit may acquire the user's behavioral history regarding at least one of the plurality of objects, and acquire the interest level by estimating the interest level corresponding to the object based on the acquired behavioral history.

[0014] The behavioral history may be at least one of a purchase history of goods related to the object, a participation history of events in which the object appeared, and a payment history of payment for the object or fees to participate in events in which the object appeared.

[0015] The information processing device may further have a memory unit that stores a user ID (Identification) in association with the behavioral history, and the user information acquisition unit may acquire the user ID corresponding to the user and acquire the behavioral history by searching the memory unit using the acquired user ID.

[0016] The information processing device may further have a user information acquisition unit that accepts an operation by a user of the terminal to change the volume of the target object corresponding to the second video after the transmission unit transmits the first video, the second video, and the second sound source to the terminal, the sound source generation unit may generate a new second sound source from the second sound source by changing the volume of the target object in accordance with the user's operation, and the transmission unit may transmit the new second sound source to the terminal.

[0017] The information processing device may further have a user information acquisition unit that acquires area identification information for identifying attributes of the object area from the terminal, and the video generation unit may identify a reference point that serves as a basis for cutting out the object area from the video area of ​​the first video based on the attributes of the object area identified by the area identification information, and generate the second video by cutting out an area that includes the identified reference point and is determined by the attributes of the object area identified by the area identification information as the object area, and the sound source generation unit may generate the second sound source that emphasizes the sound of the target object to a degree according to the attributes of the object area.

[0018] The first video may include information indicating a nearby microphone defined as the microphone closest to each object included in the first video, and the sound source generation unit may generate the second sound source by adjusting the volume of sound picked up by at least one of the nearby microphone corresponding to the target object and the nearby microphone corresponding to another object other than the target object among the multiple objects included in the first video.

[0019] An information processing method according to a second aspect of the present invention includes the steps of: acquiring a first video, executed by a computer; generating a second video by cutting out an object area including at least a part of a target object from the video area of ​​the first video; generating a second sound source that emphasizes the sound of the target object contained in a first sound source that is the sound source of the first video; and transmitting the first video, the second video synchronized with the first video, and the generated second sound source to a terminal.

[0020] A program according to a third aspect of the present invention causes a computer to function as a video acquisition unit that acquires a first video, a video generation unit that generates a second video by cutting out an object area including at least a part of a target object from the video area of ​​the first video, a sound source generation unit that generates a second sound source that emphasizes the sound of the target object contained in the first sound source, which is the sound source of the first video, and a transmission unit that transmits the first video, the second video synchronized with the first video, and the second sound source generated by the sound source generation unit to a terminal.

[0021] [Effects of the Invention]

[0022] According to the present invention, it is possible to provide an effect that objects included in a video can be more easily viewed by a viewer. [Brief explanation of the drawings]

[0023] [Figure 1] FIG. 1 is a diagram illustrating an overview of an information processing system. [Figure 2] 3A and 3B are diagrams schematically illustrating an example of a first moving image and a second moving image. [Figure 3] FIG. 2 is a diagram schematically illustrating the functional configuration of a user terminal 1. [Figure 4] FIG. 1 is a diagram schematically illustrating a functional configuration of an information processing device. [Figure 5] FIG. 10 is a diagram illustrating an example of a configuration of an interest level management database. [Figure 6]FIG. 10 is a diagram schematically illustrating an example of a display screen of a dedicated application. [Figure 7] FIG. 10 is a diagram schematically illustrating an example of a display screen of a dedicated application. [Figure 8] 10 is a flowchart showing the flow of processing executed by the information processing device 2. DETAILED DESCRIPTION OF THE INVENTION

[0024] [Outline of Information Processing System S] FIG. 1 is a diagram for explaining an overview of an information processing system S. The information processing system S is a service used to provide an information processing service. The information processing service is a service that provides video. The video provided by the information processing service may be real-time video or archived video. The information processing system S has a user terminal 1 and an information processing device 2.

[0025] The user terminal 1 is an information processing terminal used by a user, such as a smartphone, tablet terminal, or personal computer. The user is a viewer who watches videos, such as a member of an information processing service. A dedicated application program (hereinafter referred to as a "dedicated app") is installed in the user terminal 1 to enable the user to use the information processing service. The user can watch videos using the dedicated app.

[0026] The information processing device 2 is a device that manages an information processing service, such as a server. The information processing service provides a video by providing a first video, a second video that is a close-up of at least a part of a target object included in the first video, and a sound source that emphasizes the sound of the target object. The target object is at least one of a plurality of objects included in the first video, such as an object that may attract a user's attention. The object may be a dynamic object that may attract a user's attention and that emits a sound, such as a person, an animal, or an avatar. The object may also be an object that emits a sound when operated or played by a person, such as a musical instrument. Here, methods for an object to emit a sound may include not only a sound emitted directly by the object, but also a sound emitted via a speaker connected to the object (e.g., a musical instrument). The processing executed by the information processing system S will be described below.

[0027] First, the information processing device 2 receives a request to play a video from the user terminal 1 ((1) in FIG. 1). For example, when a user performs an operation on the display screen of a dedicated app on the user terminal 1 to select a first video that the user wishes to view from among multiple first videos provided by the information processing service, the information processing device 2 receives a request to play the first video selected by the user.

[0028] Then, the information processing device 2 transmits to the user terminal 1 the first moving image, a second moving image that is generated by cutting out an object area that is an area that includes at least a part of the target object from the moving image area of ​​the first moving image and is synchronized with the first moving image, and a second sound source that emphasizes the sound of the target object included in the first sound source that is the sound source of the first moving image ((2) in FIG. 1). Thereafter, the user terminal 1 displays the first moving image and the second moving image synchronized with the first moving image acquired from the information processing device 2 on the display screen of the dedicated app, and outputs the second sound source acquired from the information processing device 2.

[0029] 2 is a diagram showing an example of a first video and a second video. Video V1 is the first video, and shows four people H (people H1, H2, H3, and H4) as objects. Video V2 is the second video. Screen D1 is a display screen for a dedicated app.

[0030] For example, if the target object is person H3, the information processing device 2 transmits a first moving image, a moving image V2 generated by cutting out area R, which is an object area including the face of person H3, from the moving image area of ​​the first moving image, and a second sound source in which the voice of person H3 included in the first sound source is emphasized, to the user terminal 1. Then, the user terminal 1 displays a screen D1 on which the moving image V1 and the moving image V2 synchronized with the moving image V1 are displayed, and outputs the second sound source.

[0031] In this way, the information processing system S can make it easier for the user to view the objects included in the first moving image. The configurations of the user terminal 1 and the information processing device 2 will be described below.

[0032] [Functional configuration of user terminal 1] FIG. 3 is a diagram schematically illustrating the functional configuration of a user terminal 1. The user terminal 1 includes an input / output unit 11, a communication unit 12, a storage unit 13, and a control unit 14. In FIG. 3, arrows indicate the main data flows, and there may be data flows not shown in FIG. 3. In FIG. 3, each functional block indicates a functional unit configuration, not a hardware (device) unit configuration. Therefore, the functional blocks shown in FIG. 3 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between functional blocks via any means, such as a data bus, a network, or a portable storage medium.

[0033] The input / output unit 11 is a user interface that receives input of information and outputs information, such as a display, a touch panel, a speaker, and the like.

[0034] The communication unit 12 is a communication interface for connecting to a network, and includes a communication controller for receiving data from an external device.

[0035] The memory unit 13 is a large-capacity storage device such as a ROM (Read Only Memory) that stores the BIOS (Basic Input Output System) of the computer that realizes the user terminal 1, a RAM (Random Access Memory) that serves as the working area of ​​the user terminal 1, an HDD (Hard Disk Drive) or SSD (Solid State Drive) that stores the OS (Operating System), application programs, and various information referenced when the application programs are executed.

[0036] The control unit 14 is a processor such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), or NPU (Neural network Processing Unit) of the user terminal 1, and functions as a transmission unit 141, an acquisition unit 142, and an output control unit 143 by executing programs stored in the memory unit 13.

[0037] [Functional configuration of information processing device 2] FIG. 4 is a diagram schematically illustrating the functional configuration of an information processing device 2. The information processing device 2 includes a communication unit 21, a storage unit 22, and a control unit 23. In FIG. 4, arrows indicate main data flows, and there may be data flows not shown in FIG. 4. In FIG. 4, each functional block indicates a configuration in functional units, rather than a configuration in hardware (device) units. Therefore, the functional blocks shown in FIG. 4 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between functional blocks via any means, such as a data bus, a network, or a portable storage medium.

[0038] The communication unit 21 is a communication interface for connecting to a network, and includes a communication controller for receiving data from an external device.

[0039] The memory unit 22 is a large-capacity storage device such as a ROM that stores the BIOS of the computer that realizes the information processing device 2, a RAM that serves as the working area of ​​the information processing device 2, an HDD or SSD that stores the OS, application programs, and various information referenced when the application programs are executed.

[0040] The storage unit 22 stores information about a first moving image provided in the information processing service, information about a predetermined object, and information about a user. The predetermined object is an object included in the first moving image provided in the information processing service.

[0041] The information related to the first moving images is, for example, information in which a first moving image ID for identifying each first moving image and a name of the first moving image are associated with each first moving image.

[0042] The information about the predetermined object is, for example, information in which, for each predetermined object, an object ID for identifying the predetermined object, the name of the predetermined object, object IDs corresponding to similar objects, an identification image of the predetermined object, and audio data of the predetermined object are associated. A similar object is an object determined to be similar to the predetermined object based on object characteristics such as gender, appearance, attributes, occupation, type, etc. The identification image of the predetermined object is, for example, an image used to identify the predetermined object from an unknown image (e.g., the first video). The audio data of the predetermined object is, for example, data used to identify the audio of the predetermined object from unknown audio (e.g., the sound source of the first video).

[0043] The information about the user is, for example, information in which a user ID for identifying the user is associated with the user's behavior history for each user. The user's behavior history is, for example, a payment history of predetermined fees paid by the user (e.g., a membership registration fee, a fee for displaying the second video, compensation for the object, a fee for participating in an event in which the object appeared, etc.), a purchase history of predetermined items purchased by the user (e.g., items specified in the information processing service, goods related to the object, etc.), a participation history of predetermined events in which the user participated (e.g., an event specified in the information processing service, an event in which the object appeared, etc.), a viewing history of videos of predetermined events viewed by the user, etc.

[0044] The storage unit 22 also stores an interest management database that manages the user's level of interest in a predetermined object. FIG. 5 is a diagram showing an example of the configuration of the interest management database. In the example shown in FIG. 5, the interest management database stores, for each combination of a user and a predetermined object, a user ID corresponding to the user, an object ID corresponding to the predetermined object, and the user's level of interest in the object, in association with each other. The level of interest is expressed, for example, as a numerical value, with a higher numerical value indicating a higher level of interest. Note that the level of interest is not limited to a numerical value and may be expressed as an index such as "high," "medium," or "low."

[0045] Returning to Figure 4, the control unit 23 is a processor such as a CPU, GPU, or NPU of the information processing device 2, and by executing programs stored in the memory unit 22, it functions as an acquisition processing unit 231, an object identification unit 232, an interest level management unit 233, a target object identification unit 234, a generation unit 235 (video generation unit 236 and sound source generation unit 237), and a transmission unit 238.

[0046] [Processing related to the provision of information processing services] Next, a process related to the provision of an information processing service executed by the information processing system S will be described.

[0047] The acquisition processing unit 231 functions as a video acquisition unit and acquires the first video. For example, if the first video is a real-time video, the acquisition processing unit 231 acquires the first video from a camera that captures an object. Also, for example, if the first video is an archived video, the acquisition processing unit 231 acquires the first video from a server (not shown) that manages the first video. Note that if the first video is stored in the storage unit 22, the acquisition processing unit 231 may acquire the first video from the storage unit 22.

[0048] For example, when acquiring a first moving image, the acquisition processing unit 231 generates a first moving image ID corresponding to the first moving image. Note that the acquisition processing unit 231 may acquire the first moving image ID corresponding to the first moving image together with the first moving image.

[0049] The object identification unit 232 identifies multiple objects included in the first moving image. For example, the object identification unit 232 first recognizes all objects included in the first moving image. The object identification unit 232 can recognize objects using, for example, a known subject recognition technology. Then, for each recognized object, the object identification unit 232 identifies the object by comparing the first moving image including the object with an identification image of a predetermined object stored in the storage unit 22, thereby identifying the object included in the first moving image.

[0050] The acquisition processing unit 231 further functions as a user information acquisition unit and acquires a playback request from the user terminal 1. The playback request is a request to play a first moving image on the user terminal 1 and includes, for example, a first moving image ID corresponding to the first moving image selected by the user. The playback request may further include a user ID corresponding to the user, etc.

[0051] For example, first, as processing in the user terminal 1, when the user selects one of the multiple first videos on the display screen of the dedicated app, the transmission unit 141 transmits a playback request including a first video ID corresponding to the first video selected by the user to the information processing device 2. Then, as processing in the information processing device 2, the acquisition processing unit 231 acquires the playback request from the user terminal 1.

[0052] The target object identification unit 234 identifies a target object from among a plurality of objects included in the first moving image. Specifically, the target object identification unit 234 identifies an object selected by the user from among a plurality of objects included in the first moving image as the target object.

[0053] For example, first, as processing of the user terminal 1, when the user selects at least one object from among a plurality of objects included in the first moving image selected by the user on the display screen of the dedicated app, the transmission unit 141 transmits a playback request further including an object ID corresponding to the object selected by the user to the information processing device 2. Then, as processing of the information processing device 2, the target object identification unit 234 identifies, as the target object, the object indicated by the object ID included in the playback request acquired by the acquisition processing unit 231.

[0054] The target object identification unit 234 may identify the target object based on the user's level of interest in an object included in the first moving image. The information processing device 2 identifies the target object based on the user's level of interest in an object included in the first moving image by performing the following two steps.

[0055] As a first step, the acquisition processing unit 231 further functions as an interest level acquisition unit and acquires the user's interest level in at least one of a plurality of objects. The acquisition processing unit 231 acquires, for example, the interest level input by the user.

[0056] Specifically, first, as processing in the user terminal 1, when the user inputs a degree of interest in at least one of a plurality of objects included in the selected first video on the display screen of the dedicated app, the sending unit 141 transmits a playback request further including the object ID corresponding to the object for which the user inputted a degree of interest and the degree of interest input by the user to the information processing device 2. Then, as processing in the information processing device 2, the acquisition processing unit 231 acquires the playback request from the user terminal 1, thereby acquiring the user's degree of interest in the object.

[0057] Fig. 6 is a diagram schematically illustrating an example of a display screen of the dedicated app. Screen D2 shown in Fig. 6(a) is a list screen displaying a list of first videos. For example, when the user first performs an operation to launch the dedicated app on the user terminal 1, the output control unit 143 displays screen D2 displaying a list of first videos acquired by the acquisition unit 142 from the information processing device 2. When the user selects a first video that the user wishes to view on screen D2, the output control unit 143 displays screen D3 shown in Fig. 6(b).

[0058] Screen D3 is a setting screen for setting the degree of interest of an object. In the example shown in Fig. 6(b), screen D3 has a setting item for setting the degree of interest of each object (e.g., four people) included in the first moving image selected by the user. In this case, when the user inputs the degree of interest corresponding to each object on screen D3 and presses the setting button, the transmission unit 141 transmits a playback request including the degree of interest corresponding to each object input by the user to the information processing device 2.

[0059] Then, the acquisition processing unit 231 acquires the user's level of interest in each object from the user terminal 1. If there is an object for which the user has not set a level of interest among the multiple objects, the acquisition processing unit 231 may acquire the level of interest corresponding to that object as the lowest level of interest, or may treat the level of interest corresponding to that object as unknown.

[0060] The acquisition processing unit 231 may acquire the order of the levels of interest instead of acquiring a numerical value indicating the level of interest itself. For example, the information processing device 2 is provided with a numerical value indicating the level of interest corresponding to each order of the levels of interest. In this case, the acquisition processing unit 231 first acquires the order of the levels of interest corresponding to each object from the user terminal 1. Then, the acquisition processing unit 231 acquires the level of interest corresponding to each object by identifying the numerical value associated with the order of the level of interest for each object. In this way, the information processing device 2 can acquire the current level of interest of the user in the object.

[0061] When acquiring the degree of interest from the user terminal 1, the acquisition processing unit 231 may acquire the degree of interest from the user terminal 1 on the condition that the user satisfies a predetermined condition. For example, the storage unit 22 stores permission conditions for determining whether to permit acceptance of the degree of interest, etc. The permission conditions include, for example, that a specific fee has been paid for an information processing service, that a specific item has been purchased, that a specific event has been attended, or that a video of a specific event has been viewed.

[0062] In this case, first, the acquisition processing unit 231 acquires the user ID from the user terminal 1, and determines whether or not a predetermined behavior by the user satisfies the permission conditions by referring to the user's behavior history associated with the acquired user ID in the storage unit 22. If the acquisition processing unit 231 determines that the predetermined behavior by the user does not satisfy the permission conditions, it does not accept the interest level from the user terminal 1, and if it determines that the predetermined behavior by the user satisfies the permission conditions, it accepts the interest level from the user terminal 1.

[0063] When the information processing device 2 does not receive the degree of interest from the user terminal 1, it may acquire a statistical degree of interest in the object as the user's degree of interest in the object, or may transmit only the first video and the first sound source without transmitting the second video and the second sound source to the user terminal 1. In this way, the information processing device 2 can provide the user with motivation to take an action that satisfies the permission conditions.

[0064] The acquisition processing unit 231 makes the determination using, for example, a common permission condition defined in the information processing service. The acquisition processing unit 231 may also make the determination using a permission condition defined for each predetermined object. For example, the storage unit 22 stores a permission condition for each predetermined object.

[0065] In this case, the acquisition processing unit 231 determines whether or not a predetermined action by the user satisfies a permission condition corresponding to an object identified by the object identification unit 232 in the first video selected by the user. The acquisition processing unit 231 may determine, for each object identified by the object identification unit 232, whether or not a predetermined action by the user satisfies a permission condition corresponding to the object, or may determine whether or not a predetermined action by the user satisfies any of a plurality of permission conditions corresponding to each of a plurality of objects identified by the object identification unit 232. Furthermore, the acquisition processing unit 231 may determine, for each target object identified by the target object identification unit 234, whether or not a predetermined action by the user satisfies a permission condition corresponding to the target object, or may determine whether or not a predetermined action by the user satisfies any of a plurality of permission conditions corresponding to each of one or more target objects identified by the target object identification unit 234.

[0066] The acquisition processing unit 231 may acquire a degree of interest corresponding to an object based on the user's behavior history. Specifically, first, the acquisition processing unit 231 acquires the user's behavior history regarding at least one of a plurality of objects. The acquisition processing unit 231 acquires the user's behavior history by, for example, acquiring a user ID corresponding to the user from the user terminal 1 and searching the storage unit 22 using the acquired user ID. The acquisition processing unit 231 may acquire the user's behavior history from the user terminal 1.

[0067] Next, the acquisition processing unit 231 estimates the degree of interest corresponding to the object based on the acquired user behavior history, thereby acquiring the user's degree of interest in the object. For example, the acquisition processing unit 231 first refers to the acquired user behavior history and tallies the user's behavioral track record with respect to each object included in the first video. The user's behavioral track record with respect to an object may be, for example, at least one of the number of times merchandise related to the object has been purchased, the total amount of money spent on merchandise related to the object, the number of times the user has attended an event in which the object appeared, the total amount of compensation paid for the object, and the total amount of fees paid to attend an event in which the object appeared.

[0068] Then, for each object included in the first video, the acquisition processing unit 231 applies a predetermined coefficient to the aggregated value of the behavioral records taken by the user toward the object to calculate the degree of interest corresponding to the object, thereby estimating the degree of interest corresponding to the object. The predetermined coefficient is a numerical value determined for converting the numerical value of the behavioral records into the degree of interest, and is a numerical value that is calculated to be higher, for example, the higher the numerical value of the behavioral records (e.g., the more times goods related to the object have been purchased). The predetermined coefficient may be a numerical value that is common to each behavioral record, or may be a numerical value that differs for each behavioral record. In this way, the information processing device 2 can acquire the user's objective degree of interest in the object.

[0069] The interest level management unit 233 functions as a recording unit and records the interest levels acquired by the acquisition processing unit 231. Specifically, the interest level management unit 233 associates the acquired user ID, the acquired interest level, and the object ID corresponding to the interest level, and stores them in the interest level management database.

[0070] If the degree of interest corresponding to an object included in the first video has already been recorded, the acquisition processing unit 231 may acquire the recorded degree of interest. Specifically, the acquisition processing unit 231 acquires the degree of interest corresponding to the object by searching the interest level management database using a user ID corresponding to the user and an object ID corresponding to the object included in the first video.

[0071] In a second step, the target object identification unit 234 identifies a target object from among the plurality of objects based on the degree of interest acquired by the acquisition processing unit 231. For example, the target object identification unit 234 identifies, as the target object, an object that has a relatively high degree of interest from the user among the plurality of objects (for example, an object with the highest degree of interest).

[0072] The target object identification unit 234 may identify an object that has a certain level of interest from the user as the target object. Specifically, the target object identification unit 234 identifies, among a plurality of objects, an object that has a level of interest that is equal to or greater than a predetermined threshold as the target object. The predetermined threshold is, for example, a numerical value used to determine whether the user is paying attention to an object or not. In this way, the information processing device 2 can prevent an object that has a low level of interest from being identified as the target object.

[0073] Here, the target object identification unit 234 may identify the target object based on the degree of interest corresponding to a similar object that is similar to an object included in the first video. The information processing device 2 identifies the target object based on the degree of interest corresponding to a similar object that is similar to an object included in the first video, for example, by performing the following two steps.

[0074] As a first step, the acquisition processing unit 231 acquires a degree of interest corresponding to a similar object associated with at least one of a plurality of objects included in the first video. For example, the acquisition processing unit 231 refers to information about a predetermined object and acquires, for each object included in the first video, a user's degree of interest in a similar object associated with the object. The acquisition processing unit 231 may acquire a degree of interest corresponding to a similar object input by the user, or may estimate a degree of interest corresponding to a similar object based on the user's behavior history regarding the similar object.

[0075] As a second step, the target object identification unit 234 further identifies a target object from among the multiple objects based on the degree of interest in the similar object acquired by the acquisition processing unit 231. Specifically, the target object identification unit 234 identifies the target object from among the multiple objects based on the degree of interest corresponding to the object included in the first video and the degree of interest corresponding to a similar object similar to the object. The target object identification unit 234 identifies the target object from among the multiple objects based on, for example, a total degree of interest obtained by adding together the degree of interest corresponding to the object included in the first video and the degree of interest corresponding to a similar object similar to the object.

[0076] The target object identification unit 234 may identify a target object from among multiple objects based on a total degree of interest obtained by weighting at least one of the degrees of interest corresponding to an object included in the first video and the degrees of interest corresponding to similar objects similar to the object by applying a predetermined coefficient. The predetermined coefficient is, for example, a numerical value determined so that the degree of interest corresponding to the object is higher than the degrees of interest corresponding to similar objects. In this way, the information processing device 2 can identify the target object taking into account the degrees of interest corresponding to similar objects similar to the object included in the first video.

[0077] When an unknown object is present among the plurality of objects included in the first video, the information processing device 2 may identify a target object from among the plurality of objects based on the user's interest level in similar objects that are similar to the unknown object. An unknown object is an object for which the user's interest level is unknown, such as an object for which the user has not input an interest level, or an object for which there is no related user behavior history.

[0078] Specifically, first, when an object is present among a plurality of objects included in the first video, the acquisition processing unit 231 acquires the user's level of interest in similar objects that are similar to the unknown object as the user's level of interest in the unknown object. Then, the target object identification unit 234 identifies a target object from among the plurality of objects based on the user's level of interest in each of the plurality of objects acquired by the acquisition processing unit 231. In this way, the information processing device 2 can estimate the level of interest corresponding to the unknown object and identify the target object.

[0079] The generation unit 235 generates a second moving image and a second sound source based on a target object, which is at least one object among a plurality of objects, from the moving image area of ​​the first moving image. Specifically, the generation unit 235 generates a second moving image corresponding to the target object identified by the target object identification unit 234. The generation unit 235 has a moving image generation unit 236 and a sound source generation unit 237.

[0080] The moving image generating unit 236 generates the second moving image by cutting out an object region that includes at least a part of the target object. For example, if the target object specifying unit 234 specifies multiple target objects, the moving image generating unit 236 may generate multiple second moving images, each with a different target object.

[0081] The moving image generating unit 236 generates the second moving image based on, for example, a predetermined attribute of the object region, such as the face of the object or the entire body of the object when the object is a person.

[0082] Specifically, first, the video generation unit 236 identifies a reference location that serves as a reference for cutting out the object region from the video area of ​​the first video, based on the attribute of the object region. The reference location is a location that serves as a reference for cutting out the object region from the video area of ​​the first video, and is, for example, a location determined according to the attribute of the object region. For example, when the attribute of the object region is "face," the reference locations are the eyes, nose, mouth, chin, etc., and when the attribute of the object region is "entire body," the reference locations are the chest, arms, legs, etc.

[0083] Then, the video generating unit 236 generates a second video by cutting out a predetermined area including the identified reference location as an object area. The predetermined area is an area determined according to the attributes of the object area and the reference location. In this way, the information processing device 2 can generate a second video that captures at least a part of the object, even if the object is a dynamic object.

[0084] When attributes of a plurality of object regions are defined, the moving image generating unit 236 may generate, for each target object, a plurality of second moving images corresponding to the target object, the plurality of second moving images corresponding to the respective attributes of the plurality of object regions. For example, suppose that, when the target object is a person, two attributes of the object region are defined: the face of the target object and the entire body of the target object.

[0085] In this case, the video generating unit 236 generates, for each target object, a second video corresponding to the face of the target object and a second video corresponding to the entire body of the target object. In this way, the information processing device 2 can present to the user second videos in which the target object is shown in close-up in various ways.

[0086] For example, when generating a second moving image, the moving image generating unit 236 sets object IDs corresponding to objects included in the second moving image and attributes of object areas of the second moving image as metadata for the second moving image.

[0087] The sound source generation unit 237 generates a second sound source that emphasizes the sound of the target object included in the first sound source, which is the sound source of the first moving image. Specifically, the sound source generation unit 237 generates a second sound source in which the sound of the target object is adjusted to a higher volume as the second sound source in which the sound of the target object is emphasized. The sound source generation unit 237 may also generate a second sound source in which the sound of objects other than the target object among the multiple objects is adjusted to a lower volume. Furthermore, the sound source generation unit 237 may also generate a second sound source in which the sound of the target object is adjusted to a higher volume and the sound of the other objects is adjusted to a lower volume as the second sound source in which the sound of the target object is emphasized. In this way, the information processing device 2 can make it easier for the user to hear the sound of the target object.

[0088] For example, the first video includes information indicating a nearby microphone that is determined as a microphone close to each object included in the first video. The nearby microphone is, for example, a pin microphone attached to the object or a fixed microphone installed near the object.

[0089] In this case, the sound source generation unit 237 generates a second sound source by adjusting the volume of the sound collected by at least one of the nearby microphone corresponding to the target object and the nearby microphone corresponding to an object other than the target object among the plurality of objects. In this way, the information processing device 2 can emphasize the sound of the target object.

[0090] The sound source generation unit 237 may generate a second sound source based on the first sound source using a known sound source separation technique. For example, the sound source generation unit 237 first separates the first sound source into sound sources of each type (for example, each object, each instrument, etc.) using a known sound source separation technique. Then, the sound source generation unit 237 adjusts the volume of at least one of the separated sound sources, which are the separated sound sources, to emphasize the sound of the target object, and generates the second sound source by synthesizing the separated sound sources in which the sound of the target object is emphasized.

[0091] The sound source generation unit 237 generates a second sound source in which the sound of the target object is emphasized at a predetermined level, for example. The sound source generation unit 237 may generate a second sound source in which the sound is emphasized at a level corresponding to the user's level of interest in the target object. For example, a level to which the sound of the object is emphasized is determined for each predetermined level of interest, and the sound source generation unit 237 generates a second sound source in which the sound is emphasized at a level corresponding to the user's level of interest in the target object.

[0092] When the target object identification unit 234 identifies multiple target objects, the sound source generation unit 237 may generate a second sound source in which the sound of each target object is emphasized to a degree corresponding to the user's level of interest in that object. Specifically, the sound source generation unit 237 generates a second sound source in which the sound of a target object is emphasized more than the sound of other objects other than the target object, and in which the sound of a target object in which the user has a relatively high level of interest among the multiple target objects is adjusted to a higher volume. The sound source generation unit 237 may generate a second sound source in which the sound of a target object is emphasized more than the sound of other objects other than the target object, and in which the sound of a target object in which the user has a relatively low level of interest among the multiple target objects is adjusted to a lower volume.

[0093] Furthermore, the sound source generating unit 237 may generate a second sound source in which the sound of a target object is emphasized more than the sound of other objects other than the target object, and in which the sound of a target object in which the user has a relatively high level of interest among the plurality of target objects is adjusted to a high volume, and the sound of a target object in which the user has a relatively low level of interest among the plurality of target objects is adjusted to a low volume. In this way, the information processing device 2 can make the sound of the plurality of target objects easier for the user to hear, while making the sound of a target object in which the user has a high level of interest even easier to hear.

[0094] Although the example in which the generation unit 235 generates the second moving image according to the attributes of a predetermined object region has been described above, the present invention is not limited to this. For example, the generation unit 235 may generate the second moving image and the second sound source according to the attributes of an object region specified by the user. Specifically, the information processing device 2 generates the second moving image and the second sound source according to the attributes of the object region specified by the user by executing the following three steps.

[0095] As a first step, the acquisition processing unit 231 acquires region identification information from the user terminal 1. The region identification information is information for identifying attributes of an object region, such as the face of the object or the entire body of the object when the object is a person.

[0096] Fig. 7 is a diagram schematically illustrating an example of a display screen of the dedicated app. Screen D4 shown in Fig. 7 is a setting screen for setting attributes of an object region, etc. In the example shown in Fig. 7, screen D4 displays "face" and "whole body" as predetermined attributes of the object region. In this case, when the user selects "face" on screen D3 and presses the setting button, transmission unit 141 of user terminal 1 transmits information indicating the "face" selected by the user to information processing device 2 as region identification information.

[0097] Then, the acquisition processing unit 231 acquires the area specifying information from the user terminal 1. In this way, the information processing device 2 can make it easier for the user to specify the attributes of the object area that he or she desires.

[0098] The acquisition processing unit 231 may receive the area identification information based on a designated area designated by the user in the video area of ​​the first video displayed on the user terminal 1. For example, the information processing device 2 associates predetermined attributes of object areas with predetermined object parts (e.g., eyes, nose, mouth, arms, chest, legs, etc.).

[0099] In this case, when the user first selects a first video that the user wishes to view on the list screen, the user terminal 1 acquires the first video selected by the user from the information processing device 2 and displays a video playback screen showing the acquired first video. When the user taps on a part of the video area of ​​the first video displayed on the video playback screen, the transmission unit 141 of the user terminal 1 transmits information indicating the area tapped by the user to the information processing device 2 as information indicating a designated area. The information indicating the designated area is, for example, information indicating a position in the video area of ​​the first video.

[0100] When the acquisition processing unit 231 acquires information indicating the designated area from the user terminal 1, the object identification unit 232 identifies the part of the object included in the designated area in the video area of ​​the first video using a known subject recognition technique. Then, the acquisition processing unit 231 acquires the area identification information by identifying the attribute of the object area associated with the part of the object identified by the object identification unit 232. In this way, the information processing device 2 can easily specify the attribute of the object area desired by the user.

[0101] The acquisition processing unit 231 may acquire area identification information on the condition that the user satisfies a predetermined condition (for example, a permission condition stored in the storage unit 22). Furthermore, the acquisition processing unit 231 may increase or decrease the number of object area attributes that are permitted to be accepted depending on whether the user satisfies the predetermined condition. For example, the attributes of the object area include a first attribute and a second attribute. The first attribute is an attribute of one or more object areas that is permitted to be designated regardless of whether or not the user has performed a predetermined action. The second attribute is an attribute of one or more object areas that is permitted to be designated depending on the user's predetermined action. Furthermore, the permission condition in this case is a condition for determining whether or not to permit designation of the second attribute.

[0102] In this case, if the acquisition processing unit 231 determines that the user does not satisfy the predetermined condition, it does not accept the area specifying information corresponding to the second attribute and accepts only the area specifying information corresponding to the first attribute. On the other hand, if the acquisition processing unit 231 determines that the user satisfies the predetermined condition, it accepts the area specifying information corresponding to the first attribute or the area specifying information corresponding to the second attribute. In this way, the information processing device 2 can provide the user with motivation to take action that satisfies the predetermined condition.

[0103] In a second step, the moving image generating unit 236 generates a second moving image based on the attributes of the object region specified by the region specifying information. Specifically, the moving image generating unit 236 first identifies a reference point that serves as a reference for cutting out the object region from the moving image region of the first moving image based on the attributes of the object region specified by the region specifying information. The moving image generating unit 236 then generates the second moving image by cutting out, as the object region, an area that includes the identified reference point and is determined by the attributes of the object region specified by the region specifying information.

[0104] In a third step, the sound source generation unit 237 generates a second sound source in which the sound of the target object is emphasized at a degree of emphasis according to the attribute of the object region. For example, a degree of emphasis is determined for each attribute of a predetermined object region, and the sound source generation unit 237 generates a second sound source in which the sound of the target object is emphasized at a degree corresponding to the attribute of the object region identified by the region identification information acquired by the acquisition processing unit 231. In this way, the information processing device 2 can provide a second moving image and a second sound source according to the attribute of the object region specified by the user.

[0105] The generation unit 235 may generate a second video and a second sound source according to the level of interest in the target object. Specifically, the video generation unit 236 generates a second video of a size according to the level of interest in the target object as the second video according to the level of interest in the target object. For example, the higher the user's level of interest, the larger the size of the second video generated by the video generation unit 236. For example, the size of the second video is determined for each predetermined level of interest, and the video generation unit 236 generates a second video of a size corresponding to the user's level of interest in the target object.

[0106] The sound source generating unit 237 generates a second sound source in which the sound of the target object is emphasized to a degree corresponding to the degree of interest in the target object as a second sound source corresponding to the degree of interest in the target object. For example, the sound source generating unit 237 generates a second sound source in which the sound of the target object is emphasized to a greater extent as the degree of interest in the target object is higher.

[0107] For example, a degree of sound emphasis is determined for each predetermined interest level, and the sound source generating unit 237 generates a second sound source in which the sound of the target object is emphasized to a degree corresponding to the user's interest level in the target object. In this way, the information processing device 2 can make the target object easier to view as the user's interest level in the target object increases.

[0108] The transmission unit 238 transmits the first moving image, the second moving image synchronized with the first moving image, and the second sound source to the user terminal 1. For example, the transmission unit 238 transmits the first moving image in which the sound source has been changed from the first sound source to the second sound source, and the second moving image synchronized with the first moving image to the user terminal 1.

[0109] The transmitting unit 238 transmits, for example, the first moving image and the second moving image and the second sound source selected based on the target object identified by the target object identifying unit 234 to the user terminal 1. Specifically, first, when the object identifying unit 232 identifies an object included in the second moving image, the generating unit 235 generates, for each object included in the first moving image, a second moving image and a second sound source corresponding to the object.

[0110] The transmission unit 238 selects a second moving image corresponding to the target object identified by the target object identification unit 234 from the plurality of second moving images generated by the generation unit 235, and selects a second sound source corresponding to the target object identified by the target object identification unit 234 from the plurality of second sound sources generated by the generation unit 235. Then, the transmission unit 238 transmits the first moving image, the selected second moving image that is synchronized with the first moving image, and the selected second sound source to the user terminal 1.

[0111] The transmission unit 238 may transmit the first moving image, and the second moving image and the second sound source generated based on the target object identified by the target object identification unit 234, to the user terminal 1. Specifically, first, when the target object identification unit 234 identifies the target object, the generation unit 235 generates the second moving image and the second sound source corresponding to the target object. Then, the transmission unit 238 transmits the first moving image, the second moving image generated by the generation unit 235 and synchronized with the first moving image, and the second sound source generated by the generation unit 235 to the user terminal 1.

[0112] The transmission unit 238 may transmit the second moving image and the second sound source, the quality of which corresponds to the level of interest in the target object, to the user terminal 1. The quality of the second moving image is, for example, resolution, frame rate, compression rate, etc. The quality of the second sound source is, for example, resolution, compression rate, etc. For example, for each predetermined level of interest, the quality of the second moving image and the quality of the second sound source corresponding to the predetermined level of interest are determined.

[0113] In this case, the transmitting unit 238 transmits the generated second video and second sound source to the user terminal 1 at a quality corresponding to the user's level of interest in the target object corresponding to the second video and second sound source. For example, it is determined that the higher the level of interest, the higher the quality of the second video and the second sound source, and the transmitting unit 238 transmits to the user terminal 1 the second video and the second sound source of higher quality for a target object with a relatively high level of interest than for a target object with a relatively low level of interest. Note that instead of the transmitting unit 238 performing a process to adjust the quality of the second video to correspond to the level of interest corresponding to the target object, the video generating unit 236 may generate the second video and the second sound source of a quality corresponding to the level of interest corresponding to the target object. In this way, the information processing device 2 can, for example, make it easier for the user to view an object with a high level of interest.

[0114] The user terminal 1 outputs the first video, the second video, and the second sound source. Specifically, when the acquisition unit 142 acquires the first video, the second video, and the second sound source from the information processing device 2, the output control unit 143 displays the first video and the second video synchronized with the first video on a video playback screen, which is a display screen of the dedicated app, and outputs the second sound source.

[0115] After transmitting the first video, the second video, and the second sound source to the user terminal 1, the information processing device 2 may update the degree of interest corresponding to the object included in the first video in response to a user operation. Specifically, first, the acquisition processing unit 231 acquires information indicating a user operation on the second video displayed on the user terminal 1 by the transmission unit 238 transmitting the first video and the second video to the user terminal 1. The user operation on the second video is, for example, an operation to change the position of the second video, an operation to change the size of the second video, an operation to change the displayed second video to another second video that is not being displayed, an operation to express a positive intention toward the second video, such as pressing a "Like" button, etc.

[0116] Then, the interest level management unit 233 updates the degree of interest stored in the interest level management database in association with the object ID of the object corresponding to the second video, based on the user's operation on the second video indicated by the information acquired by the acquisition processing unit 231. For example, if the user performs an operation to swap the positions of two second videos on the video playback screen, the interest level management unit 233 updates the degree of interest corresponding to the object of the second video that has been swapped to a higher position in the order of the two second videos, and updates the degree of interest corresponding to the object of the second video that has been swapped to a lower position in the order of the two second videos.

[0117] In this way, the information processing device 2 can update the user's level of interest in the object in response to the user's operation. When the user's level of interest in an object included in the first video is updated, the information processing device 2 may identify the target object, generate the second video, and generate the second sound source based on the updated level of interest.

[0118] After transmitting the first moving image, the second moving image, and the second sound source to the user terminal 1, the transmission unit 238 may transmit a new second sound source that has been changed in response to a user operation to the user terminal 1. Specifically, the information processing device 2 transmits the new second sound source to the user terminal 1 by executing the following three steps.

[0119] In a first step, the acquisition processing unit 231 receives an operation by the user to change the volume of a target object corresponding to the second video after the transmission unit 238 transmits the first video, the second video, and the second sound source to the user terminal 1. For example, the video playback screen is provided with an adjustment item for adjusting the volume of the object corresponding to each second video, and when the user performs an operation to adjust the volume of the object using the adjustment item, the acquisition processing unit 231 acquires information indicating the volume of the object adjusted by the user.

[0120] In a second step, the sound source generating unit 237 generates a new second sound source by changing the volume of the target object from the second sound source in response to a user operation. For example, the sound source generating unit 237 generates a new second sound source by changing the volume of the target object from the second sound source to a volume that corresponds to the volume adjusted by the user in the adjustment item.

[0121] In a third step, the transmitting unit 238 transmits the new second sound source to the user terminal 1. In this way, the information processing device 2 can provide a sound source in which the sound of the target object is emphasized to a degree desired by the user.

[0122] [Processing of information processing device 2] Next, a description will be given of the flow of processing by the information processing device 2. Fig. 8 is a flowchart showing the flow of processing executed by the information processing device 2. This flowchart starts when the acquisition processing unit 231 acquires a first moving image (S1).

[0123] The object identification unit 232 identifies an object included in the first moving image (S2). When the object identification unit 232 identifies an object included in the first moving image, the generation unit 235 generates a second moving image and a second sound source corresponding to each object included in the first moving image (S3).

[0124] The acquisition processing unit 231 acquires from the user terminal 1 a playback request including a first video ID corresponding to a first video selected by the user from the list of first videos and an object ID corresponding to an object selected by the user from among multiple objects included in the first video (S4). The target object identification unit 234 identifies, as the target object, the object indicated by the object ID included in the playback request acquired by the acquisition processing unit 231 (S5).

[0125] The transmission unit 238 selects a second moving image corresponding to the target object identified by the target object identification unit 234 from the plurality of second moving images generated by the generation unit 235, and selects a second sound source corresponding to the target object identified by the target object identification unit 234 from the plurality of second sound sources generated by the generation unit 235 (S6). Then, the transmission unit 238 transmits the first moving image, the selected second moving image that is synchronized with the first moving image, and the second sound source to the user terminal 1 (S7).

[0126] [Effects of this embodiment] As described above, the information processing device 2 transmits a first moving image, a second moving image that is generated by cutting out an object area that includes at least a part of a target object from the moving image area of ​​the first moving image and that is synchronized with the first moving image, and a second sound source that emphasizes the sound of the target object included in the first sound source, to the user terminal 1. In this way, the information processing device 2 can make it easier for the user to view the object included in the first moving image.

[0127] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is "Build resilient infrastructure, promote inclusive and sustainable industrialization, and promote innovation and resilience."

[0128] The present invention has been described above using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by functionally or physically distributing or integrating any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combination also have the effects of the original embodiments. [Explanation of symbols]

[0129] 1. User terminal 11 Input / output section 12 Communications Department 13 Storage section 14 Control Unit 141 Transmitter 142 Acquisition Department 143 Output control section 2. Information processing equipment 21 Communications Department 22 Memory section 23 Control Unit 231 Acquisition processing unit 232 Object Identification Section 233 Interest Management Department 234 Target object identification part 235 Generation part 236 Video Generation Unit 237 Sound source generation section 238 Transmitter S Information Processing System

Claims

1. a moving image acquisition unit that acquires a first moving image; a moving image generating unit that generates a second moving image by cutting out an object area including at least a part of a target object, which is at least one of a plurality of objects identified by analyzing the first moving image, from a moving image area of ​​the first moving image; a sound source generating unit that generates a second sound source by emphasizing the sound of the target object included in a first sound source that is a sound source of the first moving image; a transmitting unit that transmits the first video, the second video synchronized with the first video, and the second sound source generated by the sound source generating unit to a terminal; An information processing device having the above.

2. the sound source generation unit generates the second sound source in which the sound of the target object is emphasized by adjusting the volume of the sound of the target object to at least one of a high volume and a low volume of the sound of other objects other than the target object among the plurality of objects. The information processing device according to claim 1 .

3. the information processing device further includes a target object identification unit that identifies the object selected by a user of the terminal from the plurality of objects as the target object; the moving image generation unit generates the second moving image corresponding to the target object identified by the target object identification unit. The information processing device according to claim 1 .

4. The information processing device includes: a user information acquisition unit that acquires a user's interest level in at least one of the plurality of objects; a target object specifying unit that specifies the target object from among the plurality of objects based on the interest level acquired by the user information acquiring unit; and the moving image generation unit generates the second moving image corresponding to the target object identified by the target object identification unit. The information processing device according to claim 1 .

5. the information processing device further includes a storage unit that stores information indicating a predetermined object and information indicating a similar object determined as an object similar to the predetermined object in association with each other; the user information acquisition unit acquires the interest level corresponding to the similar object associated with at least one of the plurality of objects; the target object identification unit further identifies the target object from among the plurality of objects based on the degree of interest in the similar object acquired by the user information acquisition unit. The information processing device according to claim 4 .

6. the target object identification unit identifies, as the target object, an object among the plurality of objects whose interest level is equal to or greater than a predetermined threshold value; The information processing device according to claim 4 .

7. the moving image generation unit generates a plurality of second moving images each having a different target object; The sound source generating unit further generates the second sound source by adjusting at least one of a volume of a sound of a target object having a relatively high interest level among the plurality of target objects and a volume of a sound of a target object having a relatively low interest level among the plurality of target objects. The information processing device according to claim 4 .

8. the user information acquisition unit acquires a behavior history of the user regarding at least one of the plurality of objects, and estimates the interest level corresponding to the object based on the acquired behavior history, thereby acquiring the interest level. The information processing device according to claim 4 .

9. The behavioral history is at least one of a purchase history of goods related to the object, a participation history of an event in which the object appeared, and a payment history of a payment for the object or a fee for participating in an event in which the object appeared. The information processing device according to claim 8 .

10. The information processing device further includes a storage unit that stores a user ID (Identification) and the behavior history in association with each other, the user information acquisition unit acquires the user ID corresponding to the user, and acquires the behavior history by searching the storage unit using the acquired user ID. The information processing device according to claim 8 or 9.

11. the information processing device further includes a user information acquisition unit that receives an operation by a user of the terminal to change a volume of the target object corresponding to the second video after the transmission unit transmits the first video, the second video, and the second sound source to the terminal; the sound source generation unit generates a new second sound source by changing a volume of the target object from the second sound source in response to the user's operation; The transmission unit transmits the new second sound source to the terminal. The information processing device according to claim 1 .

12. the information processing device further includes a user information acquisition unit that acquires area identification information for identifying an attribute of the object area from the terminal; the moving image generation unit identifies a reference point that serves as a reference for cutting out the object area from the moving image area of ​​the first moving image based on the attributes of the object area identified by the area identification information, and generates the second moving image by cutting out, as the object area, an area that includes the identified reference point and is determined by the attributes of the object area identified by the area identification information; the sound source generation unit generates the second sound source by emphasizing the sound of the target object at a level according to the attribute of the object region. The information processing device according to claim 1 .

13. the first moving image includes information indicating a nearby microphone defined for each of the objects as a microphone close to the object; the sound source generation unit generates the second sound source by adjusting the volume of the sound collected by at least one of the nearby microphone corresponding to the target object and the nearby microphone corresponding to another object other than the target object among the plurality of objects. The information processing device according to claim 1 .

14. The computer executes acquiring a first moving image; generating a second moving image by cutting out an object area including at least a portion of a target object, the target object being at least one of a plurality of objects identified by analyzing the first moving image, from a moving image area of ​​the first moving image; generating a second sound source by emphasizing the sound of the target object included in a first sound source that is a sound source of the first moving image; transmitting the first video, the second video synchronized with the first video, and the generated second sound source to a terminal; An information processing method comprising:

15. Computer, a video acquisition unit that acquires a first video; a moving image generating unit that generates a second moving image by cutting out an object area including at least a part of a target object, which is at least one of a plurality of objects identified by analyzing the first moving image, from a moving image area of ​​the first moving image; a sound source generating unit that generates a second sound source by emphasizing the sound of the target object included in a first sound source that is a sound source of the first moving image; and a transmitting unit that transmits the first video, the second video synchronized with the first video, and the second sound source generated by the sound source generating unit to a terminal; A program to function as a

Images