Information processing device, information processing method, program, and information processing terminal

Abstract

To make it easier for a viewer to see objects contained in a video. [Solution] The information processing device 2 has an acquisition processing unit 231 that acquires a first video, an object identification unit 232 that identifies multiple objects included in the first video, a video generation unit 236 that generates a second video by cutting out an object area including at least a part of a target object which is at least one of the multiple objects from the video area of ​​the first video, a sound source generation unit 237 that generates a second sound source that emphasizes the sound of the target object included in the first sound source which is the sound source of the first video, and a transmission unit 238 that transmits the first video, the second video synchronized with the first video, and the second sound source generated by the sound source generation unit to a user terminal.

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, a program, and an information processing terminal. [Background technology]

[0002] 2. Description of the Related Art Conventionally, services for distributing moving images are known. Patent Document 1 discloses a technology for distributing moving images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2004-274531 A Summary of the Invention [Problem to be solved by the invention]

[0004] A viewer of a video may not only view the video as a whole, but may also focus on an object included in the video. Therefore, there is a demand for providing a mechanism for enabling a viewer to easily view an object included in the video.

[0005] The present invention has been made in consideration of these points, and has an object to make it easier for viewers to view objects included in moving images. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention comprises a video acquisition unit that acquires a first video, an object identification unit that identifies a plurality of objects included in the first video, a video generation unit that generates a second video by cutting out an object area including at least a part of a target object, which is at least one of the plurality of objects, from a video area of ​​the first video, a sound source generation unit that generates a second sound source that emphasizes the sound of the target object included in a first sound source, which is the sound source of the first video, and a transmission unit that transmits the first video, the second video synchronized with the first video, and the second sound source generated by the sound source generation unit to a user terminal.

[0007] The sound source generation unit may generate the second sound source by adjusting the volume of the sound of the target object to at least one of a high volume and a low volume of the sound of other objects among the plurality of objects other than the target object as the second sound source that emphasizes the sound of the target object.

[0008] The information processing device may further have a target object identification unit that identifies an object selected by a user using the user terminal from a plurality of objects as the target object, and the video generation unit may generate the second video corresponding to the target object identified by the target object identification unit.

[0009] The information processing device may further have a user information acquisition unit that acquires a user's level of interest in at least one of the plurality of objects, and a target object identification unit that identifies the target object from among the plurality of objects based on the level of interest acquired by the user information acquisition unit, and the video generation unit may generate the second video corresponding to the target object identified by the target object identification unit.

[0010] The information processing device may further have a memory unit that associates and stores information indicating a specified object with information indicating a similar object defined as an object similar to the specified object, the user information acquisition unit may acquire the degree of interest corresponding to the similar object associated with at least any of the multiple objects, and the target object identification unit may further identify the target object from among the multiple objects based on the degree of interest in the similar object acquired by the user information acquisition unit.

[0011] The target object identification unit may identify, as the target object, an object among the plurality of objects whose interest level is equal to or greater than a predetermined threshold.

[0012] The video generation unit may generate a plurality of the second videos, each of which has a different target object, and the sound source generation unit may further generate the second sound source by adjusting the volume of the sound of a target object having a relatively high level of interest among the plurality of target objects to at least one of a high volume and a low volume of the sound of a target object having a relatively low level of interest among the plurality of target objects.

[0013] The user information acquisition unit may acquire a behavioral history of the user regarding at least one of the plurality of objects, and acquire the degree of interest by estimating the degree of interest corresponding to the object based on the acquired behavioral history.

[0014] The behavioral history may be at least one of a purchasing history of goods related to the object, a participation history of an event in which the object appeared, and a payment history of payment of compensation for the object or a fee to attend an event in which the object appeared.

[0015] The information processing device may further have a memory unit that stores a user ID (Identification) in association with the behavioral history, and the user information acquisition unit may acquire the user ID corresponding to the user and acquire the behavioral history by searching the memory unit using the acquired user ID.

[0016] The information processing device may further have a user information acquisition unit that accepts an operation by a user using the user terminal to change the volume of the target object corresponding to the second video after the transmission unit transmits the first video, the second video, and the second sound source to the user terminal, the sound source generation unit may generate a new second sound source from the second sound source by changing the volume of the target object in accordance with the user's operation, and the transmission unit may transmit the new second sound source to the user terminal.

[0017] The information processing device may further have a user information acquisition unit that acquires area identification information for identifying attributes of the object area from the user terminal, and the video generation unit may identify a reference point that serves as a basis for cutting out the object area from the video area of ​​the first video based on the attributes of the object area identified by the area identification information, and generate the second video by cutting out an area that includes the identified reference point and is determined by the attributes of the object area identified by the area identification information as the object area, and the sound source generation unit may generate the second sound source in which the sound of the target object is emphasized to a degree according to the attributes of the object area.

[0018] The first video may include information indicating a nearby microphone defined for each object as the microphone closest to the object, and the sound source generation unit may generate the second sound source by adjusting the volume of sound picked up by at least one of the nearby microphone corresponding to the target object and the nearby microphone corresponding to another object among the multiple objects other than the target object.

[0019] An information processing method according to a second aspect of the present invention includes the steps of: acquiring a first video, executed by a computer; identifying a plurality of objects included in the first video; generating a second video by cutting out an object area including at least a part of a target object, which is at least one of the plurality of objects, from a video area of ​​the first video; generating a second sound source that emphasizes the sound of the target object included in a first sound source, which is the sound source of the first video; and transmitting the first video, the second video synchronized with the first video, and the generated second sound source to a user terminal.

[0020] A program according to a third aspect of the present invention causes a computer to function as: a video acquisition unit that acquires a first video; an object identification unit that identifies a plurality of objects included in the first video; a video generation unit that generates a second video by cutting out an object area including at least a part of a target object, which is at least one of the plurality of objects, from the video area of ​​the first video; a sound source generation unit that generates a second sound source that emphasizes the sound of the target object included in a first sound source, which is the sound source of the first video; and a transmission unit that transmits the first video, the second video synchronized with the first video, and the second sound source generated by the sound source generation unit to a user terminal.

[0021] An information processing terminal according to a fourth aspect of the present invention has a transmitting unit that transmits information indicating a target object, which is an object selected by a user from a plurality of objects included in a first video, to an information processing device; an acquisition unit that acquires from the information processing device the first video and a second sound source in which the sound of the target object included in the first sound source, which is the sound source of the first video, is emphasized; the first video and a second video generated by cutting out an object area including at least a part of the target object from the video area of ​​the first video, the second video being synchronized with the first video; and an output control unit that outputs the first video, the second video, and the second sound source acquired by the acquisition unit. Effect of the Invention

[0022] According to the present invention, it is possible to provide an effect that objects included in a video can be easily viewed by a viewer. [Brief description of the drawings]

[0023] [Figure 1] FIG. 1 is a diagram for explaining an overview of an information processing system. [Diagram 2] 4A to 4C are diagrams illustrating examples of a first moving image and a second moving image. [Diagram 3] FIG. 2 is a diagram illustrating a functional configuration of a user terminal 1. [Figure 4] FIG. 2 is a diagram illustrating a functional configuration of an information processing device. [Diagram 5] FIG. 13 is a diagram illustrating an example of a configuration of an interest level management database. [Figure 6] FIG. 13 is a diagram illustrating an example of a display screen of a dedicated application. [Figure 7] FIG. 13 is a diagram illustrating an example of a display screen of a dedicated application. [Figure 8] 13 is a flowchart showing the flow of processing executed by the information processing device 2. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] [Outline of Information Processing System S] FIG. 1 is a diagram for explaining an overview of an information processing system S. The information processing system S is a service used for providing an information processing service. The information processing service is a service for providing moving images. The moving images provided by the information processing service may be real-time moving images or archived moving images. The information processing system S has a user terminal 1 and an information processing device 2.

[0025] The user terminal 1 is an information processing terminal used by a user, such as a smartphone, a tablet terminal, or a personal computer. The user is a viewer who watches videos, such as a member of an information processing service. A dedicated application program (hereinafter, referred to as a "dedicated app") is installed in the user terminal 1 to enable the user to use the information processing service. The user can watch videos using the dedicated app.

[0026] The information processing device 2 is a device that manages an information processing service, and is, for example, a server. In the information processing service, a video is provided by providing a first video, which is the video, a second video in which at least a part of a target object included in the first video is zoomed in, and a sound source that emphasizes the sound of the target object. The target object is at least one of a plurality of objects included in the first video, and is, for example, an object that the user may pay attention to. The object is, for example, a person, an animal, an avatar, or the like, which is a dynamic object that the user may pay attention to and which emits a sound. In addition, the object may be, for example, a musical instrument, or the like, which emits a sound when operated or played by a person. Here, the method of the object emitting a sound may include not only a sound emitted directly by the object, but also a case where the sound is emitted via a speaker connected to the object (for example, a musical instrument). The processes executed by the information processing system S will be described below.

[0027] First, the information processing device 2 acquires a request to play a video from the user terminal 1 ((1) in FIG. 1). For example, when a user performs an operation on a display screen of a dedicated app on the user terminal 1 to select a first video that the user wishes to watch from among multiple first videos provided by the information processing service, the information processing device 2 acquires a request to play the first video selected by the user.

[0028] Then, the information processing device 2 transmits to the user terminal 1 the first moving image, a second moving image generated by cutting out an object area, which is an area including at least a part of the target object, from the moving image area of ​​the first moving image and synchronized with the first moving image, and a second sound source that emphasizes the sound of the target object included in the first sound source, which is the sound source of the first moving image ((2) in FIG. 1). After that, the user terminal 1 displays the first moving image acquired from the information processing device 2 and the second moving image synchronized with the first moving image on the display screen of the dedicated app, and outputs the second sound source acquired from the information processing device 2.

[0029] 2 is a diagram showing an example of a first moving image and a second moving image. A moving image V1 is a first moving image, and four people H (people H1, H2, H3, and H4) are shown as objects. A moving image V2 is a second moving image. A screen D1 is a display screen of a dedicated application.

[0030] For example, when the target object is person H3, the information processing device 2 transmits a first moving image, a moving image V2 generated by cutting out an area R that is an object area including the face of person H3 from the moving image area of ​​the first moving image, and a second sound source in which the voice of person H3 included in the first sound source is emphasized, to the user terminal 1. Then, the user terminal 1 displays a screen D1 on which the moving image V1 and the moving image V2 synchronized with the moving image V1 are displayed, and outputs the second sound source.

[0031] In this way, the information processing system S can make it easier for the user to view the object included in the first moving image. The configurations of the user terminal 1 and the information processing device 2 will be described below.

[0032] [Functional configuration of user terminal 1] FIG. 3 is a diagram showing a schematic functional configuration of a user terminal 1. The user terminal 1 includes an input / output unit 11, a communication unit 12, a storage unit 13, and a control unit 14. In FIG. 3, arrows indicate main data flows, and there may be data flows not shown in FIG. 3. In FIG. 3, each functional block indicates a functional unit configuration, not a hardware (device) unit configuration. Therefore, the functional blocks shown in FIG. 3 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between functional blocks via any means, such as a data bus, a network, or a portable storage medium.

[0033] The input / output unit 11 is a user interface that receives input of information and outputs information, such as a display, a touch panel, a speaker, and the like.

[0034] The communication unit 12 is a communication interface for connecting to a network, and includes a communication controller for receiving data from an external device.

[0035] The memory unit 13 is a large-capacity storage device such as a ROM (Read Only Memory) that stores the BIOS (Basic Input Output System) of the computer that realizes the user terminal 1, a RAM (Random Access Memory) that serves as the working area of ​​the user terminal 1, an HDD (Hard Disk Drive) or SSD (Solid State Drive) that stores the OS (Operating System), application programs, and various information referenced when the application programs are executed.

[0036] The control unit 14 is a processor such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), or NPU (Neural network Processing Unit) of the user terminal 1, and functions as a transmission unit 141, an acquisition unit 142, and an output control unit 143 by executing programs stored in the memory unit 13.

[0037] [Functional configuration of information processing device 2] FIG. 4 is a diagram showing a schematic functional configuration of the information processing device 2. The information processing device 2 includes a communication unit 21, a storage unit 22, and a control unit 23. In FIG. 4, arrows indicate main data flows, and there may be data flows not shown in FIG. 4. In FIG. 4, each functional block indicates a functional unit configuration, not a hardware (device) unit configuration. Therefore, the functional blocks shown in FIG. 4 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between the functional blocks via any means, such as a data bus, a network, or a portable storage medium.

[0038] The communication unit 21 is a communication interface for connecting to a network, and includes a communication controller for receiving data from an external device.

[0039] The memory unit 22 is a large-capacity storage device such as a ROM that stores the BIOS of the computer that realizes the information processing device 2, a RAM that serves as the working area of ​​the information processing device 2, an OS, an application program, and various information referenced when the application program is executed, such as an HDD or SSD.

[0040] The storage unit 22 stores information about a first moving image provided in the information processing service, information about a predetermined object, and information about a user. The predetermined object is an object included in the first moving image provided in the information processing service.

[0041] The information on the first moving images is, for example, information in which a first moving image ID for identifying the first moving image and a name of the first moving image are associated with each first moving image.

[0042] The information on the predetermined object is, for example, information in which an object ID for identifying the predetermined object, the name of the predetermined object, an object ID corresponding to a similar object, an identification image of the predetermined object, and audio data of the predetermined object are associated with each predetermined object. A similar object is an object determined as an object similar to the predetermined object based on the characteristics of the object such as gender, appearance, attributes, occupation, type, etc. The identification image of the predetermined object is, for example, an image used to identify the predetermined object from an unknown image (e.g., the first video). The audio data of the predetermined object is, for example, data used to identify the audio of the predetermined object from unknown audio (e.g., the sound source of the first video).

[0043] The information on the user is, for example, information in which a user ID for identifying the user is associated with the user's behavior history for each user. The user's behavior history is, for example, a payment history of a predetermined fee paid by the user (e.g., a membership registration fee, a fee for displaying a second video, a consideration for an object, a fee for participating in an event in which the object appeared, etc.), a purchase history of a predetermined item purchased by the user (e.g., an item designated in an information processing service, goods related to an object, etc.), a participation history of a predetermined event in which the user participated (e.g., an event designated in an information processing service, an event in which an object appeared, etc.), a viewing history of a video of a predetermined event viewed by the user, etc.

[0044] The storage unit 22 also stores an interest level management database that manages the user's interest level in a specific object. FIG. 5 is a diagram showing an example of the configuration of the interest level management database. In the example shown in FIG. 5, the interest level management database stores, for each combination of a user and a specific object, a user ID corresponding to the user, an object ID corresponding to the specific object, and the user's interest level in the object in association with each other. The interest level is expressed, for example, as a numerical value, and a higher numerical value indicates a higher degree of interest. Note that the interest level is not limited to a numerical value, and may be expressed as an index such as "high", "medium", "low", etc.

[0045] Returning to Figure 4, the control unit 23 is a processor such as a CPU, GPU, or NPU of the information processing device 2, and functions as an acquisition processing unit 231, an object identification unit 232, an interest level management unit 233, a target object identification unit 234, a generation unit 235 (video generation unit 236 and sound source generation unit 237), and a transmission unit 238 by executing programs stored in the memory unit 22.

[0046] [Processing related to the provision of information processing services] Next, a process related to the provision of an information processing service executed by the information processing system S will be described.

[0047] The acquisition processing unit 231 functions as a video acquisition unit and acquires the first video. For example, when the first video is a real-time video, the acquisition processing unit 231 acquires the first video from a camera that captures an object. Also, for example, when the first video is an archive video, the acquisition processing unit 231 acquires the first video from a server (not shown) that manages the first video. Note that when the first video is stored in the storage unit 22, the acquisition processing unit 231 may acquire the first video from the storage unit 22.

[0048] For example, when acquiring a first moving image, the acquisition processing unit 231 generates a first moving image ID corresponding to the first moving image. Note that the acquisition processing unit 231 may acquire the first moving image ID corresponding to the first moving image together with the first moving image.

[0049] The object identification unit 232 identifies a plurality of objects included in the first moving image. For example, the object identification unit 232 first recognizes all objects included in the first moving image. The object identification unit 232 can recognize objects using, for example, a known subject recognition technology. Then, for each recognized object, the object identification unit 232 identifies the object by comparing the first moving image including the object with an identification image of a predetermined object stored in the storage unit 22, thereby identifying the object included in the first moving image.

[0050] The acquisition processing unit 231 further functions as a user information acquisition unit, and acquires a playback request from the user terminal 1. The playback request is a request to play a first moving image on the user terminal 1, and includes, for example, a first moving image ID corresponding to the first moving image selected by the user. The playback request may further include a user ID corresponding to the user, etc.

[0051] For example, first, as a process of the user terminal 1, when a user selects one of a plurality of first moving images on a display screen of a dedicated app, the transmission unit 141 transmits a playback request including a first moving image ID corresponding to the first moving image selected by the user to the information processing device 2. Then, as a process of the information processing device 2, the acquisition processing unit 231 acquires the playback request from the user terminal 1.

[0052] The target object identification unit 234 identifies a target object from among a plurality of objects included in the first moving image. Specifically, the target object identification unit 234 identifies an object selected by the user from among a plurality of objects included in the first moving image as the target object.

[0053] For example, first, as a process of the user terminal 1, when the user selects at least one of a plurality of objects included in the first moving image selected by the user on the display screen of the dedicated app, the transmission unit 141 transmits a playback request further including an object ID corresponding to the object selected by the user to the information processing device 2. Then, as a process of the information processing device 2, the target object identification unit 234 identifies, as the target object, the object indicated by the object ID included in the playback request acquired by the acquisition processing unit 231.

[0054] The target object identification unit 234 may identify the target object based on the user's degree of interest in the object included in the first moving image. The information processing device 2 identifies the target object based on the user's degree of interest in the object included in the first moving image by performing the following two steps.

[0055] As a first step, the acquisition processing unit 231 further functions as an interest level acquisition unit and acquires the user's interest level in at least one of a plurality of objects. The acquisition processing unit 231 acquires, for example, the interest level input by the user.

[0056] Specifically, first, as a process of the user terminal 1, when the user inputs a degree of interest in at least one of a plurality of objects included in the selected first video on the display screen of the dedicated app, the transmission unit 141 transmits a playback request further including an object ID corresponding to the object for which the user inputs a degree of interest and the degree of interest input by the user to the information processing device 2. Then, as a process of the information processing device 2, the acquisition processing unit 231 acquires the playback request from the user terminal 1, thereby acquiring the user's degree of interest in the object.

[0057] Fig. 6 is a diagram showing a schematic example of a display screen of the dedicated app. Screen D2 shown in Fig. 6(a) is a list screen displaying a list of first videos. For example, when the user first performs an operation to start the dedicated app on the user terminal 1, the output control unit 143 displays screen D2 displaying a list of first videos acquired by the acquisition unit 142 from the information processing device 2. When the user selects a first video that the user wishes to view on screen D2, the output control unit 143 displays screen D3 shown in Fig. 6(b).

[0058] The screen D3 is a setting screen for setting the degree of interest of an object. In the example shown in Fig. 6(b), the screen D3 is provided with a setting item for setting the degree of interest of each object (e.g., four people) included in the first moving image selected by the user. In this case, when the user inputs the degree of interest corresponding to each object on the screen D3 and presses the setting button, the transmission unit 141 transmits a playback request including the degree of interest corresponding to each object input by the user to the information processing device 2.

[0059] Then, the acquisition processing unit 231 acquires the user's degree of interest in each object from the user terminal 1. If there is an object for which the user has not set a degree of interest among the multiple objects, the acquisition processing unit 231 may acquire the degree of interest corresponding to the object as the lowest degree of interest, or may treat the degree of interest corresponding to the object as unknown.

[0060] The acquisition processing unit 231 may acquire the order of the interest levels instead of acquiring a numerical value indicating the interest levels themselves. For example, in the information processing device 2, a numerical value indicating the interest level corresponding to each order of the interest levels is defined. In this case, the acquisition processing unit 231 first acquires the order of the interest levels corresponding to each object from the user terminal 1. Then, the acquisition processing unit 231 acquires the degree of interest corresponding to each object by identifying, for each object, a numerical value associated with the order of the interest levels of the object. In this way, the information processing device 2 can acquire the current degree of interest of the user in the object.

[0061] When acquiring the degree of interest from the user terminal 1, the acquisition processing unit 231 may acquire the degree of interest from the user terminal 1 on the condition that the user satisfies a predetermined condition. For example, the storage unit 22 stores permission conditions for determining whether or not to permit acceptance of the degree of interest, etc. The permission conditions include, for example, that a specific fee has been paid for an information processing service, that a specific item has been purchased, that a specific event has been attended, that a video of a specific event has been viewed, etc.

[0062] In this case, first, the acquisition processing unit 231 acquires a user ID from the user terminal 1, and determines whether or not a predetermined behavior by the user satisfies the permission conditions by referring to the user's behavior history associated with the acquired user ID in the storage unit 22. Then, if the acquisition processing unit 231 determines that the predetermined behavior by the user does not satisfy the permission conditions, it does not accept the interest level from the user terminal 1, and if it determines that the predetermined behavior by the user satisfies the permission conditions, it accepts the interest level from the user terminal 1.

[0063] When the information processing device 2 does not accept the degree of interest from the user terminal 1, it may acquire a statistical degree of interest in the object as the user's degree of interest in the object, or may transmit only the first video and the first sound source without transmitting the second video and the second sound source to the user terminal 1. In this way, the information processing device 2 can provide the user with a motivation to take an action that satisfies the permission condition.

[0064] The acquisition processing unit 231 makes the determination using, for example, a common permission condition defined in the information processing service. The acquisition processing unit 231 may make the determination using a permission condition defined for each predetermined object. For example, the storage unit 22 stores a permission condition for each predetermined object.

[0065] In this case, the acquisition processing unit 231 determines whether or not a predetermined action by the user satisfies a permission condition corresponding to an object identified by the object identification unit 232 in the first video selected by the user. The acquisition processing unit 231 may determine whether or not a predetermined action by the user satisfies a permission condition corresponding to each of the objects identified by the object identification unit 232, or may determine whether or not a predetermined action by the user satisfies any of a plurality of permission conditions corresponding to each of the plurality of objects identified by the object identification unit 232. The acquisition processing unit 231 may also determine whether or not a predetermined action by the user satisfies a permission condition corresponding to each of the target objects identified by the target object identification unit 234, or may determine whether or not a predetermined action by the user satisfies any of a plurality of permission conditions corresponding to each of one or more target objects identified by the target object identification unit 234.

[0066] The acquisition processing unit 231 may acquire a degree of interest corresponding to an object based on a behavior history of the user. Specifically, first, the acquisition processing unit 231 acquires a behavior history of the user regarding at least one of a plurality of objects. For example, the acquisition processing unit 231 acquires a user ID corresponding to the user from the user terminal 1, and acquires the behavior history of the user by searching the storage unit 22 using the acquired user ID. The acquisition processing unit 231 may acquire the behavior history of the user from the user terminal 1.

[0067] Next, the acquisition processing unit 231 estimates the interest level corresponding to the object based on the acquired user behavior history, thereby acquiring the user's interest level in the object. For example, the acquisition processing unit 231 first refers to the acquired user behavior history, and tallies up the user's behavioral results for each object included in the first video. The user's behavioral results for an object are, for example, at least any one of the number of times goods related to the object were purchased, the total amount of money spent on goods related to the object, the number of times the object was attended in an event in which the object appeared, the total amount of money paid for the object, and the total amount of money paid to attend an event in which the object appeared.

[0068] Then, the acquisition processing unit 231 estimates the degree of interest in each object included in the first video by applying a predetermined coefficient to the numerical value of the collected behavioral records taken by the user toward the object to calculate the degree of interest in the object. The predetermined coefficient is a numerical value determined for converting the numerical value of the behavioral records into the degree of interest, and is a numerical value that is calculated to be higher as the numerical value of the behavioral records is higher (for example, the more times goods related to the object are purchased). The predetermined coefficient may be a numerical value common to each behavioral record, or may be a numerical value that differs for each behavioral record. In this way, the information processing device 2 can acquire the user's objective degree of interest in the object.

[0069] The interest level management unit 233 functions as a recording unit and records the interest level acquired by the acquisition processing unit 231. Specifically, the interest level management unit 233 associates the acquired user ID, the acquired interest level, and an object ID corresponding to the interest level in the interest level management database.

[0070] If the degree of interest corresponding to an object included in the first video has already been recorded, the acquisition processing unit 231 may acquire the recorded degree of interest. Specifically, the acquisition processing unit 231 acquires the degree of interest corresponding to the object by searching the interest level management database using a user ID corresponding to the user and an object ID corresponding to the object included in the first video.

[0071] As a second step, the target object identification unit 234 identifies a target object from among the multiple objects based on the degree of interest acquired by the acquisition processing unit 231. The target object identification unit 234, for example, identifies an object with a relatively high degree of interest of the user (e.g., an object with the highest degree of interest) from among the multiple objects as the target object.

[0072] The target object identification unit 234 may identify an object in which the user has a certain level of interest or more as the target object. Specifically, the target object identification unit 234 identifies an object in which the user has a level of interest or more than a predetermined threshold as the target object among a plurality of objects. The predetermined threshold is, for example, a numerical value used to determine whether the user pays attention to an object or not. In this way, the information processing device 2 can prevent an object in which the user has a low level of interest from being identified as the target object.

[0073] Here, the target object identification unit 234 may identify the target object based on the degree of interest corresponding to a similar object similar to an object included in the first video. The information processing device 2 identifies the target object based on the degree of interest corresponding to a similar object similar to an object included in the first video, for example, by executing the following two steps.

[0074] As a first step, the acquisition processing unit 231 acquires a degree of interest corresponding to a similar object associated with at least one of a plurality of objects included in the first video. The acquisition processing unit 231, for example, refers to information about a predetermined object and acquires, for each object included in the first video, a user's degree of interest in a similar object associated with the object. The acquisition processing unit 231 may acquire a degree of interest corresponding to a similar object input by the user, or may estimate a degree of interest corresponding to a similar object based on a user's behavior history regarding the similar object.

[0075] As a second step, the target object identification unit 234 further identifies a target object from among the multiple objects based on the degree of interest in the similar object acquired by the acquisition processing unit 231. Specifically, the target object identification unit 234 identifies a target object from among the multiple objects based on the degree of interest corresponding to an object included in the first video and the degree of interest corresponding to a similar object similar to the object. The target object identification unit 234 identifies the target object from among the multiple objects based on a total degree of interest obtained by adding up the degree of interest corresponding to an object included in the first video and the degree of interest corresponding to a similar object similar to the object.

[0076] The target object identification unit 234 may identify the target object from among the multiple objects based on a total degree of interest after weighting by applying a predetermined coefficient to at least one of the degree of interest corresponding to an object included in the first video and the degree of interest corresponding to a similar object similar to the object. The predetermined coefficient is, for example, a numerical value determined so that the degree of interest corresponding to the object is higher than the degree of interest corresponding to the similar object. In this way, the information processing device 2 can identify the target object in consideration of the degree of interest corresponding to a similar object similar to the object included in the first video.

[0077] When an unknown object is present among the plurality of objects included in the first video, the information processing device 2 may identify a target object from among the plurality of objects based on the user's interest in a similar object similar to the unknown object. An unknown object is an object for which the user's interest is unknown, such as an object for which the user has not input a degree of interest, an object for which there is no related user behavior history, etc.

[0078] Specifically, first, when an object is present among a plurality of objects included in the first video, the acquisition processing unit 231 acquires the user's degree of interest in a similar object similar to the unknown object as the user's degree of interest in the unknown object. Then, the target object identification unit 234 identifies a target object from among the plurality of objects based on the user's degree of interest in each of the plurality of objects acquired by the acquisition processing unit 231. In this manner, the information processing device 2 can estimate the degree of interest corresponding to the unknown object and identify the target object.

[0079] The generation unit 235 generates a second moving image and a second sound source based on a target object which is at least one object among a plurality of objects from a moving image area of ​​the first moving image. Specifically, the generation unit 235 generates a second moving image corresponding to the target object identified by the target object identification unit 234. The generation unit 235 has a moving image generation unit 236 and a sound source generation unit 237.

[0080] The video generating unit 236 generates the second video by cutting out an object region including at least a part of the target object. For example, when the target object specifying unit 234 specifies a plurality of target objects, the video generating unit 236 may generate a plurality of second videos each including a different target object.

[0081] The video generator 236 generates the second video based on, for example, a predetermined attribute of the object region. The attribute of the object region is, for example, the face of the object when the object is a person, the entire body of the object, etc.

[0082] Specifically, first, the video generating unit 236 identifies a reference location that is a reference for cutting out the object region from the video area of ​​the first video based on the attribute of the object region. The reference location is a location that is a reference for cutting out the object region from the video area of ​​the first video, and is, for example, a location determined according to the attribute of the object region. For example, when the attribute of the object region is "face", the reference locations are the eyes, nose, mouth, chin, etc., and when the attribute of the object region is "whole body", the reference locations are the chest, arms, legs, etc.

[0083] Then, the video generating unit 236 generates the second video by cutting out a predetermined area including the identified reference location as an object area. The predetermined area is an area determined according to the attribute of the object area and the reference location. In this way, the information processing device 2 can generate a second video that captures at least a part of the object even if the object is a dynamic object.

[0084] When attributes of a plurality of object regions are defined, the video generating unit 236 may generate, for each target object, a plurality of second videos corresponding to the target object, the plurality of second videos corresponding to the respective attributes of the plurality of object regions. For example, it is assumed that two attributes of the object region are defined: the face of the target object when the target object is a person, and the entire body of the target object.

[0085] In this case, the video generating unit 236 generates, for each target object, a second video corresponding to the face of the target object and a second video corresponding to the entire body of the target object. In this way, the information processing device 2 can present to the user second videos in which the target object is shown in close-up in various ways.

[0086] For example, when generating a second moving image, the moving image generating section 236 sets an object ID corresponding to an object included in the second moving image and attributes of an object area of ​​the second moving image as metadata of the second moving image.

[0087] The sound source generating unit 237 generates a second sound source in which the sound of the target object included in the first sound source, which is the sound source of the first moving image, is emphasized. Specifically, the sound source generating unit 237 generates a second sound source in which the sound of the target object is adjusted to a high volume as the second sound source in which the sound of the target object is emphasized. The sound source generating unit 237 may generate a second sound source in which the sound of other objects other than the target object among the multiple objects is adjusted to a low volume. In addition, the sound source generating unit 237 may generate a second sound source in which the sound of the target object is adjusted to a high volume and the sound of other objects is adjusted to a low volume as the second sound source in which the sound of the target object is emphasized. In this way, the information processing device 2 can make it easier for the user to hear the sound of the target object.

[0088] For example, the first video includes information indicating a nearby microphone that is determined as a microphone close to each object included in the first video. The nearby microphone is, for example, a lapel microphone attached to the object or a fixed microphone installed near the object.

[0089] In this case, the sound source generating unit 237 generates a second sound source by adjusting the volume of the sound collected by at least one of the nearby microphones corresponding to the target object and the nearby microphones corresponding to the other objects other than the target object among the multiple objects. In this way, the information processing device 2 can emphasize the sound of the target object.

[0090] The sound source generating unit 237 may generate the second sound source based on the first sound source using a known sound source separation technique. For example, the sound source generating unit 237 first separates the sound sources of each type (e.g., each object, each instrument, etc.) included in the first sound source using a known sound source separation technique. Then, the sound source generating unit 237 emphasizes the sound of the target object by adjusting the volume of at least one of the multiple separated sound sources that are the separated sound sources, and generates the second sound source by synthesizing the multiple separated sound sources in which the sound of the target object is emphasized.

[0091] The sound source generating unit 237 generates a second sound source in which the sound of the target object is emphasized at a predetermined level, for example. The sound source generating unit 237 may generate a second sound source in which the sound of the target object is emphasized at a level corresponding to the user's level of interest in the target object. For example, a level to which the sound of the object is emphasized is determined for each predetermined level of interest, and the sound source generating unit 237 generates a second sound source in which the sound of the object is emphasized at a level corresponding to the user's level of interest in the target object.

[0092] When the target object identification unit 234 identifies a plurality of target objects, the sound source generation unit 237 may generate a second sound source in which the sound of the target object is emphasized to a degree corresponding to the user's interest in each target object. Specifically, the sound source generation unit 237 generates a second sound source in which the sound of the target object is emphasized more than the sound of other objects other than the target object, and the sound of a target object in which the user's interest is relatively high among the plurality of target objects is adjusted to a high volume. The sound source generation unit 237 may generate a second sound source in which the sound of the target object is emphasized more than the sound of other objects other than the target object, and the sound of a target object in which the user's interest is relatively low among the plurality of target objects is adjusted to a low volume.

[0093] The sound source generating unit 237 may generate a second sound source in which the sound of a target object is emphasized more than the sound of other objects other than the target object, and the sound of a target object in which the user's level of interest is relatively high among the multiple target objects is adjusted to a high volume, and the sound of a target object in which the user's level of interest is relatively low among the multiple target objects is adjusted to a low volume. In this way, the information processing device 2 can make it easier for the user to hear the sound of the multiple target objects, while making it easier for the user to hear the sound of a target object in which the user's level of interest is high.

[0094] In the above, an example has been described in which the generating unit 235 generates the second moving image according to the attribute of a predetermined object region, but the present invention is not limited to this. For example, the generating unit 235 may generate the second moving image and the second sound source according to the attribute of an object region specified by a user. Specifically, the information processing device 2 generates the second moving image and the second sound source according to the attribute of an object region specified by a user by executing the following three steps.

[0095] As a first step, the acquisition processing unit 231 acquires region identification information from the user terminal 1. The region identification information is information for identifying attributes of an object region, such as the face of the object or the entire body of the object when the object is a person.

[0096] Fig. 7 is a diagram showing a schematic example of a display screen of a dedicated application. Screen D4 shown in Fig. 7 is a setting screen for setting attributes of an object region, etc. In the example shown in Fig. 7, screen D4 displays "face" and "whole body" as predetermined attributes of an object region. In this case, when a user selects "face" on screen D3 and presses a setting button, transmission unit 141 of user terminal 1 transmits information indicating the "face" selected by the user to information processing device 2 as region identification information.

[0097] Then, the acquisition processing unit 231 acquires the area specifying information from the user terminal 1. In this manner, the information processing device 2 can easily specify the attribute of the object area desired by the user.

[0098] The acquisition processing unit 231 may receive the area identification information based on a designated area designated by a user in the moving image area of ​​the first moving image displayed on the user terminal 1. For example, in the information processing device 2, predetermined attributes of an object area are associated with parts of a given object (for example, eyes, nose, mouth, arms, chest, legs, etc.).

[0099] In this case, first, when the user selects a first video that the user wishes to view on the list screen, the user terminal 1 acquires the first video selected by the user from the information processing device 2, and displays a video playback screen showing the acquired first video. When the user taps on a part of the video area of ​​the first video displayed on the video playback screen, the transmission unit 141 of the user terminal 1 transmits information indicating the area tapped by the user to the information processing device 2 as information indicating a designated area. The information indicating the designated area is, for example, information indicating a position in the video area of ​​the first video.

[0100] When the acquisition processing unit 231 acquires information indicating the designated area from the user terminal 1, the object identification unit 232 identifies a part of an object included in the designated area in the video area of ​​the first video using a known subject recognition technique. Then, the acquisition processing unit 231 acquires area identification information by identifying an attribute of the object area associated with the part of the object identified by the object identification unit 232. In this way, the information processing device 2 can easily specify the attribute of the object area desired by the user.

[0101] The acquisition processing unit 231 may acquire area identification information on the condition that the user satisfies a predetermined condition (for example, an authorization condition stored in the storage unit 22). Furthermore, the acquisition processing unit 231 may increase or decrease the number of object area attributes that are permitted to be accepted depending on whether or not the user satisfies the predetermined condition. For example, the object area attributes include a first attribute and a second attribute. The first attribute is an attribute of one or more object areas that is permitted to be designated regardless of whether or not the user has performed a predetermined action. The second attribute is an attribute of one or more object areas that is permitted to be designated depending on the user's predetermined action. Furthermore, the authorization condition in this case is a condition for determining whether or not to permit designation of the second attribute.

[0102] In this case, when the acquisition processing unit 231 determines that the user does not satisfy the predetermined condition, it does not accept the area specifying information corresponding to the second attribute, and only accepts the area specifying information corresponding to the first attribute. On the other hand, when the acquisition processing unit 231 determines that the user satisfies the predetermined condition, it accepts the area specifying information corresponding to the first attribute or the area specifying information corresponding to the second attribute. In this way, the information processing device 2 can provide the user with a motivation to take an action that satisfies the predetermined condition.

[0103] As a second step, the video generating unit 236 generates a second video based on the attributes of the object region specified by the region specifying information. Specifically, the video generating unit 236 first specifies a reference point that is used as a reference for cutting out the object region from the video region of the first video based on the attributes of the object region specified by the region specifying information. The video generating unit 236 then generates the second video by cutting out, as an object region, a region that includes the specified reference point and is determined by the attributes of the object region specified by the region specifying information.

[0104] As a third step, the sound source generating unit 237 generates a second sound source in which the sound of the target object is emphasized with an emphasis degree according to the attribute of the object region. For example, the emphasis degree is determined for each attribute of a predetermined object region, and the sound source generating unit 237 generates a second sound source in which the sound of the target object is emphasized with a degree corresponding to the attribute of the object region specified by the region specifying information acquired by the acquisition processing unit 231. In this way, the information processing device 2 can provide a second video and a second sound source according to the attribute of the object region specified by the user.

[0105] The generation unit 235 may generate a second video and a second sound source according to the degree of interest in the target object. Specifically, the video generation unit 236 generates a second video having a size according to the degree of interest in the target object as the second video according to the degree of interest in the target object. For example, the video generation unit 236 generates a second video having a larger size as the user's degree of interest is higher. For example, the size of the second video is determined for each predetermined degree of interest, and the video generation unit 236 generates a second video having a size corresponding to the user's degree of interest in the target object.

[0106] The sound source generating unit 237 generates a second sound source in which the sound of the target object is emphasized to a degree corresponding to the degree of interest in the target object as a second sound source corresponding to the degree of interest in the target object. For example, the sound source generating unit 237 generates a second sound source in which the sound of the target object is emphasized to a greater extent as the degree of interest in the target object is higher.

[0107] For example, a degree of sound emphasis is determined for each predetermined interest level, and the sound source generating unit 237 generates a second sound source in which the sound of the target object is emphasized to a degree corresponding to the user's interest level in the target object. In this way, the information processing device 2 can make the target object easier to view as the user's interest level in the target object increases.

[0108] The transmission unit 238 transmits the first moving image, the second moving image synchronized with the first moving image, and the second sound source to the user terminal 1. The transmission unit 238 transmits, for example, the first moving image in which the sound source has been changed from the first sound source to the second sound source, and the second moving image synchronized with the first moving image to the user terminal 1.

[0109] The transmission unit 238 transmits, for example, the first moving image and the second moving image and the second sound source selected based on the target object identified by the target object identification unit 234 to the user terminal 1. Specifically, first, in response to the object identification unit 232 identifying an object included in the second moving image, the generation unit 235 generates, for each object included in the first moving image, a second moving image and a second sound source corresponding to the object.

[0110] The transmission unit 238 selects a second moving image corresponding to the target object identified by the target object identification unit 234 from among the multiple second moving images generated by the generation unit 235, and selects a second sound source corresponding to the target object identified by the target object identification unit 234 from among the multiple second sound sources generated by the generation unit 235. Then, the transmission unit 238 transmits the first moving image, the selected second moving image that is synchronized with the first moving image, and the selected second sound source to the user terminal 1.

[0111] The transmission unit 238 may transmit the first video, and the second video and the second sound source generated based on the target object identified by the target object identification unit 234, to the user terminal 1. Specifically, first, the generation unit 235 generates the second video and the second sound source corresponding to the target object when the target object identification unit 234 identifies the target object. Then, the transmission unit 238 transmits the first video, the second video generated by the generation unit 235 and synchronized with the first video, and the second sound source generated by the generation unit 235 to the user terminal 1.

[0112] The transmission unit 238 may transmit the second moving image and the second sound source, the quality of which corresponds to the degree of interest in the target object, to the user terminal 1. The quality of the second moving image is, for example, a resolution, a frame rate, a compression ratio, etc. The quality of the second sound source is, for example, a resolution, a compression ratio, etc. For example, for each predetermined degree of interest, the quality of the second moving image and the quality of the second sound source corresponding to the predetermined degree of interest are determined.

[0113] In this case, the transmission unit 238 transmits the generated second video and second sound source to the user terminal 1 with a quality according to the user's interest in the target object corresponding to the second video and the second sound source. For example, the quality of the second video and the second sound source is set to be higher as the interest level is higher, and the transmission unit 238 transmits the second video and the second sound source to the user terminal 1 with a higher quality for a target object with a relatively high interest level than for a target object with a relatively low interest level. Note that the video generation unit 236 may generate the second video and the second sound source with a quality according to the interest level corresponding to the target object, instead of the transmission unit 238 executing a process for making the second video have a quality according to the interest level corresponding to the target object. In this way, the information processing device 2 can, for example, make it easier to view an object with a high interest level of the user.

[0114] The user terminal 1 outputs the first video, the second video, and the second sound source. Specifically, when the acquisition unit 142 acquires the first video, the second video, and the second sound source from the information processing device 2, the output control unit 143 displays the first video and the second video synchronized with the first video on a video playback screen that is a display screen of a dedicated application, and outputs the second sound source.

[0115] After transmitting the first video, the second video, and the second sound source to the user terminal 1, the information processing device 2 may update the degree of interest corresponding to the object included in the first video in response to a user operation. Specifically, first, the acquisition processing unit 231 acquires information indicating a user operation on the second video displayed on the user terminal 1 by the transmission unit 238 transmitting the first video and the second video to the user terminal 1. The user operation on the second video is, for example, an operation to change the position of the second video, an operation to change the size of the second video, an operation to change the displayed second video to another second video that is not displayed, an operation to show a positive intention to the second video, such as pressing a "Like" button, etc.

[0116] Then, the interest level management unit 233 updates the degree of interest stored in the interest level management database in association with the object ID of the object corresponding to the second video, based on the user's operation on the second video indicated by the information acquired by the acquisition processing unit 231. For example, when the user performs an operation to switch the positions of two second videos on the video playback screen, the interest level management unit 233 updates the degree of interest corresponding to the object of the second video that has been switched to a higher position in the order of the second video among the two second videos, to a higher level, and updates the degree of interest corresponding to the object of the second video that has been switched to a lower position in the order of the second video among the two second videos, to a lower level.

[0117] In this way, the information processing device 2 can update the user's interest level in the object in response to the user's operation. When the user's interest level in an object included in the first video is updated, the information processing device 2 may specify the target object, generate a second video, and generate a second sound source based on the updated interest level.

[0118] After transmitting the first moving image, the second moving image, and the second sound source to the user terminal 1, the transmission unit 238 may transmit a new second sound source changed in response to a user operation to the user terminal 1. Specifically, the information processing device 2 transmits the new second sound source to the user terminal 1 by executing the following three steps.

[0119] As a first step, the acquisition processing unit 231 receives an operation by the user to change the volume of a target object corresponding to the second video after the transmission unit 238 transmits the first video, the second video, and the second sound source to the user terminal 1. For example, the video playback screen is provided with an adjustment item for adjusting the volume of the object corresponding to the second video for each second video, and when the user performs an operation to adjust the volume of the object in the adjustment item, the acquisition processing unit 231 acquires information indicating the volume of the object adjusted by the user.

[0120] In a second step, the sound source generating unit 237 generates a new second sound source by changing the volume of the target object from the second sound source in response to the user's operation. For example, the sound source generating unit 237 generates a new second sound source by changing the volume of the target object from the second sound source to a volume that corresponds to the volume adjusted by the user in the adjustment item.

[0121] As a third step, the transmission unit 238 transmits the new second sound source to the user terminal 1. In this way, the information processing device 2 can provide a sound source in which the sound of the target object is emphasized to a degree desired by the user.

[0122] [Processing of information processing device 2] Next, a description will be given of the flow of processing by the information processing device 2. Fig. 8 is a flowchart showing the flow of processing executed by the information processing device 2. This flowchart starts when the acquisition processing unit 231 acquires the first moving image (S1).

[0123] The object identification unit 232 identifies an object included in the first moving image (S2). When the object identification unit 232 identifies an object included in the first moving image, the generation unit 235 generates a second moving image and a second sound source corresponding to each object included in the first moving image (S3).

[0124] The acquisition processing unit 231 acquires from the user terminal 1 a playback request including a first video ID corresponding to a first video selected by the user from a list of first videos and an object ID corresponding to an object selected by the user from among a plurality of objects included in the first video (S4). The target object identification unit 234 identifies, as a target object, an object indicated by the object ID included in the playback request acquired by the acquisition processing unit 231 (S5).

[0125] The transmission unit 238 selects a second moving image corresponding to the target object identified by the target object identification unit 234 from among the multiple second moving images generated by the generation unit 235, and selects a second sound source corresponding to the target object identified by the target object identification unit 234 from among the multiple second sound sources generated by the generation unit 235 (S6). Then, the transmission unit 238 transmits the first moving image, the selected second moving image that is synchronized with the first moving image, and the second sound source to the user terminal 1 (S7).

[0126] [Effects of this embodiment] As described above, the information processing device 2 transmits a first moving image, a second moving image that is generated by cutting out an object area including at least a part of a target object from a moving image area of ​​the first moving image and is synchronized with the first moving image, and a second sound source that emphasizes the sound of the target object included in the first sound source, to the user terminal 1. In this way, the information processing device 2 can make it easier for the user to view the object included in the first moving image.

[0127] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote industry, innovation and infrastructure."

[0128] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0129] 1 User terminal 11 Input / output section 12 Communications Department 13 Storage section 14 Control section 141 Transmitter 142 Acquisition Department 143 Output control section 2. Information processing equipment 21 Communications Department 22 Memory section 23 Control Unit 231 Acquisition processing unit 232 Object Identification Section 233 Interest Management Department 234 Target Object Identification Section 235 Generation part 236 Video Generation Unit 237 Sound source generation section 238 Transmitter S Information Processing System

Claims

1. a moving image acquisition unit that acquires a first moving image; an object identification unit that identifies a plurality of objects included in the first moving image; a moving image generating unit that generates a second moving image by cutting out an object area including at least a part of a target object, which is at least one of the plurality of objects, from a moving image area of ​​the first moving image; a sound source generating unit that generates a second sound source by emphasizing a sound of the target object included in a first sound source that is a sound source of the first moving image; a transmission unit that transmits the first video, the second video synchronized with the first video, and the second sound source generated by the sound source generation unit to a user terminal; An information processing device having the above configuration.

2. the sound source generation unit generates the second sound source in which the sound of the target object is emphasized by adjusting the volume of the sound of the target object to at least one of a high volume and a low volume of the sound of other objects other than the target object among the plurality of objects, as the second sound source in which the sound of the target object is emphasized. The information processing device according to claim 1 .

3. the information processing device further includes a target object identification unit that identifies, as the target object, the object selected by a user who uses the user terminal from among a plurality of objects; the moving image generation unit generates the second moving image corresponding to the target object identified by the target object identification unit. The information processing device according to claim 1 .

4. The information processing device includes: a user information acquiring unit that acquires a user's degree of interest in at least one of the plurality of objects; a target object identification unit that identifies the target object from among the plurality of objects based on the interest level acquired by the user information acquisition unit; and the moving image generation unit generates the second moving image corresponding to the target object identified by the target object identification unit. The information processing device according to claim 1 .

5. The information processing device further includes a storage unit that stores information indicating a predetermined object and information indicating a similar object determined as an object similar to the predetermined object in association with each other; the user information acquisition unit acquires the degree of interest corresponding to the similar object associated with at least one of the plurality of objects; The target object identification unit further identifies the target object from among the plurality of objects based on the degree of interest in the similar object acquired by the user information acquisition unit. The information processing device according to claim 4.

6. the target object identification unit identifies, among the plurality of objects, an object whose interest level is equal to or greater than a predetermined threshold as the target object; The information processing device according to claim 4.

7. the moving image generation unit generates a plurality of the second moving images, each of which has a different target object; The sound source generating unit further generates the second sound source by adjusting at least one of a volume of a sound of the target object having a relatively large interest level among the plurality of target objects to a high volume and a volume of a sound of the target object having a relatively small interest level among the plurality of target objects to a low volume. The information processing device according to claim 4.

8. the user information acquiring unit acquires a behavior history of the user regarding at least one of the plurality of objects, and estimates the interest level corresponding to the object based on the acquired behavior history, thereby acquiring the interest level. The information processing device according to claim 4.

9. The behavioral history is at least one of a purchase history of goods related to the object, a participation history of an event in which the object appeared, and a payment history of a payment for the object or a fee for participating in an event in which the object appeared. The information processing device according to claim 8.

10. The information processing device further includes a storage unit that stores a user ID (Identification) and the behavior history in association with each other, the user information acquisition unit acquires the user ID corresponding to the user, and acquires the behavior history by searching the storage unit using the acquired user ID.

10. The information processing device according to claim 8 or 9.

11. The information processing device further includes a user information acquisition unit that receives an operation by a user of the user terminal to change a volume of the target object corresponding to the second video after the transmission unit transmits the first video, the second video, and the second sound source to the user terminal, and the sound source generation unit generates a new second sound source by changing a volume of the target object from the second sound source in response to the user's operation; The transmission unit transmits the new second sound source to the user terminal. The information processing device according to claim 1 .

12. The information processing device further includes a user information acquisition unit that acquires area identification information for identifying an attribute of the object area from the user terminal, the moving image generation unit identifies a reference point that is to be used as a reference for cutting out the object area from the moving image area of ​​the first moving image based on an attribute of the object area identified by the area identification information, and generates the second moving image by cutting out, as the object area, an area that includes the identified reference point and is determined by the attribute of the object area identified by the area identification information; The sound source generating unit generates the second sound source by emphasizing the sound of the target object at a degree according to the attribute of the object region. The information processing device according to claim 1 .

13. the first moving image includes information indicating a nearby microphone defined for each of the objects as a microphone close to the object, the sound source generation unit generates the second sound source by adjusting the volume of a sound collected by at least one of the nearby microphone corresponding to the target object and the nearby microphone corresponding to an object other than the target object among the plurality of objects. The information processing device according to claim 1 .

14. The computer executes obtaining a first moving image; identifying a plurality of objects included in the first moving image; generating a second moving image by cutting out an object area including at least a part of a target object, which is at least one of the plurality of objects, from a moving image area of ​​the first moving image; generating a second sound source by emphasizing a sound of the target object included in a first sound source that is a sound source of the first moving image; transmitting the first video, the second video synchronized with the first video, and the generated second sound source to a user terminal; An information processing method comprising the steps of:

15. Computer, a moving image acquisition unit that acquires a first moving image; an object identification unit that identifies a plurality of objects included in the first moving image; a moving image generating unit that generates a second moving image by cutting out an object area including at least a part of a target object, which is at least one of the plurality of objects, from a moving image area of ​​the first moving image; a sound source generating unit that generates a second sound source by emphasizing a sound of the target object included in a first sound source that is a sound source of the first moving image; and a transmission unit that transmits the first moving image, the second moving image synchronized with the first moving image, and the second sound source generated by the sound source generation unit to a user terminal; A program to function as a

16. a transmission unit that transmits information indicating a target object, which is an object selected by a user from among a plurality of objects included in a first moving image, to an information processing device; an acquisition unit that acquires from the information processing device a second sound source in which a sound of the target object included in a first sound source that is a sound source of the first moving image is emphasized, the first moving image, and a second moving image that is generated by cutting out an object area including at least a part of the target object from a moving image area of ​​the first moving image and is synchronized with the first moving image; an output control unit that outputs the first moving image, the second moving image, and the second sound source acquired by the acquisition unit; An information processing terminal having the above configuration.

Images