Information processing device and information processing method

Abstract

To make it easier for a user to view objects included in a first video. [Solution] The information processing device 2 has an acquisition unit 231 that acquires a first video, an identification unit 232 that identifies an object included in the first video, a reception unit 233 that receives area identification information for identifying an object area including at least a part of an object in the video area of ​​the first video from a user terminal used by a user watching the first video, and a transmission unit 235 that transmits the first video and a second video that is generated by cutting out the object area identified by the area identification information received by the reception unit 233 from the video area of ​​the first video and is synchronized with the first video to the user terminal.

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an information processing method. [Background technology]

[0002] BACKGROUND ART Services for distributing moving images have been known in the past. Patent Document 1 discloses a technology for distributing moving images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-274531 Summary of the Invention [Problem to be solved by the invention]

[0004] Viewers of videos may not only watch the video as a whole, but also focus on objects included in the video. Therefore, there is a demand for a mechanism that makes it easier for viewers to view objects included in the video.

[0005] The present invention has been made in consideration of these points, and aims to make it easier for viewers to view objects included in moving images. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention comprises an acquisition unit that acquires a first video, an identification unit that identifies an object included in the first video, a reception unit that receives area identification information for identifying an object area in the video area of ​​the first video that includes at least a part of the object from a user terminal used by a user watching the first video, and a transmission unit that transmits the first video and a second video that is generated by cutting out the object area identified by the area identification information received by the reception unit from the video area of ​​the first video and is synchronized with the first video to the user terminal.

[0007] The area identification information may be information for identifying the attributes of the object area, and the information processing device may further have a generation unit that generates the second video corresponding to the attribute of a specified object area for each attribute of the specified object area, and the transmission unit may transmit to the user terminal the second video corresponding to the attribute of the object area identified by the area identification information from among the multiple second videos generated by the generation unit for each attribute of the specified object area.

[0008] The area identification information may be information for identifying attributes of the object area, and the information processing device may further have a generation unit that generates the second video corresponding to the attributes of the object area identified by the area identification information, and the transmission unit may transmit the second video generated by the generation unit to the user terminal.

[0009] The generation unit may identify a reference point that serves as a basis for cutting out the object area from the video area of ​​the first video based on the attributes of the object area, and generate the second video by cutting out a specified area that includes the identified reference point as the object area.

[0010] The receiving unit may further receive a scale specified by a user using the user terminal, and the transmitting unit may transmit to the user terminal the second video generated by cutting out, as the object area, the specified area that includes the identified reference location and is determined by the scale specified by the user.

[0011] When the identification unit identifies multiple objects included in the first video, the reception unit may further receive information indicating a selected object, which is the object specified by the user among the multiple objects, and the transmission unit may transmit the second video corresponding to the selected object to the user terminal.

[0012] The receiving unit may receive information indicating the selected object and receive the area identification information corresponding to the received selected object, and the transmitting unit may transmit to the user terminal only the second video corresponding to the selected object among the plurality of second videos corresponding to each of the plurality of objects.

[0013] The information processing device may further include a storage unit that stores permission conditions for determining whether or not to permit acceptance of the area identification information, and the acceptance unit may accept the area identification information when a predetermined action by the user satisfies the permission conditions.

[0014] The area identification information may be information for identifying attributes of the object area, and the attributes of the object area may include a first attribute that is permitted to be designated regardless of whether or not the user performs a predetermined action, and a second attribute that is permitted to be designated depending on the user's predetermined action, and the information processing device may further have a memory unit that stores permission conditions for determining whether or not to permit designation of the second attribute, and the receiving unit may not accept the area identification information corresponding to the second attribute if the user's predetermined action does not satisfy the permission conditions, and may accept the area identification information corresponding to the second attribute if the user's predetermined action satisfies the permission conditions.

[0015] The area identification information may be information for identifying the attributes of the object area, and the information processing device may define a first allowed number and a second allowed number, which is a number greater than the first allowed number, as the number of second videos that are allowed to be displayed, each having different attributes of the object area, and the information processing device may further have a memory unit that stores permission conditions for determining whether to allow the second allowed number of second videos to be displayed, and the transmission unit may, if a specified action by the user does not satisfy the permission conditions, transmit one or more second videos to the user terminal up to the first allowed number, and if the specified action by the user satisfies the permission conditions, transmit a plurality of second videos to the user terminal up to the second allowed number.

[0016] The reception unit may receive a plurality of pieces of area identification information, each of which has a different object area, and the transmission unit may transmit a plurality of pieces of the second video corresponding to each of the plurality of pieces of area identification information received by the reception unit to the user terminal.

[0017] The area identification information may be information for identifying an attribute of the object area, or the receiving unit may receive as the area identification information an attribute of the object area selected by the user from a plurality of predetermined attributes of the object area.

[0018] The receiving unit may receive the area identification information based on an area designated by a user in a moving image area of ​​the first moving image displayed on the user terminal.

[0019] The area identification information may be information for identifying the attributes of the object area, or the quality of the second video corresponding to each attribute of the object area may be determined, and the transmission unit may transmit the second video to the user terminal at a quality according to the attribute of the object area corresponding to the second video.

[0020] The identification unit may identify a plurality of objects included in the first video, and the transmission unit may transmit a plurality of the second videos corresponding to each of the plurality of objects, each synchronized with the first video, to the user terminal.

[0021] An information processing method according to a second aspect of the present invention includes the steps of: acquiring a first video; identifying an object included in the first video; receiving area identification information from a user terminal used by a user watching the first video for identifying an object area in the video area of ​​the first video that includes at least a part of the object; and transmitting the first video and a second video, which is generated by cutting out the object area identified by the received area identification information from the video area of ​​the first video and is synchronized with the first video, to the user terminal. [Effects of the Invention]

[0022] According to the present invention, it is possible to provide an effect that objects included in a video can be easily viewed by a viewer. [Brief explanation of the drawings]

[0023] [Figure 1] FIG. 1 is a diagram illustrating an overview of an information processing system. [Figure 2] 3A and 3B are diagrams schematically illustrating an example of a first moving image and a second moving image. [Figure 3] FIG. 1 is a diagram schematically illustrating a functional configuration of an information processing device. [Figure 4] FIG. 10 is a diagram schematically illustrating an example of a display screen of a dedicated application. [Figure 5] 3A and 3B are diagrams schematically illustrating an example of a first moving image and a second moving image. [Figure 6] 10 is a flowchart showing the flow of processing executed by the information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0024] [Outline of Information Processing System S] FIG. 1 is a diagram for explaining an overview of an information processing system S. The information processing system S is a service used to provide an information processing service. The information processing service is a service that provides video. The video provided by the information processing service may be real-time video or archived video. The information processing system S has a user terminal 1 and an information processing device 2.

[0025] The user terminal 1 is an information processing terminal used by a user, such as a smartphone, tablet terminal, or personal computer. The user is a viewer who watches videos. A dedicated application program (hereinafter referred to as a "dedicated app") is installed in the user terminal 1 so that the user can use the information processing service. The user can watch videos using the dedicated app.

[0026] The information processing device 2 is a device that manages an information processing service, such as a server. The information processing service provides a first moving image, which is the moving image, and a second moving image that is a close-up of at least a part of an object included in the first moving image. The object is, for example, a dynamic object that can attract the user's attention, such as a person, an animal, or an avatar, but is not limited to this and may also be a static object. The processing executed by the information processing system S will be described below.

[0027] First, when a user performs an operation in a dedicated app on user terminal 1 to identify an object area that includes at least a part of an object in the video area of ​​the first video that the user wishes to view, user terminal 1 transmits area identification information to information processing device 2 ((1) in FIG. 1). The area identification information is information for identifying an object area that includes at least a part of an object in the video area of ​​the first video. The area identification information is information for identifying an attribute of the object area, such as the face of the object or the entire body of the object when the object is a person, for example.

[0028] Then, the information processing device 2 transmits the first moving image and a second moving image that is generated by cutting out the object area identified by the area identification information from the moving image area of ​​the first moving image and that is synchronized with the first moving image to the user terminal 1 ((2) in FIG. 1). After that, the user terminal 1 displays the first moving image acquired from the information processing device 2 and the second moving image that is synchronized with the first moving image on the display screen of the dedicated app.

[0029] 2 is a diagram showing an example of a first video and a second video. Video V1 is the first video, and shows a person H1 as an object. Video V2 is the second video. Screen D1 is a display screen for a dedicated app.

[0030] For example, if the area identification information indicates the face of an object, the information processing device 2 transmits a first moving image and a moving image V2 generated by cutting out an area R, which is an object area including the face of person H1, from the moving image area of ​​the first moving image to the user terminal 1. Then, the user terminal 1 displays a screen D1 showing the moving image V1 and the moving image V2 synchronized with the moving image V1.

[0031] In this way, the information processing system S can make it easier for the user to view the objects included in the first moving image. The configuration of the information processing device 2 will be described below.

[0032] [Functional configuration of information processing device 2] FIG. 3 is a diagram schematically illustrating the functional configuration of an information processing device 2. The information processing device 2 includes a communication unit 21, a storage unit 22, and a control unit 23. In FIG. 3, arrows indicate main data flows, and there may be data flows not shown in FIG. 3. In FIG. 3, each functional block indicates a configuration in functional units, rather than a configuration in hardware (device) units. Therefore, the functional blocks shown in FIG. 3 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between functional blocks via any means, such as a data bus, a network, or a portable storage medium.

[0033] The communication unit 21 is a communication interface for connecting to a network, and includes a communication controller for receiving data from an external device.

[0034] The memory unit 22 is a large-capacity storage device such as a ROM (Read Only Memory) that stores the BIOS (Basic Input Output System) of the computer that realizes the information processing device 2, a RAM (Random Access Memory) that serves as the working area of ​​the information processing device 2, an HDD (Hard Disk Drive) or SSD (Solid State Drive) that stores the OS (Operating System), application programs, and various information referenced when the application programs are executed.

[0035] The storage unit 22 stores information about a first moving image provided in the information processing service, information about a predetermined object, and information about a user. The predetermined object is an object included in the first moving image provided in the information processing service.

[0036] The information related to the first moving images is, for example, information in which a first moving image ID for identifying each first moving image and a name of the first moving image are associated with each first moving image.

[0037] The information about the predetermined object is, for example, information in which, for each predetermined object, an object ID for identifying the predetermined object, the name of the predetermined object, an identification image of the predetermined object, etc. The identification image of the predetermined object is, for example, an image used to identify the predetermined object from an unknown image (for example, the first moving image).

[0038] The information about the user is, for example, information in which a user ID for identifying the user is associated with the user's behavior history for each user. The user's behavior history is, for example, a payment history of predetermined fees paid by the user (e.g., a membership registration fee, a fee for displaying the second video, compensation for the object, a fee for participating in an event in which the object appeared, etc.), a purchase history of predetermined items purchased by the user (e.g., items specified in the information processing service, goods related to the object, etc.), a participation history of predetermined events in which the user participated (e.g., an event specified in the information processing service, an event in which the object appeared, etc.), a viewing history of videos of predetermined events viewed by the user, etc.

[0039] The control unit 23 is a processor such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), or NPU (Neural network Processing Unit) of the information processing device 2, and functions as an acquisition unit 231, an identification unit 232, a reception unit 233, a generation unit 234, and a transmission unit 235 by executing programs stored in the memory unit 22.

[0040] The acquisition unit 231 acquires the first video. For example, if the first video is a real-time video, the acquisition unit 231 acquires the first video from a camera that captures an object. Also, for example, if the first video is an archived video, the acquisition unit 231 acquires the first video from a server (not shown) that manages the first video. Note that if the first video is stored in the storage unit 22, the acquisition unit 231 may acquire the first video from the storage unit 22.

[0041] For example, when acquiring a first moving image, the acquiring unit 231 generates a first moving image ID corresponding to the first moving image. Note that the acquiring unit 231 may acquire the first moving image ID corresponding to the first moving image together with the first moving image.

[0042] The identification unit 232 identifies objects included in the first moving image. For example, the identification unit 232 first recognizes all objects included in the first moving image. The identification unit 232 can recognize objects using, for example, a known object recognition technology. Then, for each recognized object, the identification unit 232 identifies the object by comparing the first moving image including the object with an identification image of a predetermined object stored in the storage unit 22, thereby identifying the object included in the first moving image.

[0043] The receiving unit 233 receives, from the user terminal 1, region identification information for identifying an object region that includes at least a part of an object in the video region of the first video. The receiving unit 233 receives, for example, a region within a range specified by the user in the video region of the first video as the region identification information. The receiving unit 233 may also receive, as the region identification information, attributes of an object region specified by the user from among a plurality of predetermined object region attributes.

[0044] Fig. 4 is a diagram schematically illustrating an example of a display screen of the dedicated app. Screen D2 shown in Fig. 4(a) is a list screen displaying a list of first videos. For example, when a user first performs an operation to launch the dedicated app on user terminal 1, user terminal 1 acquires a list of first videos from information processing device 2 and displays screen D2 displaying the acquired list of first videos. When the user selects a first video that the user wishes to view on screen D2, user terminal 1 displays screen D3 shown in Fig. 4(b).

[0045] Screen D3 is a setting screen for setting attributes of an object region. In the example shown in Fig. 4(b), screen D3 displays "face" and "whole body" as predetermined attributes of the object region. In this case, when the user selects "face" on screen D3 and presses the setting button, user terminal 1 transmits information indicating the "face" selected by the user to information processing device 2 as region identification information.

[0046] Then, the receiving unit 233 acquires the area specifying information from the user terminal 1. In this way, the information processing device 2 can make it easier for the user to specify the attributes of the object area that he or she desires.

[0047] The receiving unit 233 may receive the area identification information based on a designated area designated by the user in the moving image area of ​​the first moving image displayed on the user terminal 1. For example, the information processing device 2 associates predetermined attributes of object areas with predetermined object parts (e.g., eyes, nose, mouth, arms, chest, legs, etc.).

[0048] In this case, when the user first selects a first video that the user wishes to view on the list screen, the user terminal 1 acquires the first video selected by the user from the information processing device 2 and displays a video playback screen showing the acquired first video. When the user taps on a part of the video area of ​​the first video displayed on the video playback screen, the user terminal 1 transmits information indicating the area tapped by the user to the information processing device 2 as information indicating a designated area. The information indicating the designated area is, for example, information indicating a position in the video area of ​​the first video.

[0049] When the receiving unit 233 acquires information indicating the designated area from the user terminal 1, the identifying unit 232 identifies the part of the object included in the designated area in the video area of ​​the first video using a known object recognition technique. The receiving unit 233 then receives the area identification information by identifying the attribute of the object area associated with the part of the object identified by the identifying unit 232. In this way, the information processing device 2 can make it easier for the user to specify the attribute of the object area desired.

[0050] The accepting unit 233 may accept the area specifying information on the condition that the user satisfies a predetermined condition. For example, the storage unit 22 stores permission conditions for determining whether or not to permit acceptance of the area specifying information. The permission conditions include, for example, that a specific fee has been paid for an information processing service, that a specific item has been purchased, that a specific event has been attended, or that a video of a specific event has been viewed.

[0051] In this case, first, the reception unit 233 acquires the user ID from the user terminal 1, and determines whether or not a predetermined behavior by the user satisfies the permission conditions by referring to the user's behavior history associated with the acquired user ID in the storage unit 22. Then, if the reception unit 233 determines that the predetermined behavior by the user does not satisfy the permission conditions, it does not accept the area identification information, and if it determines that the predetermined behavior by the user satisfies the permission conditions, it accepts the area identification information.

[0052] When the information processing device 2 does not accept region identification information (for example, either "face" or "whole body") from the user terminal 1, it may accept a predetermined attribute of the object region (for example, "whole body") as the region identification information, or may transmit only the first moving image without transmitting the second moving image to the user terminal 1. In this way, the information processing device 2 can provide the user with motivation to take an action that satisfies the permission conditions.

[0053] The accepting unit 233 may increase or decrease the number of object area attributes that are permitted to be accepted depending on whether the user satisfies a predetermined condition. For example, the attributes of the object area include a first attribute and a second attribute. The first attribute is an attribute of one or more object areas that is permitted to be designated regardless of whether or not the user has performed a predetermined action. The second attribute is an attribute of one or more object areas that is permitted to be designated depending on the user's predetermined action. In this case, the permission condition is a condition for determining whether or not to permit the designation of the second attribute.

[0054] In this case, if the receiving unit 233 determines that the predetermined behavior of the user does not satisfy the permission conditions, it does not accept area specifying information corresponding to the second attribute and accepts only area specifying information corresponding to the first attribute. On the other hand, if the receiving unit 233 determines that the predetermined behavior of the user satisfies the permission conditions, it accepts area specifying information corresponding to the first attribute or area specifying information corresponding to the second attribute. In this way, the information processing device 2 can provide motivation for the user to take behavior that satisfies the permission conditions.

[0055] The reception unit 233 makes the determination using, for example, a common permission condition defined in the information processing service. The reception unit 233 may also make the determination using a permission condition defined for each predetermined object. For example, the storage unit 22 stores a permission condition for each predetermined object.

[0056] In this case, the reception unit 233 determines whether or not a predetermined action by the user satisfies a permission condition corresponding to an object identified by the identification unit 232 in the first video selected by the user. When the identification unit 232 identifies multiple objects in the first video selected by the user, the reception unit 233 may determine, for each object identified by the identification unit 232, whether or not a predetermined action by the user satisfies a permission condition corresponding to the object, or may determine whether or not a predetermined action by the user satisfies any of a plurality of permission conditions corresponding to each of the plurality of objects identified by the identification unit 232.

[0057] The transmitting unit 235 transmits to the user terminal 1 the first moving image and a second moving image that has been generated by cutting out an object area identified by the area identification information received by the receiving unit 233 from the moving image area of ​​the first moving image and that is synchronized with the first moving image. For example, the generating unit 234 first generates the second moving image by cutting out an area of ​​a range specified by the user and indicated by the area identification information received by the receiving unit 233 from the moving image area of ​​the first moving image. Then, the transmitting unit 235 transmits to the user terminal 1 the first moving image and the second moving image that has been generated by the generating unit 234 and that is synchronized with the first moving image.

[0058] The transmission unit 235 may transmit the first moving image and the second moving image generated based on the attributes of the object region to the user terminal 1. Specifically, the information processing device 2 transmits the first moving image and the second moving image generated based on the attributes of the object region to the user terminal 1 by executing the following two steps.

[0059] As a first step, the generation unit 234 generates a second moving image based on the attributes of the object region. Specifically, the generation unit 234 first identifies a reference location that serves as a reference for cutting out the object region from the moving image region of the first moving image based on the attributes of the object region. The reference location is a location that serves as a reference for cutting out the object region from the moving image region of the first moving image, and is, for example, a location determined according to the attributes of the object region. For example, when the attribute of the object region is "face," the reference locations are the eyes, nose, mouth, chin, etc., and when the attribute of the object region is "entire body," the reference locations are the chest, arms, legs, etc.

[0060] The generation unit 234 then generates the second moving image by cutting out a predetermined area including the identified reference location as an object area. The predetermined area is an area determined according to the attributes of the object area and the reference location. In this way, the information processing device 2 can generate a second moving image that captures at least a portion of the object, even if the object is a dynamic object.

[0061] For example, when generating a second moving image, the generating unit 234 sets object IDs corresponding to objects included in the second moving image and attributes of object areas of the second moving image as metadata of the second moving image.

[0062] In a second step, the transmitting unit 235 transmits to the user terminal 1 the first video acquired by the acquiring unit 231 and the second video generated by the generating unit 234, the second video having a playback time synchronized with that of the first video.

[0063] For example, the transmission unit 235 transmits the second moving image generated at the same scale as the first moving image to the user terminal 1. The transmission unit 235 may transmit the second moving image generated at a scale (for example, a degree of enlargement or reduction) specified by the user.

[0064] Specifically, first, the receiving unit 233 receives the scale of the object area specified by the user. For example, a setting screen of the dedicated app (e.g., a setting screen or a video playback screen) may have a scale specification item for specifying the degree of scale, and the receiving unit 233 receives the degree of scale specified by the user in the scale specification item. Then, the generating unit 234 transmits to the user terminal 1 the second moving image generated by cutting out, as the object area, a predetermined area that includes the identified reference location and is determined by the scale specified by the user. In this way, the information processing device 2 can present the user with the second moving image at the scale desired by the user.

[0065] The transmission unit 235 may transmit the second moving image of a quality according to the attribute of the object region to the user terminal 1. The quality of the second moving image is, for example, the resolution, the frame rate, the compression rate, etc. For example, for each attribute of the object region, the quality of the second moving image corresponding to the attribute is determined.

[0066] In this case, the transmitting unit 235 transmits the second video to the user terminal 1 at a quality corresponding to the attribute of the object region corresponding to the second video. For example, it is assumed that the quality of the second video for a "face" is set higher than that for a "whole body." In this case, when the region identification information indicates a "face," the transmitting unit 235 transmits the second video corresponding to the "face" to the user terminal 1 at a higher quality than the second video corresponding to the "whole body." Furthermore, when the region identification information indicates a "whole body," the transmitting unit 235 transmits the second video corresponding to the "whole body" to the user terminal 1 at a lower quality than the second video corresponding to the "face." Note that, instead of the transmitting unit 235 performing a process for adjusting the quality of the second video to correspond to the degree of interest corresponding to the object, the generating unit 234 may generate the second video at a quality corresponding to the degree of interest corresponding to the object. In this way, the information processing device 2 can present the second video to the user at a quality corresponding to the attribute of the object region.

[0067] The transmission unit 235 may transmit a plurality of second videos corresponding to a plurality of different object areas to the user terminal 1. Specifically, first, the reception unit 233 receives a plurality of pieces of area identification information each of which corresponds to a different object area. Then, the transmission unit 235 transmits a plurality of second videos corresponding to each of the plurality of pieces of area identification information received by the reception unit 233 to the user terminal 1. In this way, the information processing device 2 can present to the user a second video in which various close-ups of objects are taken.

[0068] For example, the transmission unit 235 transmits a second moving image corresponding to the attribute of an object area designated by the user from among a plurality of second moving images generated in advance for each attribute of a predetermined object area to the user terminal 1. Specifically, first, when the identification unit 232 identifies an object included in the first moving image, the generation unit 234 generates a second moving image corresponding to the attribute of the predetermined object area for each attribute of the predetermined object area.

[0069] Then, the transmitting unit 235 transmits, from among the plurality of second moving images generated by the generating unit 234 for each attribute of a predetermined object area, the second moving image that corresponds to the attribute of the object area identified by the area identifying information received by the receiving unit 233 to the user terminal 1. In this way, the information processing device 2 can prevent an occurrence of a situation in which resource consumption of the information processing device 2 increases due to generating a second moving image for each user.

[0070] The transmission unit 235 may transmit the second moving image generated in response to the designation of the attribute of the user object area to the user terminal 1. Specifically, first, triggered by the reception unit 233 receiving the area identification information, the generation unit 234 generates a second moving image corresponding to the attribute of the object area identified by the area identification information received by the reception unit 233.

[0071] Then, the transmission unit 235 transmits the second moving image generated by the generation unit 234 to the user terminal 1. In this way, the information processing device 2 can prevent a situation from occurring in which resources of the information processing device 2 are unnecessarily consumed by generating a second moving image that is not transmitted to the user terminal 1.

[0072] When the identification unit 232 identifies multiple objects included in the first video, the transmission unit 235 transmits multiple second videos corresponding to the multiple objects respectively, and each second video being synchronized with the first video, to the user terminal 1. Specifically, the transmission unit 235 transmits multiple second videos corresponding to the multiple objects identified by the identification unit 232 based on the first video, and each second video corresponding to an attribute of the object area identified by the area identification information received by the reception unit 233, to the user terminal 1.

[0073] The transmitting unit 235 may transmit to the user terminal 1 a second moving image corresponding to an object (hereinafter referred to as a "selected object") designated by the user from among the plurality of objects identified by the identifying unit 232 based on the first moving image. Specifically, first, when the identifying unit 232 identifies the plurality of objects included in the first moving image, the receiving unit 233 further receives information indicating the selected object. The information indicating the selected object is, for example, an object ID for identifying the object, which corresponds to the selected object. For example, a selection item for selecting one of the plurality of objects included in the first moving image is provided on the display screen (for example, a setting screen) of the dedicated app, and the receiving unit 233 receives the object ID corresponding to the object selected by the user in the selection item.

[0074] Then, the transmitting unit 235 transmits the first video and the second video corresponding to the selected object to the user terminal 1. For example, the transmitting unit 235 does not transmit second videos corresponding to objects other than the selected object among the plurality of objects identified by the identifying unit 232 based on the first video, but transmits the first video and the second video corresponding to the selected object to the user terminal 1. In this case, the transmitting unit 235 may transmit to the user terminal 1 a plurality of second videos each having different attributes of the object region and corresponding to the selected object.

[0075] The transmission unit 235 may transmit the first video, a plurality of second videos corresponding to each of a plurality of objects including the selected object, and a display list of the second videos to the user terminal 1. The display list is a list indicating the display order of the second videos, in which the second video corresponding to the selected object is set higher in the display order of the second videos. Upon acquiring the first video, the plurality of second videos, and the display list of the second videos, the user terminal 1 displays the first video and the plurality of second videos arranged in the display order indicated by the display list.

[0076] 5 is a diagram schematically showing an example of the first moving image and the second moving image. Moving image V3 is the first moving image and includes four persons H (persons H2, H3, H4, and H5) as objects. Moving image V4 is the second moving image corresponding to person H2, moving image V5 is the second moving image corresponding to person H3, moving image V6 is the second moving image corresponding to person H4, and moving image V7 is the second moving image corresponding to person H5. Screen D2 is a display screen of a dedicated app.

[0077] For example, suppose the area identification information indicates "face" and the selected object is person H4. In this case, first, the transmission unit 235 transmits to the user terminal 1 the video V3, the video V4, video V5, video V6, and video V7, which are second videos generated by cutting out object areas including the faces of each object from the video V3 and the video area, and a display list in which the video V6 corresponding to person H4 is set higher in the display order of the second videos. Then, the user terminal 1 displays a screen D2 on which the video V1 and the multiple second videos arranged in the display order indicated by the display list are displayed in a display column for the second videos.

[0078] 5, two second videos (video V6 and video V4) are displayed in the second video display column, and video V6 corresponding to person H4, which is the selected object, is displayed at the top of the second video display column. In this case, the transmission unit 235 transmits, for example, video V6 and video V4, which are displayed in the second video display column, out of the multiple second videos, to the user terminal 1. In this way, the information processing device 2 can make it easier for the user to view the second video corresponding to the object specified by the user.

[0079] The user can display second videos (videos V5 and V7) that are not currently displayed by, for example, sliding the display field for the second videos up and down. For example, when the user slides the display field for the second videos up to display videos V4 and V5 in the display field for the second videos, the transmission unit 235 transmits, for example, videos V4 and V5 of the multiple second videos to the user terminal 1. In this way, the information processing device 2 can present to the user second videos corresponding to objects other than the object specified by the user.

[0080] The transmission unit 235 may increase or decrease the number of second videos to be simultaneously displayed in the display column for second videos, depending on whether or not a predetermined action by the user satisfies the permission condition. For example, the information processing device 2 is set to a first permission number and a second permission number as the number of second videos that correspond to one object and have different attributes of the object region that are permitted to be displayed.

[0081] The first allowed number is, for example, the number (e.g., 1) of second videos that are permitted to be displayed regardless of whether a predetermined action by the user satisfies the permission condition. The second allowed number is a number greater than the first allowed number, and is the number (e.g., 2) of second videos that are permitted to be displayed depending on whether a predetermined action by the user satisfies the permission condition. In this case, the permission condition is a condition for determining whether to permit the second allowed number of second videos to be displayed.

[0082] In this case, the transmission unit 235 first determines whether or not the predetermined behavior of the user satisfies the permission condition. If the transmission unit 235 determines that the predetermined behavior of the user does not satisfy the permission condition, the transmission unit 235 transmits one or more second videos up to the first permission number to the user terminal 1. In this case, the user terminal 1 displays the first permission number of second videos in the display column for second videos.

[0083] On the other hand, when the transmission unit 235 determines that the predetermined behavior of the user satisfies the permission condition, it transmits a plurality of second videos up to the second permission number to the user terminal 1. In this case, the user terminal 1 displays the second permission number of second videos in the second video display field. In this way, the information processing device 2 can provide the user with motivation to take behavior that satisfies the permission condition.

[0084] The transmitting unit 235 may transmit only the second moving image corresponding to the selected object to the user terminal 1. Specifically, the receiving unit 233 first receives information indicating the selected object and receives area identification information corresponding to the received selected object. Then, the transmitting unit 235 transmits only the second moving image corresponding to the selected object among the plurality of second moving images corresponding to the plurality of objects, respectively, to the user terminal 1.

[0085] More specifically, the transmission unit 235 does not transmit, to the user terminal 1, second videos corresponding to objects other than the selected object among a plurality of second videos corresponding to each of a plurality of objects, but transmits the first video and the second video corresponding to the selected object to the user terminal 1. In this way, the information processing device 2 can make it easier for the user to concentrate on watching the object specified by the user.

[0086] [Processing of information processing device 2] Next, a description will be given of the flow of processing by the information processing device 2. Fig. 6 is a flowchart showing the flow of processing executed by the information processing device 2. This flowchart starts when the acquisition unit 231 acquires the first moving image (S1).

[0087] The identification unit 232 identifies an object included in the first moving image (S2). When the identification unit 232 identifies an object included in the first moving image, the generation unit 234 generates a second moving image corresponding to the attribute of each predetermined object region for each attribute of the predetermined object region (S3).

[0088] The receiving unit 233 receives, as area identification information, the attribute of an object area specified by the user from among a plurality of predetermined object area attributes (S4). The transmitting unit 235 selects, from a plurality of second videos generated by the generating unit 234 for each of the predetermined object area attributes, a second video corresponding to the attribute of the object area identified by the area identification information received by the receiving unit 233 (S5). Then, the transmitting unit 235 transmits the first video and the selected second video that is synchronized with the first video to the user terminal 1 (S6).

[0089] [Variations] In the above, an example has been described in which the information processing device 2 transmits the second video to the user terminal 1 according to the area identification information received from the user terminal 1, but this is not limiting. For example, the user terminal 1 may control the display of the second video according to the area identification information.

[0090] Specifically, first, when the user selects a first video that the user wishes to view on the list screen of first videos, the user terminal 1 transmits a first video ID corresponding to the first video to the information processing device 2. When the information processing device 2 acquires the first video ID from the user terminal 1, it transmits to the user terminal 1 the first video corresponding to the first video ID and multiple second videos generated for each combination of objects included in the first video and attributes of predetermined object regions.

[0091] When the user inputs area identification information on the setting screen, the user terminal 1 selects a second video corresponding to the area identification information input by the user from among the plurality of second videos, and displays the first video and the selected second video on the video playback screen. In this way, the user terminal 1 can control the display of the second video according to the area identification information input by the user.

[0092] [Effects of this embodiment] As described above, the information processing device 2 transmits to the user terminal 1 the first video and the second video, which is generated by cutting out the object area specified by the area specifying information received from the user terminal 1 and is synchronized with the first video. In this way, the information processing device 2 can make it easier for the user to view the object included in the first video.

[0093] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is "Build resilient infrastructure, promote inclusive and sustainable industrialization, and promote innovation and resilience."

[0094] The present invention has been described above using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by functionally or physically distributing or integrating any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combination also have the effects of the original embodiments. [Explanation of symbols]

[0095] 1. User terminal 2. Information processing equipment 21 Communications Department 22 Memory section 23 Control Unit 231 Acquisition Department 232 Specific part 233 Reception Department 234 Generation part 235 Transmitter S Information Processing System

Claims

1. A storage unit that stores permission conditions for determining whether to permit acceptance of area identification information for identifying an object area of ​​a video area of ​​a first video that includes at least a part of an object included in the first video; and an acquisition unit that acquires the first moving image; an identification unit that identifies the object included in the first moving image; a receiving unit that receives the area identification information from a user terminal used by a user who watches the first video when a predetermined action by the user satisfies the permission condition; a transmitting unit that transmits to the user terminal the first moving image and a second moving image that is generated by cutting out the object area identified by the area identification information received by the receiving unit from a moving image area of ​​the first moving image and that is synchronized with the first moving image; An information processing device having the above.

2. An acquisition unit that acquires a first video; an identification unit that identifies an object included in the first moving image; a receiving unit that receives, from a user terminal used by a user watching the first video, region identification information for identifying an object region that includes at least a part of the object within a video region of the first video, the region identification information being information for identifying attributes of the object region that include a first attribute that is permitted to be designated regardless of whether or not the user has performed a predetermined action, and a second attribute that is permitted to be designated depending on the user's predetermined action; a transmitting unit that transmits to the user terminal the first moving image and a second moving image that is generated by cutting out the object area identified by the area identification information received by the receiving unit from a moving image area of ​​the first moving image and that is synchronized with the first moving image; a storage unit that stores a permission condition for determining whether or not to permit designation of the second attribute; and the receiving unit does not receive the area identification information corresponding to the second attribute when the predetermined behavior of the user does not satisfy the permission condition, and receives the area identification information corresponding to the second attribute when the predetermined behavior of the user satisfies the permission condition. Information processing device.

3. An acquisition unit that acquires a first video; an identification unit that identifies an object included in the first moving image; a receiving unit that receives, from a user terminal used by a user watching the first video, region identification information for identifying an object region that includes at least a part of the object in a video region of the first video, the region identification information being information for identifying an attribute of the object region; a transmitting unit that transmits to the user terminal the first moving image and a second moving image that is generated by cutting out the object area identified by the area identification information received by the receiving unit from a moving image area of ​​the first moving image and that is synchronized with the first moving image; a storage unit that stores a permission condition for determining whether to permit the second permission number of second videos to be displayed, when a first permission number and a second permission number, which is a number of second videos permitted to be displayed that are greater than the first permission number, are defined as the number of second videos permitted to be displayed, each of which has a different attribute of the object region; and the transmitting unit transmits one or more of the second videos to the user terminal up to the first permitted number when the predetermined behavior of the user does not satisfy the permission condition, and transmits a plurality of the second videos to the user terminal up to the second permitted number when the predetermined behavior of the user satisfies the permission condition. Information processing device.

4. An acquisition unit that acquires a first video; an identification unit that identifies an object included in the first moving image; a generation unit that identifies, for each attribute of a predetermined object area, a reference point that serves as a reference for cutting out an object area including at least a part of the object from the video area of ​​the first video based on the attribute of the predetermined object area, and generates a second video by cutting out the predetermined area including the identified reference point from the video area of ​​the first video as the predetermined object area; a receiving unit that receives, from a user terminal used by a user watching the first video, region identification information for identifying the object region that includes at least a part of the object in the video region of the first video, the region identification information being information for identifying an attribute of the object region; a transmitting unit that transmits to the user terminal the first video and the second video, which corresponds to an attribute of the object region specified by the region specifying information among the plurality of second videos generated by the generating unit for each attribute of the predetermined object region, and which is synchronized with the first video; An information processing device having the above.

5. An acquisition unit that acquires a first video; an identification unit that identifies an object included in the first moving image; a receiving unit that receives, from a user terminal used by a user who watches the first video, region identification information for identifying an object region that includes at least a part of the object within a video region of the first video, the region identification information being information for identifying an attribute of the object region; a generation unit that generates a second moving image by identifying a reference point that serves as a reference for cutting out the object area from the moving image area of ​​the first moving image based on an attribute of the object area identified by the area identification information, and cutting out a predetermined area including the identified reference point from the moving image area of ​​the first moving image as the object area; a transmitting unit that transmits the first video and the second video generated by the generating unit and synchronized with the first video to the user terminal; An information processing device having the above.

6. The receiving unit further receives a scale specified by a user who uses the user terminal, the transmission unit transmits the second video generated by cutting out, as the object area, the predetermined area including the identified reference location and determined by a scale specified by the user, to the user terminal.

6. The information processing device according to claim 4 or 5.

7. when the identification unit identifies a plurality of objects included in the first moving image, the reception unit further receives information indicating a selected object that is the object designated by the user among the plurality of objects; the transmission unit transmits the second video corresponding to the selected object to the user terminal; The information processing device according to claim 1 .

8. the receiving unit receives information indicating the selected object, and receives the area specifying information corresponding to the received selected object; the transmitting unit transmits, to the user terminal, only the second video corresponding to the selected object among the plurality of second videos corresponding to the plurality of objects, respectively. The information processing device according to claim 7 .

9. the receiving unit receives a plurality of pieces of area identification information, each of which has a different object area; the transmitting unit transmits to the user terminal a plurality of the second moving images corresponding to the plurality of pieces of area identification information received by the receiving unit, respectively. The information processing device according to claim 1 .

10. the region identification information is information for identifying an attribute of the object region, the receiving unit receives, as the area identification information, an attribute of the object area selected by the user from a plurality of predetermined attributes of the object area; The information processing device according to claim 1 .

11. the receiving unit receives the area identification information based on an area designated by a user in a moving image area of ​​the first moving image displayed on the user terminal; The information processing device according to claim 1 .

12. the region identification information is information for identifying an attribute of the object region, a quality of the second moving image corresponding to each attribute of the object region is determined; the transmitting unit transmits the second moving image to the user terminal at a quality according to an attribute of the object region corresponding to the second moving image. The information processing device according to claim 1 .

13. the identification unit identifies a plurality of objects included in the first moving image; the transmission unit transmits to the user terminal a plurality of second videos corresponding to the plurality of objects, the second videos being synchronized with the first videos, respectively; The information processing device according to claim 1 .

14. A method executed by a computer having a memory unit that stores permission conditions for determining whether to permit acceptance of area identification information for identifying an object area of ​​a video area of ​​a first video that includes at least a part of an object included in the first video, acquiring the first moving image; Identifying the object included in the first moving image; receiving the area identification information from a user terminal used by a user who watches the first video when a predetermined action by the user satisfies the permission condition; transmitting, to the user terminal, the first moving image and a second moving image generated by cutting out the object area identified by the area identification information received from a moving image area of ​​the first moving image and synchronized with the first moving image; An information processing method comprising:

15. A method for executing a program by a computer having a memory unit, acquiring a first moving image; Identifying an object included in the first moving image; receiving, from a user terminal used by a user watching the first video, area identification information for identifying an object area including at least a part of the object within a video area of ​​the first video, the area identification information being information for identifying attributes of the object area including a first attribute that is permitted to be designated regardless of whether or not the user has performed a predetermined action, and a second attribute that is permitted to be designated depending on the user's predetermined action; transmitting, to the user terminal, the first moving image and a second moving image generated by cutting out the object area identified by the area identification information received from a moving image area of ​​the first moving image and synchronized with the first moving image; and the storage unit stores a permission condition for determining whether or not to permit designation of the second attribute; In the step of accepting the area identification information, if the predetermined behavior of the user does not satisfy the permission condition, the area identification information corresponding to the second attribute is not accepted, and if the predetermined behavior of the user satisfies the permission condition, the area identification information corresponding to the second attribute is accepted. Information processing methods.

16. A method for executing a program by a computer having a memory unit, acquiring a first moving image; Identifying an object included in the first moving image; receiving, from a user terminal used by a user watching the first video, region identification information for identifying an object region including at least a part of the object within a video region of the first video, the region identification information being information for identifying an attribute of the object region; transmitting, to the user terminal, the first moving image and a second moving image generated by cutting out the object area identified by the area identification information received from a moving image area of ​​the first moving image and synchronized with the first moving image; and the storage unit stores a permission condition for determining whether to permit display of the second allowed number of second videos when a first permission number and a second permission number, which is a number of second videos permitted to be displayed that are different from the first permission number, are defined as the number of second videos permitted to be displayed, each of which has a different attribute of the object region; In the step of transmitting the first video and the second video to the user terminal, if the predetermined behavior of the user does not satisfy the permission condition, one or more of the second videos are transmitted to the user terminal up to the first permission number, and if the predetermined behavior of the user satisfies the permission condition, a plurality of the second videos are transmitted to the user terminal up to the second permission number. Information processing methods.

17. A computer-implemented method for acquiring a first moving image; Identifying an object included in the first moving image; generating a second moving image by identifying, for each attribute of a predetermined object area, a reference point that serves as a reference for cutting out an object area including at least a part of the object from the moving image area of ​​the first moving image based on the attribute of the predetermined object area, and cutting out the predetermined area including the identified reference point from the moving image area of ​​the first moving image as the predetermined object area; receiving, from a user terminal used by a user watching the first video, region identification information for identifying an object region including at least a part of the object within a video region of the first video, the region identification information being information for identifying an attribute of the object region; transmitting, to the user terminal, the first video and the second video, which corresponds to an attribute of the object region specified by the region specifying information among the plurality of second videos generated for each attribute of the predetermined object region, and which is synchronized with the first video; An information processing method comprising:

18. A computer-implemented method for acquiring a first moving image; Identifying an object included in the first moving image; receiving, from a user terminal used by a user watching the first video, area identification information for identifying an object area including at least a part of the object within a video area of ​​the first video, the area identification information being information for identifying an attribute of the object area; generating a second moving image by identifying a reference point that serves as a reference for cutting out the object area from the moving image area of ​​the first moving image based on the attributes of the object area identified by the area identification information, and cutting out a predetermined area that includes the identified reference point from the moving image area of ​​the first moving image as the object area; transmitting the first video and the generated second video, the second video being synchronized with the first video, to the user terminal; An information processing method comprising:

Images