Program, Information Processing Apparatus, Information Processing Method, and Information Processing System

Abstract

Provided are a program, an information processing apparatus, an information processing method, and an information processing system that simplify the editing operation of a distribution video and improve the convenience of a distribution application. 【Solution means】A program to be executed by an information processing apparatus for distributing a video in which an image of a performer is arranged on a background that is a background image or a virtual space includes a storage process for storing a plurality of object candidates that are candidates for objects constituting the video and a plurality of background candidates that are candidates for the background, a configuration process for configuring each of the plurality of background candidates using at least a part of the plurality of object candidates, and a setting process for setting the selected background candidate as the background in the video in response to an operation of selecting any one of the plurality of background candidates by the distributor of the video.

Description

Technical Field

[0001] The present invention relates to a program, an information processing apparatus, an information processing method, and an information processing system.

Background Art

[0002] A video distribution system provides a service for distributing a video edited by a distributor to viewers via the Internet. In a conventional video distribution system, a distribution application reads objects such as a background image, a virtual space, a decorative item, a character representing a performer, and music (BGM: BackGround Music) from the Web and provides them to the distributor as components of the video. The distributor arranges decorative items or the like on the background image or virtual space and sets it as the background for the performance of the video actors. The data of the background set using a plurality of objects such as a background image and a decorative item is managed as asset data for constructing a virtual space or the like (see Patent Document 1).

[0003] Patent Document 1 describes that object data includes asset data for constructing a virtual space that constitutes a video, object data for drawing the background of the virtual space that constitutes the video, data for drawing various objects displayed in the video, and data for drawing various other objects displayed in the video.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] As described above, in the conventional video distribution system, the distribution application reads objects such as background images, virtual spaces, decorative items, and characters representing performers from the Web and provides them to the distributor as components of the video. The distributor often overlays decorative items or the like on the background image or virtual space and sets it as the background. Therefore, when the distributor wants to switch the background when switching scenes accompanying the video stream, it is necessary to set a plurality of background candidates in advance. That is, in the conventional video distribution system, since it takes time to create the background of the distributed video, there is a problem that the editing operation of the distributed video is complicated and the convenience of the distribution service is reduced.

[0006] The present invention has been made to solve the above problems, and an object of the present invention is to simplify the editing operation of the distributed video and improve the convenience of the distribution application.

Means for Solving the Problems

[0007] The present invention causes an information processing apparatus for distributing a video in which an image of a performer is arranged on a background that is a background image or a virtual space, to store a plurality of object candidates that are candidates for objects constituting the video, and a plurality of background candidates that are candidates for the background, a configuration process of configuring each of the plurality of background candidates using at least a part of the plurality of object candidates, and a setting process of setting the selected background candidate as the background in the video in response to an operation of selecting any one of the plurality of background candidates by the distributor of the video. Note that the above program is an aspect of the present invention, and an information processing apparatus, an information processing method, and an information processing system reflecting one aspect of the present invention are also configured in the same manner as the above server.

Effects of the Invention

[0008] According to the present invention having the above configuration, it is possible to simplify the editing operation of the distributed video and improve the convenience of the distribution application. Problems, configurations, and effects other than those described above will be clarified by the description of the following embodiments.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same function or configuration are denoted by the same reference numerals, and redundant descriptions are omitted.

[0011] <Configuration Example of Video Distribution System> Next, a configuration example of the video distribution system according to the present embodiment will be described. FIG. 1 is a block diagram showing a configuration example of a video distribution system 1 according to the present embodiment. The video distribution system 1 is an example of an information processing system, and as shown in FIG. 1, includes a server 10, a distribution terminal 20, and a plurality of viewing terminals 30. The server 10, the distribution terminal 20, and the plurality of viewing terminals 30 are connected to each other via a network NW. The network NW is composed of a public line such as the Internet and may include a LAN (Local Area Network), a WAN (Wide Area Network), or the like.

[0012] The server 10 is an information processing device that provides a video distribution service. Here, video distribution includes the distribution of pre-generated videos and the distribution of live videos. Also, in the present embodiment, the video to be distributed includes at least the image of the performer and the background in which the image of the performer is placed. Here, the background is a background image or a virtual space. Also, the image of the performer is an image of a character representing the performer, an image of the performer taken by a camera, or the like. The image of the performer may be any of a still image, a dynamic image, or a live captured image. The background in which the image of the performer is placed is configured using a plurality of objects. Here, an object includes an image such as a background image, a virtual space, a decorative item, an image of a character, etc., and audio such as BGM. When the object is an image, it may be any of a still image, a dynamic image, or a video. Also, when the object is audio, it may be any audio such as BGM, radio, or the live voice of the performer.

[0013] The server 10 provides a video distribution / viewing platform for distributors and viewers logged in to the video distribution system 1. The server 10 receives a distribution video from the distribution terminal 20 via the network NW and provides the received video to viewers through the distribution / viewing service platform. The detailed functions of the server 10 will be described in detail with reference to FIG. 2 below.

[0014] The distribution terminal 20 is an information processing device such as a PC (Personal Computer), tablet, or smartphone held by a video distributor. A distribution application is installed on the distribution terminal 20. The distribution application has a video generation screen (see FIG. 6 described later). The distributor can configure and generate a video on the video generation screen. The distribution terminal 20 can transmit the generated video or live video to the server 10 via the network NW and start an effect on the distribution / viewing platform. The detailed functions of the distribution terminal 20 will be described in detail with reference to FIG. 2 described later.

[0015] The viewing terminal 30 is an information processing device such as a PC (Personal Computer), tablet, or smartphone held by a video viewer. Using the viewing terminal 30, the video distributed by the distributor can be viewed on the distribution / viewing platform provided by the server 10 via the network NW. Also, the viewer can perform operations such as comment sending and tipping on the display screen of the video being viewed using the viewing terminal 30.

[0016] <Functional configuration example of the video distribution system> Next, a functional configuration example of the video distribution system 1 according to the present embodiment will be described. FIG. 2 is a block diagram showing a functional configuration example of the video distribution system 1 according to the present embodiment. The network NW is omitted in FIG. 2. Also, in FIG. 2, only the functional configuration parts related to various functions of the present invention are displayed, and the illustration and description of other functional configuration parts are omitted. Hereinafter, functional configuration examples of the server 10 and the distribution terminal 20 constituting the video distribution system 1 will be described. A detailed description of the viewing terminal 30 is omitted.

[0017] [Functional configuration example of the server 10] As shown in FIG. 2, the server 10 includes a processing unit 11, a storage unit 12, and a communication unit 13. The processing unit 11 is connected to each of the storage unit 12 and the communication unit 13.

[0018] The processing unit 11 performs various processes for providing a video distribution / viewing service, and includes a receiving unit 111, a service providing unit 112, and a transmitting unit 113.

[0019] The receiving unit 111 receives, via the communication unit 13, commands such as start, stop, and end of video distribution from the distribution terminal 20, and videos created and generated by the distributor. Further, the receiving unit 111 receives a video viewing request from the viewing terminal 30 and operation information such as a comment post or a donation by the viewer.

[0020] The service providing unit 112 provides a video distribution / viewing platform. In response to a video distribution request from the distribution terminal 20, the service providing unit 112 starts the distribution of the video received from the distribution terminal 20 on the distribution / viewing platform. Further, in response to a video viewing request from the viewing terminal 30, the service providing unit 112 starts video viewing for the viewer on the distribution / viewing platform.

[0021] The transmitting unit 113 transmits notifications such as start, stop, and end of video distribution to the distribution terminal 20. Further, the transmitting unit 113 transmits notifications such as start, stop, and end of video viewing to the viewing terminal 30.

[0022] The storage unit 12 stores input / output data of various processes in the server 10. Further, the storage unit 12 may store a plurality of object candidates that are candidates for objects constituting the video, and a plurality of background candidates that are candidates for the background of the video.

[0023] The communication unit 13 establishes connections between the server 10 and each of the distribution terminal 20 and the viewing terminal 30 via the network NW, and performs transmission and reception of various data with each of the distribution terminal 20 and the viewing terminal 30.

[0024] [Functional configuration example of the distribution terminal 20] The distribution terminal 20 has a function of generating a distribution video and a function of managing the production of the distribution video. As shown in FIG. 2, it includes a processing unit 21, a storage unit 22, an operation display unit 23, an imaging unit 24, an audio input unit 25, and a communication unit 26. The processing unit 21 is connected to each of the storage unit 22, the operation display unit 23, the imaging unit 24, the audio input unit 25, and the communication unit 26.

[0025] The processing unit 21 performs the functions of the distribution application installed in the distribution terminal 20, and has a configuration unit 211, a setting unit 212, a video generation unit 213, a transmission unit 214, and a reception unit 215.

[0026] The configuration unit 211 constitutes each of a plurality of background candidates (refer to Studio A and Studio B in FIG. 6 described later), which are candidates for the background of the video, using at least a part of a plurality of object candidates for constituting the video, which are registered (stored) in advance in the storage unit 22. For example, the configuration unit 211 periodically acquires the background usage history data in the video distribution system 1 from the server 10, and constitutes a predetermined number of backgrounds with the most usage times as background candidates from the background usage history data. Thereby, the distribution application can always provide the most popular background candidates.

[0027] The information of each of the plurality of background candidates constituted by the configuration unit 211 is output to and stored in the storage unit 22. The information of the background candidates includes a background candidate table and a background candidate configuration table, and the configurations of these two tables will be described in detail with reference to FIG. 3 described later. Note that the background candidates are not limited to being configured by the configuration unit 211, and may be released to the storage unit 22 when the distribution application is installed, for example.

[0028] The setting unit 212 sets the selected background candidate as the background in the video in response to an operation of selecting any one of a plurality of background candidates by the distributor. Specifically, the setting unit 114 extracts the configuration information of the background candidate (refer to the background candidate configuration table T3 shown in FIG. 3 described later) based on the identification information of the background candidate selected by the distributor on the video generation screen U1 (refer to FIG. 6) described later, and sets the background of the video according to the extracted configuration information of the background candidate.

[0029] Also, when an operation is performed by the distributor to change the background candidate currently set as the background to another background candidate, the setting unit 212 changes the background to another background candidate in response to the operation. Also, when an operation is performed by the distributor to change the object candidate constituting the current background to another object candidate, the setting unit 212 changes the object candidate to another object candidate in response to the operation. Also, when an operation is performed to add any one of a plurality of object candidates to the current background, the setting unit 212 arranges the added object candidate in the background in response to the operation. Also, the background changed by the setting unit 212 may be stored in the storage unit 22 as a background candidate for the distributor's customization. Note that the above various processes in the setting unit 212 can be executed at any time before and during the distribution of the video.

[0030] The video generation unit 213 generates a video to be distributed based on the background set by the setting unit 114, the image of the performer arranged on the background, and the information of other object candidates.

[0031] When the distribution application is launched, the transmission unit 214 transmits the user ID registered by the distributor in the video distribution system 1, that is, the identification information of the distributor, to the server 10 via the communication unit 26. Also, the transmission unit 214 transmits the video generated by the video generation unit 213 to the server 10 via the communication unit 26. Also, the transmission unit 214 transmits an instruction to start, stop, and end the production of the video to the server 10 via the communication unit 26.

[0032] The receiving unit 215 receives notifications such as the start, stop, and end of video production from the server 10. The receiving unit 215 also receives information on comments posted by viewers, donation information, etc. from the server 10.

[0033] The storage unit 22 stores a plurality of object candidates and a plurality of background candidates. The storage unit 22 may also store, as background candidates, the backgrounds changed by the setting unit 212 in response to the video editing operations of the distributor. The storage unit 22 stores photos taken by the imaging unit 24, videos, voice information acquired by the voice input unit 25, videos generated by the video generation unit 213, etc. Note that the plurality of object candidates are released to the storage unit 22, for example, when the distribution application is installed.

[0034] The operation display unit 23 includes an operation unit for performing various operations when the distributor creates a video, and a display unit for displaying a video generation screen U1 and the like described later. The operation unit and the display unit may be integrally formed as a touch panel, for example, or may be configured separately. The operation display unit 23 generates an operation signal representing the operation content input from the distributor to the operation unit, and supplies the operation signal to the processing unit 21. The operation display unit 23 also performs screen display on the display unit based on the display signal supplied from the processing unit 21.

[0035] The imaging unit 24 is an imaging device that acquires surrounding image information, such as photos and videos. The voice input unit 25 is a voice input device that acquires surrounding voice information. Note that the imaging unit 24 and the voice input unit 25 may be integrally configured.

[0036] The communication unit 26 establishes a connection between the distribution terminal 20 and the server 10 via the network NW, and performs transmission and reception of various data with the server 10.

[0037] Next, the information on object candidates and background candidates stored in the storage unit 22 of the distribution terminal 20 will be described. In the present embodiment, object candidates include still images, dynamic images, videos, music, and the like. Further, the object candidate may include an advertisement column for displaying an advertisement. In the advertisement column, an advertisement image or video, the address of a website for displaying the advertisement, and a two-dimensional code or barcode that can read the address of the website can be displayed. Further, the distributor may prepare a plurality of advertisement candidates in the advertisement column and select and stream an arbitrary advertisement candidate. Further, the object candidate may include a description column that can be edited by the distributor and the viewer. In the description column, text and / or an object candidate can be displayed. For example, in the description column, in response to a predetermined operation by the distributor and / or the viewer, a display operation of an object candidate corresponding to the predetermined operation can be performed. Here, the predetermined operation includes a coin insertion operation by the viewer, a display operation of an object by the distributor and / or the viewer, and the like.

[0038] FIG. 3 is a diagram showing a table of information on object candidates and background candidates stored in the distribution terminal 20 according to the present embodiment. The object candidate table T1 shown in FIG. 3 is a data table for storing information on object candidates. The background candidate table T2 and the background candidate configuration table T3 are data tables for storing information on background candidates.

[0039] The object candidate table T1 has columns of "Name", "ID", and "Access Information". In the "Name" column, names of object candidates, for example, "Wallpaper_1", "Clock_1", etc. are stored. In the "ID" column, identification information that can uniquely identify the object candidate, for example, "Wp1", "Crt1", etc. are stored. In the "Access Information" column, access information to the storage location (storage area in the storage unit 12) of the image data or audio data of each object candidate associated with the identification information of each object candidate is stored. In FIG. 3, the data example in the "Access Information" column is omitted as "xxxx".

[0040] The background candidate table T2 has columns "ID" and "Name". In the "ID" column, identification information that can uniquely identify a background candidate, such as "St1", "St2", etc., is stored. In the "Name" column, the name of the background candidate, such as "Studio A", "Studio B", etc., is stored.

[0041] The background candidate composition table T3 is stored for each background candidate, associated with the identification information of the background candidate, and has columns "Object candidate name", "ID", and "Placement position". The background candidate composition table T3 shown in FIG. 3 is, for example, the composition table of the background candidate "Studio A". In the "Object candidate name" column, the names of all object candidates that make up the corresponding background candidate (Studio A), such as "Wallpaper_1", "Clock_1", "Table_1", "Book_1", "BGM_1", are stored. In the "ID" column, the identification information of all object candidates that make up the corresponding background candidate (Studio A), such as "Wp1", "Wt1", "Tb1", "Bk1", "Bgm1", is stored. In the "Placement position" column, information representing the placement position of the object candidate stored in the "ID" column on the video screen, for example, the coordinate data (x1, y1) of the center of the object candidate's image on the video screen, is stored. Note that the information representing the placement position of the object candidate is not limited to the coordinate data of the center of the object candidate's image, and may be, for example, information data indicating the area of the object candidate's image on the video screen. As an example of information data indicating the area on the video screen, in the case of a rectangular area, for example, it includes the coordinate data of at least two of the four vertices of the rectangular area. On the other hand, when the object candidate is audio (for example, BGM_1), the "Placement position" column stores a blank or the "-" shown in the figure.

[0042] Note that the configurations of the object candidate table T1, the background candidate table T2, and the background candidate composition table T3 are not limited to the configurations shown in FIG. 3, and the columns of each of the above tables may be added or changed as appropriate according to the need.

[0043] <Example of the hardware configuration of server 10 and distribution terminal 20> Next, the hardware configurations of the server 10 and the distribution terminal 20 will be described. FIG. 4 is a block diagram showing an example of the hardware configuration of the server 10 according to the present embodiment. As shown in FIG. 4, the hardware configuration of the server 10 includes a CPU (Central Processing Unit) 10a, a ROM (Read Only Memory) 10b, a RAM (Random Access Memory) 10c, a non-volatile storage 10d, and a communication interface 10e. The CPU 10a, the ROM 10b, the RAM 10c, the non-volatile storage 10d, and the communication interface 10e are connected by a bus 10f so that information data can be transmitted and received to and from each other.

[0044] The CPU 10a reads the program code of the software that realizes various functions of the server 10 from the ROM 10b, loads it into the RAM 10c, and executes it. Note that instead of the CPU 10a, a GPU (Graphics Processing Unit) or the like may be used, or the CPU 10a and the GPU may be used in combination.

[0045] The ROM 10b is composed of a storage medium such as a non-volatile memory, and stores programs, data, etc. that are executed and referenced by the CPU 10a.

[0046] The RAM 10c is composed of a storage medium such as a volatile memory, and temporarily stores information (data) necessary for each process performed by the CPU 10a.

[0047] The non-volatile storage 10d is composed of a computer-readable non-transitory recording medium storing programs executed by the CPU 10a, and is composed of a storage device such as an HDD (Hard Disk Drive). The non-volatile storage 10d stores programs for the CPU 10a to execute each function, an OS (Operating System), programs such as a controller, and data. Further, the computer-readable non-transitory recording medium storing the programs executed by the CPU 10a is not limited to an HDD, and may be a recording medium such as an SSD (Solid State Drive), a CD (Compact Disc)-ROM, a DVD (Digital Versatile Disc)-ROM, etc.

[0048] For the communication interface 10e, for example, a NIC (Network Interface Card) etc. is used, and it is possible to transmit and receive various data between devices via a LAN, a WAN, a dedicated line, etc. connected to the terminals of the NIC.

[0049] Note that the server 10 is not limited to the configuration shown in FIG. 4, and may be configured, for example, on the cloud.

[0050] Next, the hardware configuration of the distribution terminal 20 will be described. FIG. 5 is a block diagram showing an example of the hardware configuration of the distribution terminal 20 according to the present embodiment. As can be seen by comparing FIG. 5 with FIG. 4, the distribution terminal 20 includes a CPU 10a, a ROM 10b, a RAM 10c, a non-volatile storage 10d, and a communication interface 10e, similar to the server 10. The distribution terminal 20 further includes an operation display device 20g, an imaging device 20h, and an audio input device 20i. The CPU 10a, the ROM 10b, the RAM 10c, the non-volatile storage 10d, the communication interface 10e, the operation display device 20g, the imaging device 20h, and the audio input device 20i are connected by a bus 10f so that information data can be transmitted and received to and from each other. Here, duplicate descriptions of the CPU 10a, the ROM 10b, the RAM 10c, the non-volatile storage 10d, and the communication interface 10e are omitted.

[0051] The operation display device 20g is composed of a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro-luminescence) display, and an operation device such as a touch sensor. The display device and the operation device are integrally formed as, for example, a touch panel. Note that the operation device may be composed of a mouse, a tablet, etc., and may be configured separately from the display device.

[0052] The imaging device 20h is composed of a camera or the like. The voice input device 20i is composed of a microphone or the like. Note that the imaging device 20h and the voice input device 20i may be integrally formed.

[0053] <Configuration example of video generation screen> Here, before explaining the video generation screen displayed on the distribution terminal 20 according to the present embodiment, first, problems when a distributor creates a video in a conventional video distribution system will be explained.

[0054] In a conventional video distribution system, a distribution application reads objects such as background images, virtual spaces, decorative items, and characters representing performers from the Web and provides them to a distributor as components of a video. For this reason, when the distribution application reads objects such as audio and video from the Web, there is a problem of delay. Also, when the background needs to be switched when switching scenes accompanying the video flow, there is a problem that the distributor has to set a plurality of background candidates in advance. Further, in the conventional video distribution system, the background is treated as an independent object, that is, as a single image. For this reason, there is a problem that decorative items and the like included in the background cannot be changed. Also, in the conventional video distribution system, when the distributor replaces an object arranged on the background with another object, the distributor deletes the object and then adds another object, or adds another object and then deletes the object. When these operations are performed, the object to be changed temporarily disappears, or the object to be changed and another object exist in the video at the same time, resulting in a problem that the tempo of the distribution deteriorates.

[0055] The present invention has been made to solve each of the above problems. Next, a configuration example of a video generation screen displayed on the distribution terminal 20 according to the present embodiment will be described. FIG. 6 is a diagram showing an example of a video generation screen U1 displayed on the distribution terminal 20 according to the present embodiment.

[0056] As shown in FIG. 6, the video generation screen U1 has a background candidate selection unit U11, a video area U12, and a video editing area U13.

[0057] As shown in FIG. 6, in the background candidate selection unit U11, images showing a plurality of background candidate images, for example, images showing background candidates such as "Studio A" and "Studio B" are displayed.

[0058] The video area U12 is an area that shows the video being created by the distributor. When the distributor selects (clicks) any background candidate in the background candidate selection section U11, the selected background candidate is reflected in the video area U12. For example, when "Studio A" is selected, as shown in FIG. 6, the background candidate of "Studio A" is set as the background of the video and reflected in the video area U12.

[0059] The background candidates are composed of a combination of multiple objects. For example, "Studio A" is composed of a combination of the book object OB1, the desk object OB2, and the clock object OB3. "Studio B" is a background candidate different from "Studio A" and is similarly composed of a combination of multiple objects.

[0060] Also, in the state shown in FIG. 6, when the distributor sets the background switch according to the switching of the video scene, for example, when "Studio B" is selected (clicked), the background candidate of "Studio B" is set as the background and reflected in the video area U12. That is, the current background (background candidate) "Studio A" is switched to the background candidate "Studio B".

[0061] In addition, the present invention manages the background candidates not as a single image but as a set of multiple objects. Therefore, by selecting the objects included in the background candidates and performing operations on the "add object candidate" button U131 and the "delete object candidate" button U132, etc. in the video editing area U13 described later, the selected objects can be changed.

[0062] Specifically, as shown in FIG. 6, the video editing area U13 has an "add object candidate" button U131, a "delete object candidate" button U132, a "background save" button U133, a "performance start / stop" button U134, and a "performance end" button U135.

[0063] When the "Add Object Candidate" button U131 is pressed, a sub-screen that displays all object candidates stored in the storage unit 22 is displayed. The sub-screen for displaying each object candidate displays, for example, an image showing the image of each object candidate. Also, when the distributor selects an arbitrary object included in the background shown in the video area U12, presses the "Add Object Candidate" button U131, and selects any object candidate on the displayed sub-screen, the selected object is replaced with the object candidate selected on the sub-screen. As a specific example, for example, when the distributor selects the object OB1 of a book, presses the "Add Object Candidate" button U131, and selects the object candidate of a bouquet on the displayed sub-screen, the object OB1 of the book is replaced with the object candidate of the bouquet.

[0064] Also, when the distributor selects an arbitrary object included in the background shown in the video area U12 and presses the "Delete Object Candidate" button U132, the selected object is deleted. Note that the sub-screen for displaying each object candidate is not limited to displaying an image showing the image of each object candidate. For example, the name of the object candidate may be displayed, or both the name and the image may be displayed.

[0065] Also, the distributor can select any object candidate on the sub-screen for displaying each object candidate and place the selected object candidate on the background shown in the video area U12. Also, the distributor can use an operation display unit 23 such as a mouse or a touch panel to move and change the placement location of each object included in the background and other objects placed on the background in the video area U12. Also, the distributor can select an arbitrary object shown in the video area U12 and press the "Delete Object Candidate" button U132 to delete the selected object.

[0066] When the "Save Background" button U133 is pressed, the background created by the distributor is stored in the storage unit 22 as a background candidate.

[0067] When the "Performance Start / Stop" button U134 is pressed, a command to start the performance of the video and the generated video are transmitted to the server 10. Also, during the performance of the video, when the "Performance Start / Stop" button U134 is pressed, a command to stop the performance of the video is transmitted to the server 10. When the server 10 receives a command to start or stop the performance of the video, it starts or stops the video performance according to the received command.

[0068] When the "Performance End" button U135 is pressed, an instruction to end the performance of the video is transmitted to the server 10. The server 10 ends the video performance (distribution) according to the received command.

[0069] As described above, in the video editing area U13, the distributor can select and use any one of a plurality of background candidates prepared by the distribution application. When switching scenes along with the video flow, the background can be easily switched just by selecting any one of the prepared plurality of background candidates. Also, before or during distribution, just by selecting any object included in the background and any one of the prepared plurality of object candidates, the object can be replaced with the selected object candidate. Furthermore, the distributor can select any one of the prepared plurality of background candidates, and perform addition, replacement, deletion, etc. of object candidates on the background candidate, and save the changed background candidate as a customized background candidate.

[0070] <Procedure of Distribution Processing> Next, the procedure of distribution processing in the video distribution system 1 according to the present embodiment will be described. FIG. 7 is a flowchart showing the procedure of distribution processing in the video distribution system 1 according to the present embodiment.

[0071] First, when the distribution application is installed in the distribution terminal 20, a plurality of object candidates, which are candidates for the objects constituting the video, are registered (stored) in the storage unit 12 (step S1).

[0072] Next, the distribution terminal 20 uses at least a part of the registered plurality of object candidates to construct each of the plurality of background candidates that are background candidates, and registers (stores) them in the storage unit 12 (step S2).

[0073] Next, the distribution terminal 20 activates the distribution application in response to an activation operation of the distribution application by the distributor (step S3). Also, in this process, the distribution terminal 20 transmits the identification information of the distributor who has logged in to the distribution application to the server 10.

[0074] Next, the distribution terminal 20 acquires various operation information of the video editing performed by the distributor on the video generation screen U1 (step S4).

[0075] Next, the distribution terminal 20 executes video generation processing (step S5). The procedure of the video generation processing will be described in detail with reference to FIG. 8 described later.

[0076] Next, the viewing terminal 30 transmits the identification information of the viewer who has logged in to the distribution / viewing platform provided by the server 10 to the server 10 (step S6). Note that this process may be performed after the process of step 7 or after the process of step 8, depending on the timing of the viewer's login.

[0077] Next, the distribution terminal 20 transmits the operation information of the start of the production and the generated video that the distributor has performed on the video generation screen U1 to the server 10 (step S7).

[0078] Next, the server 10 starts video distribution (step S8). Also, in this process, the server 10 notifies each of the distribution terminal 20 and the viewing terminal 30 of the start of the video distribution.

[0079] Next, the viewing terminal 30 starts viewing the video (step S9). Note that the execution timing of this process may change depending on the execution timing of step S6.

[0080] Next, when the distributor performs a video editing operation on the video generation screen U1 during the production (distribution) of the video, the distribution terminal 20 acquires various operation information by the distributor (step S10).

[0081] Next, the distribution terminal 20 executes video generation processing (step S11). Since the video generation processing here is the same as the video generation processing in step S5, it will be described in detail in FIG. 8 described later. Also, the distribution terminal 20 transmits the generated video to the server 10.

[0082] Next, the server 10 updates the video being distributed, that is, distributes the newly received video from the distribution terminal 20 (step S12).

[0083] Next, when the viewer uses the viewing terminal 30 to perform a predetermined operation such as posting a comment or making a donation operation, the viewing terminal 30 transmits the information of the predetermined operation to the server 10 (step S13).

[0084] Next, the server 10 updates the video being distributed by using the information of the predetermined operation received from the viewing terminal 30 (step S14).

[0085] Next, when the distributor performs an operation to end the production on the video generation screen U1, the distribution terminal 20 transmits the operation information to end the production by the distributor to the server 10 (step S15).

[0086] Next, the server 10 ends the video distribution according to the received operation information to end the distribution (step S16). Also, the server 10 notifies each of the distribution terminal 20 and the viewing terminal 30 of the end of the video distribution. After the processing in step S16, the distribution process ends.

[0087] <Procedure of Video Generation Processing> Next, the procedure of the video generation process in the distribution terminal 20 according to the present embodiment will be described. FIG. 8 is a flowchart showing the procedure of the video generation process in the distribution terminal 20 according to the present embodiment. The processes described below are called and started in steps S5 and S11 shown in FIG. 7.

[0088] First, the setting unit 212 acquires various operation information of the video editing performed by the distributor on the video generation screen U1 (step S51).

[0089] Next, the setting unit 212 determines whether there is a background setting operation among the acquired various operation information of the video editing (step S52).

[0090] In the process of step S52, when the setting unit 212 determines that there is no background setting operation (in the case of NO determination in step S52), it performs the process of step S54 described later.

[0091] On the other hand, in the process of step S52, when the setting unit 212 determines that there is a background setting operation (in the case of YES determination in step S52), it sets the background candidate selected by the distributor as the background of the video (step S53).

[0092] In the case of NO determination in step S52 or after the process of step S53, the setting unit 212 determines whether there is background replacement operation information among the acquired various operation information of the video editing (step S54).

[0093] In the process of step S54, when the setting unit 212 determines that there is no background replacement operation information (in the case of NO determination in step S54), it performs the process of step S56 described later.

[0094] On the other hand, in the process of step S54, when the setting unit 212 determines that there is a background replacement operation (in the case of YES determination in step S54), it changes the current background to the background candidate selected by the distributor (step S55).

[0095] In the case of the NO determination in step S54, or after the process in step S55, the setting unit 212 determines whether there is object change operation information among the various operation information of video editing acquired (step S56).

[0096] In the process of step S56, when the setting unit 212 determines that there is no object change operation information (in the case of the NO determination in step S56), it performs the process of step S58 described later.

[0097] On the other hand, in the process of step S56, when the setting unit 212 determines that there is an object change operation (in the case of the YES determination in step S56), it changes the object based on the object change operation information (step S57). In this process, the setting unit 212 changes the object included in the background to the selected object candidate according to the object change operation information, adds the selected object candidate on the background, changes the object arranged on the background to the selected object candidate, etc.

[0098] In the case of the NO determination in step S56, or after the process in step S57, the video generation unit 213 generates an edited video on the video generation screen U1 (step S58). After the process in step S58, the video generation process ends.

[0099] <Effect> As described above, the distribution terminal 20 according to the present embodiment pre-registers a plurality of object candidates and a plurality of background candidates for constructing a video. As a result, the distributor can set the background simply by selecting any one of the registered plurality of background candidates. For this reason, the work of preparing each object candidate that the distributor uses to configure the background and the work of creating a background from scratch are reduced. Also, when switching scenes along with the video stream, the distributor can easily switch the background simply by selecting any one of the background candidates. Further, before or during distribution, by simply selecting any object included in the background and any one of the prepared plurality of object candidates, the object can be replaced with the selected object candidate. Therefore, according to the present invention, the editing operation of the distributed video can be simplified, and the convenience of the distribution application can be improved.

[0100] Note that the present invention is not limited to the above-described embodiment, and it goes without saying that various other application examples and modification examples can be taken as long as they do not depart from the gist of the present invention described in the claims. For example, the above-described embodiment describes the configuration of the video distribution system in detail and specifically in order to explain the present invention in an easy-to-understand manner, and is not necessarily limited to having all the configurations described. Also, it is possible to replace a part of the configuration of the embodiment described here with the configuration of another embodiment, and furthermore, it is possible to add the configuration of another embodiment to the configuration of a certain embodiment. Also, it is possible to add, delete, or replace a part of the configuration of the embodiment with other configurations. Also, the control lines and information lines show those considered necessary for explanation, and not necessarily all the control lines and information lines are shown on the product. In fact, it may be considered that almost all the components are interconnected.

[0101] In the above-described embodiment, the process of managing the background in units of object sets has been described, but the present invention is not limited thereto. The present invention can manage any combination of a plurality of objects in units of object sets. For example, the present invention can manage a combination of a plurality of objects such as a character, the character's clothing, and the character's accessories in units of object sets. Thereby, any combination of objects can be switched in units of sets.

[0102] (Supplementary Note) The features related to the above-described embodiment are appended. (Supplementary Note 1) In an information processing apparatus for distributing a video in which an image of a performer is arranged on a background image or a background that is a virtual space, a storage process of storing a plurality of object candidates that are candidates for objects constituting the video and a plurality of background candidates that are candidates for the background; a configuration process of configuring each of the plurality of background candidates using at least a part of the plurality of object candidates; a setting process of setting a selected background candidate as the background in the video in response to an operation of selecting any one of the plurality of background candidates by the distributor of the video. Program. Thereby, the editing operation of the distributed video can be simplified, and the convenience of the distribution application can be improved. (Supplementary Note 2) When an operation of changing the background candidate set as the background to another background candidate is performed, the setting process changes the background to the other background candidate in response to the operation. The program according to Supplementary Note 1. Thereby, the background switching operation can be simplified. (Supplementary Note 3) When an operation of changing the object candidate constituting the background to another object candidate is performed, The setting process changes the object candidate to the other object candidate according to the operation. The program according to Supplementary Note 1. Thereby, the replacement operation of the object included in the background can be simplified. (Supplementary Note 4) When an operation of adding any one of the plurality of object candidates is performed on the background, the setting process arranges the added object candidate on the background according to the operation. The program according to Supplementary Note 1. Thereby, any registered object candidate can be added to the background. (Supplementary Note 5) The setting process can be executed before and during the distribution of the video. The program according to any one of Supplementary Notes 1 to 4. Thereby, before and during the distribution of the video, background switching, replacement of objects included in the background, and addition of any object candidate can be performed. (Supplementary Note 6) The storage process can store the background changed in the setting process as a background candidate. The program according to any one of Supplementary Notes 2 to 4. Thereby, the background candidate customized by the distributor can be registered. (Supplementary Note 7) The object candidate includes a still image, a dynamic image, a video, and music. The program according to Supplementary Note 1. Thereby, various object candidates for constituting a video can be provided. (Supplementary Note 8) The object candidate includes an advertisement column for displaying an advertisement, in the advertisement column, an image or video of the advertisement, an address of a website for displaying the advertisement, and a two-dimensional code or barcode that can read the address of the website can be displayed. The program according to Supplementary Note 1. As a result, in the distributed video, advertisements can be displayed or presented to viewers. (Appendix 9) The object candidates include a description field that can be edited by the distributor and the viewers of the video. In the description field, text and / or the object candidates can be displayed. The program described in Appendix 1. As a result, in the distributed video, a place for communication between the distributor and the viewers can be provided. (Appendix 10) In the description field, in response to a predetermined operation by the distributor and / or the viewer, a display operation of the object candidate corresponding to the predetermined operation can be performed. The program described in Appendix 9. As a result, in the distributed video, the distributor and / or the viewer can realize a predetermined communication action. (Appendix 11) The predetermined operations include an operation of dropping money by the viewer, and a display operation of accessory items by the distributor and / or the viewer. The program described in Appendix 10. As a result, in the distributed video, the viewer can drop money, and the distributor and / or the viewer can send (display) accessory items such as expressions and bouquets. (Appendix 12) An information processing apparatus for distributing a video in which an image of a performer is arranged on a background image or a background that is a virtual space, a storage unit that stores a plurality of object candidates that are candidates for objects constituting the video, and a plurality of background candidates that are candidates for the background; a configuration unit that configures each of the plurality of background candidates using at least a part of the plurality of object candidates; and a setting unit that sets the selected background candidate as the background in the video in response to an operation of selecting any one of the plurality of background candidates by the distributor of the video. Information processing apparatus. (Appendix 13) An information processing method in an information processing apparatus for distributing a video in which an image of a performer is arranged on a background image or a background that is a virtual space, a storage step of storing a plurality of object candidates that are candidates for objects constituting the video and a plurality of background candidates that are candidates for the background; a configuration step of configuring each of the plurality of background candidates using at least a part of the plurality of object candidates; a setting step of setting a selected background candidate as the background in the video in response to an operation of selecting any one of the plurality of background candidates by the distributor of the video, including the information processing method. (Appendix 14) An information processing system for distributing a video in which an image of a performer is arranged on a background image or a background that is a virtual space, a storage unit that stores a plurality of object candidates that are candidates for objects constituting the video and a plurality of background candidates that are candidates for the background; a configuration unit that configures each of the plurality of background candidates using at least a part of the plurality of object candidates; a setting unit that sets a selected background candidate as the background in the video in response to an operation of selecting any one of the plurality of background candidates by the distributor of the video, comprising the information processing system.

Explanation of Signs

[0103] 1: Video distribution system 10: Server 20: Distribution terminal 30: Viewing terminal 11, 21: Processing unit 12, 22: Storage unit 13, 26: Communication unit 23: Operation display unit 24: Imaging unit 25: Audio input unit 113, 214: Transmission unit 111, 215: Reception unit 211: Component 212: Setting Unit 213: Video Generation Unit

Claims

1. An information processing device for distributing a video in which an image of a performer is placed against a background image or a virtual space, comprising: a storage process for storing a plurality of object candidates that are candidates for objects constituting the moving image, and a plurality of background candidates that are candidates for the background; a construction process for constructing each of the plurality of background candidates using at least a portion of the plurality of object candidates; a setting process for setting a selected background candidate as the background in the video in response to an operation of a distributor of the video to select one of the plurality of background candidates; The object candidate includes a description field that can be edited by a distributor and a viewer of the video, In the description field, text and / or the object candidates can be displayed; In response to a predetermined operation by the distributor and / or the viewer, a display operation of the object candidate corresponding to the predetermined operation can be performed in the description field. program.

2. When an operation for changing the background candidate set as the background to another background candidate is performed, The setting process changes the background to the other background candidate in response to the operation. The program according to claim 1.

3. When an operation for changing the object candidate constituting the background to another object candidate is performed, The setting process changes the object candidate to the other object candidate in response to the operation. The program according to claim 1.

4. When an operation of adding any one of the plurality of object candidates onto the background is performed, The setting process includes arranging the added object candidate on the background in response to the operation. The program according to claim 1.

5. The setting process can be performed before and during the distribution of the video. The program according to any one of claims 1 to 4.

6. The storage process can store the background changed in the setting process as a background candidate. The program according to any one of claims 2 to 4.

7. The object candidates include still images, dynamic images, videos, and music. The program according to claim 1.

8. the object candidates include an advertisement section for displaying advertisements; In the advertisement column, an image or video of the advertisement, an address of a website displaying the advertisement, and a two-dimensional code or a barcode from which the address of the website can be read can be displayed. The program according to claim 1.

9. The predetermined operation includes a tipping operation by the viewer, and a display operation of a small item by the distributor and / or the viewer. The program according to claim 1.

10. An information processing device for distributing a video in which an image of a performer is arranged on a background image or a background that is a virtual space, a storage unit that stores a plurality of object candidates that are candidates for objects constituting the video, and a plurality of background candidates that are candidates for the background; a configuration unit that configures each of the plurality of background candidates using at least a portion of the plurality of object candidates; a setting unit that sets a selected background candidate as the background in the video in response to an operation of selecting one of the plurality of background candidates by a distributor of the video, The object candidate includes a description field that can be edited by a distributor and a viewer of the video, In the description field, text and / or the object candidates can be displayed; In response to a predetermined operation by the distributor and / or the viewer, a display operation of the object candidate corresponding to the predetermined operation can be performed in the description field. Information processing device.

11. An information processing method in an information processing device for distributing a video in which an image of a performer is arranged on a background image or a background that is a virtual space, comprising: a storage step of storing a plurality of object candidates that are candidates for objects constituting the moving image, and a plurality of background candidates that are candidates for the background; constructing each of the plurality of background candidates using at least a portion of the plurality of object candidates; and a setting step of setting the selected background candidate as the background in the video in response to an operation of selecting one of the plurality of background candidates by a distributor of the video, The object candidate includes a description field that can be edited by a distributor and a viewer of the video, In the description field, text and / or the object candidates can be displayed; In response to a predetermined operation by the distributor and / or the viewer, a display operation of the object candidate corresponding to the predetermined operation can be performed in the description field. Information processing methods.

12. An information processing system for distributing a video in which an image of a performer is placed against a background image or a background that is a virtual space, a storage unit that stores a plurality of object candidates that are candidates for objects constituting the video, and a plurality of background candidates that are candidates for the background; a configuration unit that configures each of the plurality of background candidates using at least a portion of the plurality of object candidates; a setting unit that sets a selected background candidate as the background in the video in response to an operation of selecting one of the plurality of background candidates by a distributor of the video, The object candidate includes a description field that can be edited by a distributor and a viewer of the video, In the description field, text and / or the object candidates can be displayed; In response to a predetermined operation by the distributor and / or the viewer, a display operation of the object candidate corresponding to the predetermined operation can be performed in the description field. Information processing system.

Images