Program, information processing device, information processing method, and information processing system

Abstract

This invention provides a program, an information processing device, an information processing method, and an information processing system that simplify the editing operations of streamed videos and improve the usability of streaming applications. [Solution] A program to be executed by an information processing device for distributing a video in which images of performers are placed in a background image or a virtual space background includes: a storage process for storing a plurality of object candidates, which are candidates for objects that constitute the video, and a plurality of background candidates, which are candidates for backgrounds; a configuration process for composing each of the plurality of background candidates using at least a portion of the plurality of object candidates; and a setting process for setting the selected background candidate as the background in the video in response to an operation by the video distributor to select one of the plurality of background candidates.

Description

Technical Field

[0001] The present invention relates to a program, an information processing apparatus, an information processing method, and an information processing system.

Background Art

[0002] A video distribution system provides a service for distributing a video edited by a distributor to viewers via the Internet. In a conventional video distribution system, a distribution application reads objects such as a background image, a virtual space, a decorative item, a character representing a performer, and music (BGM: BackGround Music) from the Web and provides them to the distributor as components of the video. The distributor arranges decorative items or the like on the background image or virtual space and sets it as the background for the performance of the video actors. The data of the background set using a plurality of objects such as a background image and a decorative item is managed as asset data for constructing a virtual space or the like (see Patent Document 1).

[0003] Patent Document 1 describes that object data includes asset data for constructing a virtual space that constitutes a video, object data for drawing the background of the virtual space that constitutes the video, data for drawing various objects displayed in the video, and data for drawing various other objects displayed in the video.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] As mentioned above, in conventional video distribution systems, the distribution application loads objects such as background images, virtual spaces, decorative items, and characters representing the presenter from the web and provides them to the distributor as components of the video. Distributors often set the background by overlaying decorative items on the background image or virtual space. Therefore, if they want to change the background when switching scenes in the video, the distributor needs to set up multiple background options in advance. In other words, in conventional video distribution systems, creating backgrounds for distributed videos is time-consuming, making video editing operations complicated and reducing the convenience of the distribution service.

[0006] This invention was made to solve the above problems, and aims to simplify the editing operations of distributed videos and improve the usability of distribution applications. [Means for solving the problem]

[0007] The present invention causes an information processing device to perform the following operations in order to distribute a video in which images of performers are placed in the background, which is a background image or a virtual space: a storage process that stores a plurality of object candidates, which are candidates for objects that constitute the video, and a plurality of background candidates, which are candidates for backgrounds; a configuration process that uses at least a portion of the plurality of object candidates to configure each of the plurality of background candidates; and a setting process that sets the selected background candidate as the background in the video in response to an operation by the video distributor to select one of the plurality of background candidates. The above program is one aspect of the present invention, and information processing devices, information processing methods, and information processing systems that reflect one aspect of the present invention are configured in the same manner as the server described above. [Effects of the Invention]

[0008] According to the present invention with the above configuration, it is possible to simplify the editing operations of distributed videos and improve the usability of the distribution application. Other issues, configurations, and effects not mentioned above will be clarified by the following description of the embodiments. [Brief explanation of the drawing]

[0009] [Figure 1] This is a block diagram showing an example configuration of a video distribution system according to one embodiment of the present invention. [Figure 2] This is a block diagram showing an example of the functional configuration of a video distribution system according to one embodiment of the present invention. [Figure 3] This figure shows a table of object candidate information and background candidate information stored in a distribution terminal according to one embodiment of the present invention. [Figure 4] This is a block diagram showing an example of a server hardware configuration according to one embodiment of the present invention. [Figure 5] This is a block diagram showing an example of the hardware configuration of a distribution terminal according to one embodiment of the present invention. [Figure 6] This figure shows an example of a video generation screen displayed in a distribution terminal according to one embodiment of the present invention. [Figure 7] This is a flowchart showing the distribution process procedure in a video distribution system according to one embodiment of the present invention. [Figure 8] This flowchart shows the procedure for video generation processing on a server according to one embodiment of the present invention. [Modes for carrying out the invention]

[0010] Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. In this specification and drawings, components having substantially the same function or configuration are denoted by the same reference numerals, and redundant descriptions are omitted.

[0011] <Example of a video streaming system configuration> Next, an example of the configuration of the video distribution system according to this embodiment will be described. Figure 1 is a block diagram showing an example of the configuration of the video distribution system 1 according to this embodiment. The video distribution system 1 is an example of an information processing system and, as shown in Figure 1, comprises a server 10, a distribution terminal 20, and a plurality of viewing terminals 30. The server 10, the distribution terminal 20, and the plurality of viewing terminals 30 are connected to each other via a network NW. The network NW consists of a public line such as the Internet and may include a LAN (Local Area Network), WAN (Wide Area Network), etc.

[0012] Server 10 is an information processing device that provides video distribution services. Here, video distribution includes the distribution of pre-generated videos and the distribution of live videos. In this embodiment, the distributed video includes at least images of performers and a background on which the performers' images are placed. Here, the background is a background image or a virtual space. The performers' images are images of characters representing the performers or captured images of the performers. The performers' images may be still images, dynamic images, or live captured images. The background on which the performers' images are placed is composed of multiple objects. Here, objects include background images, virtual spaces, decorative items, images of characters, etc., and sound such as BGM. If an object is an image, it may be a still image, a dynamic image, or a video. If an object is sound, it may be any sound such as BGM, radio, or live voice of the performers.

[0013] Server 10 provides a video distribution / viewing platform to broadcasters and viewers who have logged into the video distribution system 1. Server 10 receives distributed videos from the distribution terminal 20 via the network NW and provides the received videos to viewers through the distribution / viewing service platform. The detailed functions of Server 10 are described in detail in Figure 2 below.

[0014] The distribution terminal 20 is an information processing device such as a PC (Personal Computer), tablet, or smartphone held by a video distributor. A distribution application is installed on the distribution terminal 20. The distribution application has a video generation screen (see FIG. 6 described later). The distributor can configure and generate a video on the video generation screen. The distribution terminal 20 can transmit the generated video or live video to the server 10 via the network NW and start production on the distribution / viewing platform. Details of the functions of the distribution terminal 20 will be described in detail in FIG. 2 described later.

[0015] The viewing terminal 30 is an information processing device such as a PC (Personal Computer), tablet, or smartphone held by a video viewer. Using the viewing terminal 30, the viewer can view the video distributed by the distributor on the distribution / viewing platform provided by the server 10 via the network NW. In addition, the viewer can use the viewing terminal 30 to send comments, make donations, etc. on the display screen of the video being viewed.

[0016] <Functional Configuration Example of Video Distribution System> Next, a functional configuration example of the video distribution system 1 according to the present embodiment will be described. FIG. 2 is a block diagram showing a functional configuration example of the video distribution system 1 according to the present embodiment. The network NW is omitted in FIG. 2. In addition, only the functional configuration parts related to various functions of the present invention are shown in FIG. 2, and the illustration and description of other functional configuration parts are omitted. Hereinafter, functional configuration examples of the server 10 and the distribution terminal 20 constituting the video distribution system 1 will be described. A detailed description of the viewing terminal 30 is omitted.

[0017] [Functional Configuration Example of Server 10] As shown in FIG. 2, the server 10 includes a processing unit 11, a storage unit 12, and a communication unit 13. The processing unit 11 is connected to each of the storage unit 12 and the communication unit 13.

[0018] The processing unit 11 performs various processes for providing a video distribution / viewing service, and includes a receiving unit 111, a service providing unit 112, and a transmitting unit 113.

[0019] The receiving unit 111 receives, via the communication unit 13, commands such as start, stop, and end of the production of the distribution video, and videos created and generated by the distributor, from the distribution terminal 20. Further, the receiving unit 111 receives a video viewing request, and operation information such as comment posting and donation by the viewer, from the viewing terminal 30.

[0020] The service providing unit 112 provides a video distribution / viewing platform. The service providing unit 112 starts the distribution of the video received from the distribution terminal 20 in the distribution / viewing platform in response to a video distribution request from the distribution terminal 20. Further, the service providing unit 112 starts video viewing for the viewer in the distribution / viewing platform in response to a video viewing request from the viewing terminal 30.

[0021] The transmitting unit 113 transmits notifications such as start, stop, and end of video distribution to the distribution terminal 20. Further, the transmitting unit 113 transmits notifications such as start, stop, and end of video viewing to the viewing terminal 30.

[0022] The storage unit 12 stores input / output data of various processes in the server 10. Further, the storage unit 12 may store a plurality of object candidates that are candidates for objects constituting the video, and a plurality of background candidates that are candidates for the background of the video.

[0023] The communication unit 13 establishes connections between the server 10 and each of the distribution terminal 20 and the viewing terminal 30 via the network NW, and performs transmission and reception of various data with each of the distribution terminal 20 and the viewing terminal 30.

[0024] [Functional configuration example of the distribution terminal 20] The distribution terminal 20 has functions for generating distribution videos and managing the presentation of distribution videos, and as shown in Figure 2, it comprises a processing unit 21, a storage unit 22, an operation display unit 23, an imaging unit 24, an audio input unit 25, and a communication unit 26. The processing unit 21 is connected to the storage unit 22, the operation display unit 23, the imaging unit 24, the audio input unit 25, and the communication unit 26, respectively.

[0025] The processing unit 21 performs the functions of the distribution application installed on the distribution terminal 20 and includes a configuration unit 211, a setting unit 212, a video generation unit 213, a transmission unit 214, and a receiving unit 215.

[0026] The component 211 uses at least some of the multiple object candidates for composing the video, which are pre-registered (stored) in the storage unit 22, to configure each of the multiple background candidates (see Studio A and Studio B in Figure 6 described later), which are candidates for the background of the video. For example, the component 211 periodically acquires background usage history data from the server 10 in the video distribution system 1, and from the background usage history data, configures a predetermined number of backgrounds with the most frequent usage as background candidates. This allows the distribution application to always provide the most popular background candidates.

[0027] Information on each of the multiple background candidates configured by the configuration unit 211 is output to and stored in the storage unit 22. The background candidate information includes a background candidate table and a background candidate configuration table, the configuration of these two tables will be described in detail in Figure 3 below. Note that background candidates are not limited to being configured by the configuration unit 211; for example, they may be released to the storage unit 22 when the distribution application is installed.

[0028] The setting unit 212 sets the selected background candidate as the background in the video in response to the broadcaster's operation to select one of several background candidates. Specifically, the setting unit 114 extracts the configuration information of the background candidate (see background candidate configuration table T3 shown in Figure 3 below) based on the identification information of the background candidate selected by the broadcaster on the video generation screen U1 (see Figure 6 below), and sets the background of the video according to the extracted configuration information of the background candidate.

[0029] Furthermore, if the broadcaster changes the currently set background candidate to another background candidate, the setting unit 212 changes the background to the other background candidate in response to that operation. Also, if the broadcaster changes the object candidate that makes up the current background to another object candidate, the setting unit 212 changes the object candidate to the other object candidate in response to that operation. Also, if the broadcaster adds one of several object candidates to the current background, the setting unit 212 places the added object candidate in the background in response to that operation. In addition, the background changed by the setting unit 212 may be stored in the storage unit 22 as a background candidate for the broadcaster's customization. Note that the above-mentioned processes in the setting unit 212 can be executed at any time before and during video distribution.

[0030] The video generation unit 213 generates a video to be distributed based on the background set by the setting unit 114, the images of performers placed on the background, and other candidate object information.

[0031] When the distribution application is launched, the transmission unit 214 transmits the user ID registered by the distributor in the video distribution system 1, i.e., the distributor's identification information, to the server 10 via the communication unit 26. The transmission unit 214 also transmits the video generated by the video generation unit 213 to the server 10 via the communication unit 26. Furthermore, the transmission unit 214 transmits instructions to the server 10 to start, stop, and end the video playback via the communication unit 26.

[0032] The receiving unit 215 receives notifications from the server 10 regarding the start, stop, and end of video playback. The receiving unit 215 also receives information from the server 10 regarding comments posted by viewers and information regarding donations.

[0033] The memory unit 22 stores multiple object candidates and multiple background candidates. The memory unit 22 may also store backgrounds that have been changed by the setting unit 212 in response to the streamer's video editing operations as background candidates. It stores photographs and videos taken by the imaging unit 24, audio information acquired by the audio input unit 25, and videos generated by the video generation unit 213. Multiple object candidates are released to the memory unit 22, for example, when the distribution application is installed.

[0034] The operation display unit 23 includes an operation unit for the broadcaster to perform various operations when creating a video, and a display unit for displaying the video generation screen U1, etc., as described later. The operation unit and the display unit may be formed integrally as a touch panel, for example, or they may be configured separately. The operation display unit 23 generates operation signals representing the operations input from the broadcaster to the operation unit and supplies these operation signals to the processing unit 21. The operation display unit 23 also displays information on the display unit based on the display signals supplied from the processing unit 21.

[0035] The imaging unit 24 is an imaging device that acquires surrounding image information, such as photographs and videos. The audio input unit 25 is an audio input device that acquires surrounding audio information. The imaging unit 24 and the audio input unit 25 may be configured as a single unit.

[0036] The communication unit 26 establishes a connection between the distribution terminal 20 and the server 10 via the network NW and performs the sending and receiving of various types of data with the server 10.

[0037] Next, information on object candidates and background candidates stored in the storage unit 22 of the distribution terminal 20 will be described. In this embodiment, object candidates include still images, dynamic images, videos, and music. Object candidates may also include an advertising section for displaying advertisements. The advertising section can display an advertisement image or video, the address of the website displaying the advertisement, and a two-dimensional code or barcode that can read the website address. The distributor may also prepare multiple advertisement candidates in the advertising section and select and distribute any advertisement candidate. Object candidates may also include a description field that can be edited by the distributor and viewers. Text and / or object candidates can be displayed in the description field. For example, in the description field, the distributor and / or viewers can perform an operation to display an object candidate corresponding to a predetermined operation. Here, predetermined operations include tipping operations by viewers and object display operations by the distributor and / or viewers.

[0038] Figure 3 shows tables of object candidate information and background candidate information stored in the distribution terminal 20 according to this embodiment. The object candidate table T1 shown in Figure 3 is a data table that stores object candidate information. The background candidate table T2 and background candidate configuration table T3 are data tables that store background candidate information.

[0039] The object candidate table T1 has the following fields: "Name," "ID," and "Access Information." The "Name" field stores the name of the object candidate, for example, "Wallpaper_1," "Clock_1," etc. The "ID" field stores the unique identifier that identifies the object candidate, for example, "Wp1," "Crt1," etc. The "Access Information" field stores access information to the storage location (storage area in the memory unit 12) of the image data or audio data of each object candidate, which is associated with the identifier of each object candidate. Note that in Figure 3, the data example for the "Access Information" field is abbreviated as "xxxx."

[0040] The background candidate table T2 has two columns: "ID" and "Name". The "ID" column stores unique identifiers that can identify a background candidate, such as "St1", "St2", etc. The "Name" column stores the name of the background candidate, such as "Studio A", "Studio B", etc.

[0041] The background candidate configuration table T3 stores information for each background candidate and is linked to the identification information of the background candidate. It has the fields "Object Candidate Name," "ID," and "Placement Position." The background candidate configuration table T3 shown in Figure 3 is, for example, the configuration table for the background candidate "Studio A." The "Object Candidate Name" field stores the names of all object candidates that make up the corresponding background candidate (Studio A), for example, "Wallpaper_1," "Clock_1," "Desk_1," "Book_1," and "BGM_1." The "ID" field stores the identification information of all object candidates that make up the corresponding background candidate (Studio A), for example, "Wp1," "Wt1," "Tb1," "Bk1," and "Bgm1." The "Placement Position" field stores information that represents the placement position of the object candidate stored in the "ID" field on the video screen, for example, the coordinate data (x1, y1) of the center of the object candidate's image on the video screen. Furthermore, the information representing the placement position of an object candidate is not limited to the coordinate data of the center of the object candidate's image; for example, it may also be information data indicating the area on the video screen where the object candidate's image is located. As an example of information data indicating an area on the video screen, for example, in the case of a rectangular area, it includes the coordinate data of at least two of the four vertices of the rectangular area. On the other hand, if the object candidate is audio (e.g., BGM_1), the "placement position" field will contain a blank space or the "-" shown in the figure.

[0042] Note that the configurations of the object candidate table T1, background candidate table T2, and background candidate configuration table T3 are not limited to those shown in Figure 3, and items in each of the above tables may be added or changed as needed.

[0043] <Example hardware configuration of server 10 and distribution terminal 20> Next, the hardware configuration of the server 10 and the distribution terminal 20 will be described. Figure 4 is a block diagram showing an example of the hardware configuration of the server 10 according to this embodiment. As shown in Figure 4, the hardware configuration of the server 10 includes a CPU (Central Processing Unit) 10a, a ROM (Read Only Memory) 10b, a RAM (Random Access Memory) 10c, a non-volatile storage 10d, and a communication interface 10e. The CPU 10a, ROM 10b, RAM 10c, non-volatile storage 10d, and communication interface 10e are connected by a bus 10f so that they can send and receive information data from each other.

[0044] The CPU 10a reads the program code for the software that implements the various functions of the server 10 from the ROM 10b, loads it into the RAM 10c, and executes it. Alternatively, a GPU (Graphics Processing Unit) or similar may be used instead of the CPU 10a, or the CPU 10a and GPU may be used in combination.

[0045] ROM10b is composed of a storage medium such as non-volatile memory and stores programs and data that the CPU10a executes and references.

[0046] RAM10c is composed of a storage medium such as volatile memory, and temporarily stores information (data) necessary for each process performed by CPU10a.

[0047] The non-volatile storage 10d consists of a computer-readable, non-transient recording medium that stores programs executed by the CPU 10a, and is composed of a storage device such as an HDD (Hard Disk Drive). The non-volatile storage 10d stores programs for the CPU 10a to execute various functions, OS (Operating System), controller programs, and data. Furthermore, the computer-readable, non-transient recording medium that stores programs executed by the CPU 10a is not limited to an HDD, but may be a recording medium such as an SSD (Solid State Drive), CD (Compact Disc)-ROM, or DVD (Digital Versatile Disc)-ROM.

[0048] The communication interface 10e can use, for example, a NIC (Network Interface Card), and various types of data can be sent and received between devices via LAN, WAN, dedicated lines, etc., connected to the terminals of the NIC.

[0049] Note that server 10 is not limited to the configuration shown in Figure 4, and may, for example, be configured on the cloud.

[0050] Next, the hardware configuration of the distribution terminal 20 will be described. Figure 5 is a block diagram showing an example of the hardware configuration of the distribution terminal 20 according to this embodiment. As can be seen by comparing Figure 5 and Figure 4, the distribution terminal 20, like the server 10, is equipped with a CPU 10a, ROM 10b, RAM 10c, non-volatile storage 10d, and a communication interface 10e. The distribution terminal 20 is further equipped with an operation display device 20g, an imaging device 20h, and an audio input device 20i. The CPU 10a, ROM 10b, RAM 10c, non-volatile storage 10d, communication interface 10e, operation display device 20g, imaging device 20h, and audio input device 20i are connected by a bus 10f so that they can send and receive information data from each other. Here, redundant explanations of the CPU 10a, ROM 10b, RAM 10c, non-volatile storage 10d, and communication interface 10e will be omitted.

[0051] The operation display device 20g consists of a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro-luminescence) display, and an operation device consisting of a touch sensor or the like. The display device and the operation device are formed as an integrated unit, for example, as a touch panel. However, it is also possible to configure the operation device as a mouse or tablet, and to configure it separately from the display device.

[0052] The imaging device 20h consists of a camera, etc. The audio input device 20i consists of a microphone, etc. The imaging device 20h and the audio input device 20i may be configured as a single unit.

[0053] <Example of video generation screen configuration> Before describing the video generation screen displayed in the distribution terminal 20 according to this embodiment, we will first explain the problems that arise when a distributor creates a video in a conventional video distribution system.

[0054] In conventional video streaming systems, the streaming application loads objects such as background images, virtual spaces, decorative items, and characters representing the performer from the web and provides them to the streamer as components of the video. This results in a delay when the streaming application loads objects such as audio and video from the web. Furthermore, if the streamer wants to change the background when switching scenes in the video, they have to go through the trouble of setting up multiple background options in advance. Also, in conventional video streaming systems, the background is treated as an independent object, i.e., a single image. This makes it impossible to change decorative items included in the background. In addition, in conventional video streaming systems, if the streamer wants to replace an object placed on the background with another object, they have to either delete the object and then add the other object, or add the other object and then delete the original object. When these operations are performed, the object being changed may temporarily disappear, or the object being changed and another object may exist simultaneously in the video, resulting in a slowdown in the streaming tempo.

[0055] The present invention was made to solve the above-mentioned problems. Next, an example of the configuration of the video generation screen displayed in the distribution terminal 20 according to this embodiment will be described. Figure 6 is a diagram showing an example of the video generation screen U1 displayed in the distribution terminal 20 according to this embodiment.

[0056] As shown in Figure 6, the video generation screen U1 includes a background candidate selection unit U11, a video area U12, and a video editing area U13.

[0057] As shown in Figure 6, the background candidate selection unit U11 displays images representing multiple background candidates, such as "Studio A" and "Studio B".

[0058] The video area U12 is the area that displays the video being created by the broadcaster. When the broadcaster selects (clicks) one of the background candidates in the background candidate selection section U11, that background candidate is reflected in the video area U12. For example, if "Studio A" is selected, as shown in Figure 6, the background candidate "Studio A" is set as the background of the video and reflected in the video area U12.

[0059] Background options are composed of combinations of multiple objects. For example, "Studio A" is composed of a combination of a book object OB1, a desk object OB2, and a clock object OB3. "Studio B" is a different background option from "Studio A," and is similarly composed of a combination of multiple objects.

[0060] Furthermore, in the state shown in Figure 6, when the broadcaster sets the background to change in accordance with the scene change in the video, if they select (click) "Studio B," for example, the background candidate for "Studio B" will be set as the background and reflected in the video area U12. In other words, the current background (background candidate) "Studio A" will be switched to background candidate "Studio B."

[0061] Furthermore, this invention manages background candidates not as a single image, but as a set of multiple objects. Therefore, by selecting an object included in the background candidates, the selected object can be changed by operating the "Add Object Candidate" button U131 or the "Delete Object Candidate" button U132 in the video editing area U13, as described later.

[0062] Specifically, as shown in Figure 6, the video editing area U13 has an "Add Object Candidate" button U131, a "Delete Object Candidate" button U132, a "Save Background" button U133, a "Start / Stop Effect" button U134, and an "End Effect" button U135.

[0063] When the "Add Object Candidate" button U131 is pressed, a sub-screen is displayed showing all object candidates stored in the memory unit 22. The sub-screen that displays each object candidate displays, for example, an image representing the image of each object candidate. Furthermore, if the broadcaster selects any object included in the background shown in the video area U12, presses the "Add Object Candidate" button U131, and selects one of the object candidates in the displayed sub-screen, the selected object is replaced with the object candidate selected in the sub-screen. For example, if the broadcaster selects the book object OB1, presses the "Add Object Candidate" button U131, and selects the bouquet object candidate in the displayed sub-screen, the book object OB1 is replaced with the bouquet object candidate.

[0064] Furthermore, if the broadcaster selects any object included in the background shown in the video area U12 and presses the "Delete Object Candidate" button U132, the selected object will be deleted. Note that the sub-screen displaying each object candidate is not limited to displaying an image representing the image of each object candidate; for example, it may also display the name of the object candidate, or both the name and the image may be displayed.

[0065] Furthermore, the broadcaster can select an object candidate in the sub-window displaying each object candidate and place the selected object candidate on the background shown in the video area U12. The broadcaster can also use a mouse or touch panel (operation display unit 23) to move and change the position of each object that includes the background, or other objects placed on the background, in the video area U12. In addition, the broadcaster can delete a selected object by selecting any object shown in the video area U12 and pressing the "Delete Object Candidate" button U132.

[0066] When the "Save Background" button U133 is pressed, the background created by the broadcaster is stored in the memory unit 22 as a background candidate.

[0067] When the "Start / Stop Performance" button U134 is pressed, a command to start the video performance and the generated video are sent to the server 10. Also, if the "Start / Stop Performance" button U134 is pressed while the video performance is in progress, a command to stop the video performance is sent to the server 10. When the server 10 receives a command to start or stop the video performance, it starts or stops the video performance according to the received command.

[0068] When the "End Performance" button U135 is pressed, a command to end the video performance is sent to the server 10. The server 10 then terminates the video performance (distribution) according to the received command.

[0069] As mentioned above, in the video editing area U13, broadcasters can select and use any one of several background options provided by the broadcasting application. When switching scenes according to the flow of the video, the background can be easily switched by simply selecting one of the available background options. In addition, before or during broadcasting, any object included in the background can be replaced with the selected object option by simply selecting one of the available object options. Furthermore, broadcasters can select any one of the available background options and add, replace, or delete object options to that background option, and save the modified background option as a customized background option.

[0070] <Delivery Processing Procedure> Next, the procedure for distribution processing in the video distribution system 1 according to this embodiment will be described. Figure 7 is a flowchart showing the procedure for distribution processing in the video distribution system 1 according to this embodiment.

[0071] First, when the distribution application is installed, the distribution terminal 20 registers (stores) several candidate objects, which are candidates for objects that make up a video, in the storage unit 12 (step S1).

[0072] Next, the distribution terminal 20 uses at least some of the registered object candidates to configure each of the multiple background candidates, which are background candidates, and registers (stores) them in the storage unit 12 (step S2).

[0073] Next, the distribution terminal 20 launches the distribution application in response to the distributionr's operation to launch the distribution application (step S3). In this process, the distribution terminal 20 also sends the identification information of the distributionr who logged into the distribution application to the server 10.

[0074] Next, the distribution terminal 20 acquires information on various video editing operations performed by the distributor on the video generation screen U1 (step S4).

[0075] Next, the distribution terminal 20 executes the video generation process (step S5). The procedure for the video generation process will be described in detail in Figure 8 below.

[0076] Next, the viewing terminal 30 sends the identification information of the viewer who has logged into the distribution / viewing platform provided by the server 10 to the server 10 (step S6). Note that this process may also be performed after the process in step 7 or after the process in step 8, depending on when the viewer logs in.

[0077] Next, the distribution terminal 20 sends the information about the operation to start the effects performed by the distributor on the video generation screen U1 and the generated video to the server 10 (step S7).

[0078] Next, server 10 starts video streaming (step S8). In this process, server 10 also notifies streaming terminal 20 and viewing terminal 30 that video streaming has started.

[0079] Next, the viewing terminal 30 starts watching the video (step S9). Note that the timing of this process may vary depending on the timing of step S6.

[0080] Next, if the broadcaster performs video editing operations on the video generation screen U1 during video production (broadcasting), the broadcasting terminal 20 acquires various operation information from the broadcaster (step S10).

[0081] Next, the distribution terminal 20 performs video generation processing (step S11). This video generation processing is the same as the video generation processing in step S5, and will be described in detail in Figure 8 below. The distribution terminal 20 then sends the generated video to the server 10.

[0082] Next, server 10 updates the video being streamed, that is, it streams the newly received video from streaming terminal 20 (step S12).

[0083] Next, when a viewer uses the viewing terminal 30 to perform a predetermined operation such as posting a comment or making a donation, the viewing terminal 30 sends information about the predetermined operation to the server 10 (step S13).

[0084] Next, the server 10 updates the video being streamed using the information of a predetermined operation received from the viewing terminal 30 (step S14).

[0085] Next, when the broadcaster performs an operation to end the animation on the video generation screen U1, the broadcasting terminal 20 sends information about the broadcaster's operation to end the animation to the server 10 (step S15).

[0086] Next, server 10 terminates video distribution in accordance with the received distribution termination operation information (step S16). Server 10 also notifies distribution terminal 20 and viewing terminal 30 of the termination of video distribution. After the processing in step S16, the distribution process is terminated.

[0087] <Video generation process steps> Next, the procedure for video generation processing in the distribution terminal 20 according to this embodiment will be described. Figure 8 is a flowchart showing the procedure for video generation processing in the distribution terminal 20 according to this embodiment. The process described below is called and started in steps S5 and S11 shown in Figure 7.

[0088] First, the settings unit 212 acquires information on various video editing operations performed by the broadcaster on the video generation screen U1 (step S51).

[0089] Next, the setting unit 212 determines whether or not there is a background setting operation among the various video editing operation information acquired (step S52).

[0090] In the process of step S52, if the setting unit 212 determines that there is no background setting operation (in the case of a NO determination in step S52), it performs the process of step S54 described below.

[0091] On the other hand, in the process of step S52, if the setting unit 212 determines that there is a background setting operation (if the determination in step S52 is YES), it sets the background candidate selected by the broadcaster as the background of the video (step S53).

[0092] If the NO determination is made in step S52, or after processing in step S53, the setting unit 212 determines whether or not there is background replacement operation information among the acquired video editing operation information (step S54).

[0093] In the process of step S54, if the setting unit 212 determines that there is no background replacement operation information (in the case of a NO determination in step S54), it performs the process of step S56 described below.

[0094] On the other hand, in the process of step S54, if the setting unit 212 determines that there is a background replacement operation (if the determination in step S54 is YES), it changes the current background to a background candidate selected by the broadcaster (step S55).

[0095] If the NO determination is made in step S54, or after processing in step S55, the setting unit 212 determines whether or not there is object modification operation information among the acquired video editing operation information (step S56).

[0096] In the process of step S56, if the setting unit 212 determines that there is no information on changing the object (in the case of a NO determination in step S56), it performs the process of step S58 described below.

[0097] On the other hand, in the process of step S56, if the setting unit 212 determines that there is an object modification operation (in the case of a YES determination in step S56), it modifies the object based on the object modification operation information (step S57). In this process, the setting unit 212 modifies the object included in the background, adds the selected object candidate to the background, or modifies the object placed on the background to the selected object candidate, etc., according to the object modification operation information.

[0098] If the NO determination is made in step S56, or after processing in step S57, the video generation unit 213 generates the edited video on the video generation screen U1 (step S58). After processing in step S58, the video generation process ends.

[0099] <Effects> As described above, the distribution terminal 20 according to this embodiment pre-registers multiple object candidates and multiple background candidates for composing a video. This allows the distributor to set the background simply by selecting one of the registered background candidates. Therefore, the work of preparing each object candidate that constitutes the background and the work of creating a background from scratch are reduced. In addition, when switching scenes according to the flow of the video, the distributor can easily switch the background by simply selecting one of the background candidates. Furthermore, before distribution or during distribution, any object included in the background, or one of the prepared object candidates, can be replaced with the selected object candidate simply by selecting that object. Therefore, according to the present invention, the editing operation of distributed videos can be simplified and the convenience of the distribution application can be improved.

[0100] It should be noted that the present invention is not limited to the embodiments described above, and various other applications and modifications can be taken as long as they do not deviate from the gist of the present invention as described in the claims. For example, the embodiments described above are detailed and specific explanations of the configuration of a video distribution system in order to clearly illustrate the present invention, and are not necessarily limited to having all the configurations described. Furthermore, it is possible to replace some of the configurations of the embodiments described here with the configurations of other embodiments, and it is also possible to add configurations from other embodiments to the configuration of one embodiment. In addition, it is possible to add, delete, or replace some of the configurations of the embodiments with those of other embodiments. Furthermore, the control lines and information lines shown are those deemed necessary for explanatory purposes, and not all control lines and information lines are necessarily shown in the actual product. In reality, it is safe to assume that almost all components are interconnected.

[0101] Furthermore, although the above embodiment describes a process for managing backgrounds in units of object sets, the present invention is not limited thereto. The present invention can manage any combination of multiple objects in units of object sets. For example, the present invention can manage combinations of multiple objects such as characters, character clothing, and character accessories in units of object sets. This makes it possible to switch any combination of objects in units of sets.

[0102] (Note) The features of the above-described embodiment are noted below. (Note 1) An information processing device for distributing videos in which images of performers are placed against a background image or a virtual space background, A storage process for storing multiple object candidates, which are candidates for objects that constitute the aforementioned video, and multiple background candidates, which are candidates for the aforementioned background. Using at least a portion of the above-mentioned multiple object candidates, a configuration process is performed to configure each of the above-mentioned multiple background candidates, In response to the video streamer selecting one of the multiple background candidates, the system will perform a setting process to set the selected background candidate as the background in the video. program. This simplifies the editing process for streamed videos and improves the usability of streaming applications. (Note 2) If an operation is performed to change the background candidate that is set as the background, The setting process changes the background to the other background candidate in response to the operation. The program described in Appendix 1. This simplifies the process of switching backgrounds. (Note 3) If an operation is performed to change one of the object candidates that constitute the background to another object candidate, The aforementioned setting process changes the object candidate to the other object candidate in response to the operation. The program described in Appendix 1. This simplifies the process of replacing objects included in the background. (Note 4) When an operation is performed to add one of the multiple object candidates onto the background, The aforementioned setting process places the added object candidates on the background in accordance with the operation. The program described in Appendix 1. This allows you to add any registered object candidate to the background. (Note 5) The aforementioned configuration process can be performed before and during the distribution of the video. The program described in any one of the appendices 1 to 4. This allows users to switch backgrounds, replace objects in the background, and add arbitrary object candidates before and during video streaming. (Note 6) The aforementioned storage process can store the background that was changed in the setting process as a background candidate. The program described in any one of the appendices 2 to 4. This allows streamers to register customized background options. (Note 7) The object candidates include still images, dynamic images, videos, and music. The program described in Appendix 1. This allows us to provide various object candidates for composing the video. (Note 8) The aforementioned object candidate includes an ad space for displaying an advertisement, In the aforementioned advertising section, an image or video of the advertisement, the address of the website displaying the advertisement, and a two-dimensional code or barcode that can read the address of the website may be displayed. The program described in Appendix 1. This allows advertisements to be displayed or presented to viewers during the streaming video. (Note 9) The object candidate includes a description field that can be edited by the broadcaster and the viewers of the video, In the description field, text and / or the object candidates can be displayed. The program described in Appendix 1. This makes it possible to provide a platform for communication between broadcasters and viewers in live-streamed videos. (Note 10) In the description field, the display operation of the object candidate corresponding to the predetermined operation can be performed in response to a predetermined operation by the broadcaster and / or the viewer. The program described in Appendix 9. This allows broadcasters and / or viewers to perform predetermined communication actions in streamed videos. (Note 11) The predetermined operation includes the viewer making a donation and the streamer and / or the viewer displaying small items. The program described in Appendix 10. This allows viewers to send donations during live streams, and streamers and / or viewers can send (display) items such as facial expressions or bouquets of flowers. (Note 12) An information processing device for distributing a video in which images of performers are placed against a background image or a virtual space, A storage unit that stores multiple object candidates, which are candidates for objects that constitute the aforementioned video, and multiple background candidates, which are candidates for the aforementioned background. Using at least a portion of the plurality of object candidates, the components that constitute each of the plurality of background candidates are: The system includes a setting unit that, in response to an operation by the video distributor to select one of the multiple background candidates, sets the selected background candidate as the background in the video. Information processing device. (Note 13) An information processing method in an information processing device for distributing a video in which images of performers are placed against a background image or a virtual space, A storage step of storing multiple object candidates, which are candidates for objects that constitute the video, and multiple background candidates, which are candidates for the background, A configuration step in which each of the multiple background candidates is constructed using at least a portion of the multiple object candidates, The set step includes setting the selected background candidate as the background in the video in response to the video distributor's operation of selecting one of the multiple background candidates. Information processing methods. (Note 14) An information processing system for distributing videos in which images of performers are placed against a background image or a virtual space, A storage unit that stores multiple object candidates, which are candidates for objects that constitute the aforementioned video, and multiple background candidates, which are candidates for the aforementioned background. Using at least a portion of the plurality of object candidates, the components that constitute each of the plurality of background candidates are: The system includes a setting unit that, in response to an operation by the video distributor to select one of the multiple background candidates, sets the selected background candidate as the background in the video. Information processing system. [Explanation of Symbols]

[0103] 1: Video distribution system 10: Server 20: Distribution device 30: Viewing device 11,21: Processing Unit 12,22: Storage section 13,26: Communications Department 23: Operation display section 24: Imaging Department 25: Voice input section 113,214: Transmitter 111,215: Receiving section 211: Component 212: Settings section 213: Video Generation Unit

Claims

1. An information processing device for distributing videos in which images of performers are placed against a background image or a virtual space background, A storage process for storing multiple object candidates, which are candidates for objects that constitute the aforementioned video, and multiple background candidates, which are candidates for the aforementioned background. Using at least a portion of the above-mentioned multiple object candidates, a configuration process is performed to configure each of the above-mentioned multiple background candidates, In response to the video streamer selecting one of the multiple background candidates, the system performs a setting process to set the selected background candidate as the background in the video. program.

2. If an operation is performed to change the background candidate that is set as the background, The setting process changes the background to the other background candidate in response to the operation. The program according to claim 1.

3. If an operation is performed to change one of the object candidates that constitute the background to another object candidate, The aforementioned setting process changes the object candidate to the other object candidate in response to the operation. The program according to claim 1.

4. When an operation is performed to add one of the multiple object candidates onto the background, The aforementioned setting process places the added object candidates on the background in accordance with the operation. The program according to claim 1.

5. The aforementioned configuration process can be performed before and during the distribution of the video. The program according to any one of claims 1 to 4.

6. The aforementioned storage process can store the background that was changed in the setting process as a background candidate. The program according to any one of claims 2 to 4.

7. The object candidates include still images, dynamic images, videos, and music. The program according to claim 1.

8. The aforementioned object candidate includes an ad space for displaying an advertisement, In the aforementioned advertising space, an image or video of the advertisement, the address of the website displaying the advertisement, and a two-dimensional code or barcode that can read the address of the website may be displayed. The program according to claim 1.

9. The aforementioned object candidate includes a description field that can be edited by the video's broadcaster and viewers, In the description field, text and / or the object candidates can be displayed. The program according to claim 1.

10. In the description field, the display operation of the object candidate corresponding to the predetermined operation can be performed in response to a predetermined operation by the broadcaster and / or the viewer. The program according to claim 9.

11. The predetermined operation includes the viewer making a donation and the streamer and / or the viewer displaying small items. The program according to claim 10.

12. An information processing device for distributing a video in which images of performers are placed against a background image or a virtual space, A storage unit that stores multiple object candidates, which are candidates for objects that constitute the aforementioned video, and multiple background candidates, which are candidates for the aforementioned background. Using at least a portion of the plurality of object candidates, the components that constitute each of the plurality of background candidates are: The system includes a setting unit that, in response to an operation by the video distributor to select one of the multiple background candidates, sets the selected background candidate as the background in the video. Information processing device.

13. An information processing method in an information processing device for distributing a video in which images of performers are placed against a background image or a virtual space, A storage step of storing multiple object candidates, which are candidates for objects that constitute the video, and multiple background candidates, which are candidates for the background, A configuration step in which each of the multiple background candidates is constructed using at least a portion of the multiple object candidates, The set step includes setting the selected background candidate as the background in the video in response to the video distributor's operation of selecting one of the multiple background candidates. Information processing methods.

14. An information processing system for distributing videos in which images of performers are placed against a background image or a virtual space, A storage unit that stores multiple object candidates, which are candidates for objects that constitute the aforementioned video, and multiple background candidates, which are candidates for the aforementioned background. Using at least a portion of the plurality of object candidates, the components that constitute each of the plurality of background candidates are: The system includes a setting unit that, in response to an operation by the video distributor to select one of the multiple background candidates, sets the selected background candidate as the background in the video. Information processing system.

Images