Program, information processing device, information processing method, and information processing system

Abstract

This will simplify the editing process for streamed videos and improve the usability of the streaming application. [Problem and Solution] Distribute a video in which images of performers are placed against a background image or a virtual space background. The program to be executed by the information processing device for this purpose is a candidate for the objects that make up the video. A memory device that stores multiple candidate objects and multiple candidate backgrounds. The reasoning is that, using at least some of the multiple object candidates, each of the multiple background candidates is The configuration process and the operation by the video broadcaster to select one of several background options are handled accordingly. This includes a setting process that sets the selected background candidate as the background in the video.

Description

Technical Field

[0001] The present invention relates to a program, an information processing apparatus, an information processing method, and an information processing system. .

Background Art

[0002] A video distribution system provides a service for distributing a video edited by a distributor to viewers via the Internet. In a conventional video distribution system, a distribution application reads objects such as a background image, a virtual space, a decorative item, a character representing a performer, and music ( BGM: BackGround Music) from the Web and provides them to the distributor as components of the video. The distributor places a decorative item or the like on the background image or the virtual space and sets it as the background for the performance of the video actors. The data of the background set using a plurality of objects such as the background image and the decorative item is managed as asset data for constructing a virtual space or the like (see Patent Document 1). BGM: BackGround Music), etc., and provides them to the distributor as components of the video. The distributor places a decorative item or the like on the background image or the virtual space and sets it as the background for the performance of the video actors. The data of the background set using a plurality of objects such as the background image and the decorative item is managed as asset data for constructing a virtual space or the like (see Patent Document 1). The data of the background set using a plurality of objects such as the background image and the decorative item is managed as asset data for constructing a virtual space or the like (see Patent Document 1). (See Patent Document 1).

[0003] Patent Document 1 describes that the object data includes asset data for constructing a virtual space that constitutes a video, data for drawing the background of the virtual space that constitutes the video, data for drawing various objects displayed in the video, and data for drawing various other objects displayed in the video. The data of the background set using a plurality of objects such as the background image and the decorative item is managed as asset data for constructing a virtual space or the like (see Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

[0005] As mentioned above, in conventional video distribution systems, the distribution application is on the web or The background image, virtual space, decorative items, and objects such as characters representing the performer are read It is incorporated and provided to the streamer as a component of the video. The streamer can use it as a background image or in a virtual space. Decorative items and other elements are often layered and set as the background. Therefore, in accordance with the flow of the video... If you want to change the background when switching scenes, the streamer should select several background options in advance. It needs to be configured. In other words, in conventional video distribution systems, background creation for the distributed video. Because it is time-consuming, editing streaming videos is cumbersome, reducing the convenience of the streaming service. There are challenges.

[0006] This invention was made to solve the above problems, and the present invention relates to the editing of distributed videos. The aim is to simplify operations and improve the usability of the distribution application. [Means for solving the problem]

[0007] This invention distributes videos in which images of performers are placed against a background image or virtual space. Therefore, the information processing device receives multiple candidate objects that are candidates for the objects that make up the video. A memory process that stores multiple background candidates, which are supplementary and background candidates, and multiple objects Using at least some of the candidates, a composition process is performed to construct each of the multiple background candidates, and video Depending on the streamer's action of selecting one of several background options, the selected background option This process sets the background for the video and executes the following steps. Incidentally, the above program is an aspect of the present invention and represents information processing reflecting one aspect of the present invention. An information processing device, an information processing method, and an information processing system are also configured in the same manner as the above server.

Effects of the Invention

[0008] According to the present invention having the above configuration, the editing operation of the distributed video can be simplified, and the convenience of the distribution application can be improved. Problems, configurations, and effects other than those described above will be clarified by the description of the following embodiments.

Brief Description of the Drawings

[0009] [Figure 1] It is a block diagram showing a configuration example of a video distribution system according to an embodiment of the present invention. [Figure 2] It is a block diagram showing a functional configuration example of a video distribution system according to an embodiment of the present invention. [Figure 3] It is a diagram showing a table of information on object candidates and information on background candidates stored in a distribution terminal according to an embodiment of the present invention. [Figure 4] It is a block diagram showing a hardware configuration example of a server according to an embodiment of the present invention. [Figure 5] It is a block diagram showing a hardware configuration example of a distribution terminal according to an embodiment of the present invention. [Figure 6] It is a diagram showing an example of a video generation screen displayed on a distribution terminal according to an embodiment of the present invention. [Figure 7] It is a flowchart showing the procedure of distribution processing in a video distribution system according to an embodiment of the present invention. [Figure 8] It is a flowchart showing the procedure of video generation processing in a server according to an embodiment of the present invention. [[ID= <49>]]

Modes for Carrying Out the Invention

[0010] ​ Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. In drawings, components having substantially the same function or configuration shall be marked with the same reference numeral. By adding a number, redundant explanations are omitted.

[0011] <Example of a video streaming system configuration> Next, an example of the configuration of the video distribution system according to this embodiment will be described. Figure 1 shows the configuration of this embodiment. This is a block diagram showing an example configuration of video distribution system 1 related to form. This is an example of an information processing system, as shown in Figure 1, comprising a server 10, a distribution terminal 20, It comprises multiple viewing terminals 30. The server 10, distribution terminal 20, and multiple viewing terminals 30 are They are connected to each other via a network (NW). The network (NW) is the internet, etc. It consists of public networks, LAN (Local Area Network), WAN (W This may include things like the IDE Area Network.

[0012] Server 10 is an information processing device that provides video streaming services. Here, video streaming is This includes the distribution of pre-generated videos and the distribution of live videos. In this embodiment, The video in question must include at least images of the performers and the background in which the performers' images are placed. Here, the background is either a background image or a virtual space. Also, the images of the performers are captions representing the performers. These include images of actors and captured images of performers. The images of performers include still images, dynamic images, Alternatively, it may be either a live recording or any of the following images. The background on which the performers' images are placed may be multiple It is constructed using the following objects. Here, an object is a background image, a virtual space, Includes images of decorative items, characters, etc., and sounds such as background music. If it is an image, it may be a still image, a dynamic image, or a video. Also, an object If it is audio, it can be any audio, such as background music, radio, or live audio of performers. .

[0013] Server 10 distributes videos to broadcasters and viewers who have logged into video distribution system 1. Provides a broadcast / viewing platform. Server 10 delivers via the network NW. The device receives the streamed video from terminal 20 and the received video is distributed to the streaming / viewing service platform. It will be provided to viewers through [this method]. The detailed functions of server 10 will be described in detail in Figure 2 below. ru.

[0014] The distribution terminal 20 is a PC (Personal Computer) maintained by the video distributor. It is an information processing device such as a ter, tablet, or smartphone. The distribution terminal 20 is a distribution terminal. The application will be installed. The distribution application will display the video generation screen (later (See Figure 6 described above) The broadcaster can compose and generate a video on the video generation screen. Yes, it is possible. The distribution terminal 20 distributes the generated video or live video via the network NW. The data can be sent to the server 10, and the performance can begin on the distribution / viewing platform. The detailed functions of the distribution terminal 20 will be described in detail in Figure 2 below.

[0015] Viewing terminal 30 is a PC (Personal Computer) owned by the video viewer. This refers to information processing devices such as ter, tablets, and smartphones. Using the viewing terminal 30 , via the network NW, the distribution / viewing platform provided by server 10 In this environment, viewers can watch videos streamed by broadcasters. Viewers can also use three viewing devices. Using 0, you can perform actions such as sending comments and making donations on the video display screen while watching. can.

[0016] <Example of a video streaming system's functional configuration> Next, an example of the functional configuration of the video distribution system 1 according to this embodiment will be described. Figure 2 shows This is a block diagram showing an example of the functional configuration of the video distribution system 1 according to this embodiment. Figure 2 shows an example of the functional configuration of the video distribution system 1 according to this embodiment. The network (NW) is omitted. Also, Figure 2 shows the various functions related to the present invention. Only the functional components are shown, and the illustrations and explanations of other functional components are omitted. Regarding the example functional configurations of the server 10 and distribution terminal 20 that constitute the image distribution system 1: I will explain it. I will omit the detailed explanation of the viewing device 30.

[0017] [Example of Server 10 Functional Configuration] As shown in Figure 2, the server 10 comprises a processing unit 11, a storage unit 12, and a communication unit 13. The processing unit 11 is connected to the storage unit 12 and the communication unit 13, respectively.

[0018] The processing unit 11 performs various processes to provide video distribution / viewing services, and the receiving unit 1 It has 11, a service provision unit 112, and a transmission unit 113.

[0019] The receiving unit 111, via the communication unit 13, receives instructions from the distribution terminal 20 to start and stop the distribution video. The receiver unit 111 receives commands such as termination and videos created and generated by the broadcaster. This includes requests for video viewing from the viewing device 30, and operations such as posting comments and making donations by viewers. Received notification.

[0020] Service provision department 112 provides a video distribution / viewing platform. The supply unit 112 responds to video distribution requests from the distribution terminal 20 to the distribution / viewing platform. In the system, the distribution of video received from the distribution terminal 20 begins. Also, the service provision unit 1 12, in response to a video viewing request from the viewing device 30, will send a message to the distribution / viewing platform. Then, the video playback for the viewers begins.

[0021] The transmitting unit 113 sends notifications to the distribution terminal 20 regarding the start, stop, and end of video distribution. The transmission unit 113 also sends notifications to the viewing terminal 30 regarding the start, stop, and end of video playback. Send a notification.

[0022] The memory unit 12 stores input and output data for various processes in the server 10. 12 is a list of multiple object candidates that are candidates for objects that make up the video, and the video You may also store multiple background candidates that are potential backgrounds for the given image.

[0023] The communication unit 13 communicates with the server 10, the distribution terminal 20, and the viewing terminal via the network NW. Establish connections with each of the 30 devices, and various data are transmitted to each of the distribution terminal 20 and viewing terminal 30. Send and receive data.

[0024] [Example of functional configuration for distribution terminal 20] The distribution terminal 20 has a function to generate distribution videos and a function to manage the presentation of distribution videos. As shown in Figure 2, the processing unit 21, the storage unit 22, the operation display unit 23, and the imaging unit 24, It includes an audio input unit 25 and a communication unit 26. The processing unit 21 includes a storage unit 22 and an operation display unit 23 It is connected to the imaging unit 24, the audio input unit 25, and the communication unit 26, respectively.

[0025] The processing unit 21 performs the functions of the distribution application installed on the distribution terminal 20. , configuration unit 211, setting unit 212, video generation unit 213, transmission unit 214, receiving unit 21 It has 5.

[0026] The component 211 contains multiple components for composing a video, which are pre-registered (stored) in the storage unit 22. Using at least some of the object candidates, multiple background candidates that are candidates for the video background ( It constitutes each of the studios A and B shown in Figure 6 below. Component 211 is, for example, For example, periodically acquire background usage history data from server 10 in video distribution system 1. Then, based on the background usage history data, the backgrounds with the most frequent usage (a predetermined number) are selected as background candidates. This ensures that the delivery application always provides the most popular background options. It is possible.

[0027] The information of each of the multiple background candidates composed by the component 211 is output to the storage unit 22. It is stored and remembered. The background candidate information includes the background candidate table and the background candidate configuration table. The structure of these two tables will be described in detail in Figure 3 below. Note that the background candidates are structure Section 211 is not limited to being configured as follows, for example, the distribution application install When it is released, it may be released to the memory unit 22.

[0028] The settings unit 212 responds to the broadcaster's operation to select one of several background candidates. The selected background candidate is set as the background in the video. Specifically, the setting unit 114 distribute Based on the identification information of the background candidate selected by the believer on the video generation screen U1 (see Figure 6) described below, Then, extract the configuration information of the background candidate (see background candidate configuration table T3 shown in Figure 3 below). Then, the video background is set according to the composition information of the extracted background candidates.

[0029] Additionally, the streamer can change the currently set background option to a different background option. If the operation is performed, the setting unit 212 changes the background to another background candidate in accordance with the operation. Additionally, the streamer may change the current background object candidates to other object candidates. If an operation to change the object is performed, the setting unit 212 will, in accordance with the operation, change the object candidate Change the substitute to a different object candidate. Also, the current background has multiple object candidates. If an operation to add a shift is performed, the setting unit 212 will, in accordance with the operation, add the shift The project candidates are placed in the background. Also, the background changed by setting unit 212 is used by the streamer. For customization, the background candidates may be stored in the memory unit 22. The various processes described above can be performed at any time before and during video distribution.

[0030] The video generation unit 213 generates the background set by the setting unit 114 and the performers placed on the background. Based on the image and other candidate object information, the system generates the video to be streamed.

[0031] When the distribution application is launched, the transmitting unit 214 transmits the video distribution system 1 The user ID registered in the above, i.e., the identification information of the distributor, is transmitted via the communication unit 26 to the server. It transmits to B10. The transmission unit 214 also transmits the video generated by the video generation unit 213 to The signal is transmitted to the server 10 via the signal unit 26. The transmission unit 214 also transmits the signal to the server 10. Instructions to start, stop, and end the animation are transmitted to the server 10 via the communication unit 26.

[0032] The receiving unit 215 receives notifications from the server 10 regarding the start, stop, and end of video playback. Furthermore, the receiving unit 215 receives information from the server 10 regarding comments posted by viewers and donations. Receive information, etc.

[0033] The memory unit 22 stores multiple object candidates and multiple background candidates. The memory unit 22 also changes the settings unit 212 according to the video editing operations of the broadcaster. The background may be stored as a background candidate. Images taken from the imaging unit 24, videos, and audio input unit. The audio information acquired by unit 25 and the video generated by unit 213 are stored. Oh, multiple object candidates, for example, when a distribution application is installed. It is then released to memory unit 22.

[0034] The operation display unit 23 is an operation unit for the broadcaster to perform various operations when creating a video, and as described later. It includes a display unit for displaying the video generation screen U1, etc. The operation unit and the display unit are, for example It may be formed as an integrated touch panel, or it may be configured separately. Operation display unit 23 generates an operation signal representing the operation content from the broadcaster input to the operation unit, and the operation signal The signal is supplied to the processing unit 21. The operation display unit 23 also receives the display signal supplied from the processing unit 21. Based on this, the display unit displays the information on the screen.

[0035] The imaging unit 24 is an imaging device that acquires surrounding image information, such as photographs and videos. The voice input unit 25 is a voice input device that acquires ambient sound information. The audio input unit 25 may be configured as a single unit.

[0036] The communications unit 26 establishes a connection between the distribution terminal 20 and the server 10 via the network NW. It then sends and receives various types of data with server 10.

[0037] Next, the information of the object candidates and background candidates stored in the storage unit 22 of the distribution terminal 20 The information will be explained. In this embodiment, the object candidates are still images, dynamic images, and moving This includes images and music, etc. Furthermore, the object candidates may also include ad spaces where advertisements are displayed. i. In the advertisement section, the advertisement image or video, the address of the website displaying the advertisement, and and display a QR code or barcode that can read the website address. It is possible. In addition, the broadcaster can prepare multiple ad options in the ad section and select any ad option You may select and stream it. Also, the object candidates are editable by both the broadcaster and the viewer. A description field may be included. In the description field, text and / or object suggestions may be displayed. This is possible. For example, in the description field, in response to a predetermined action by the broadcaster and / or viewer, The system can display object candidates corresponding to a predetermined operation. This includes viewer donation operations and object display operations by the streamer and / or viewers. This includes, among others.

[0038] Figure 3 shows the object candidate information and background stored in the distribution terminal 20 according to this embodiment. This is a diagram showing a table of candidate information. The object candidate table T1 shown in Figure 3 is O This is a data table that stores information on project candidates. Background candidate table T2 and background The candidate configuration table T3 is a data table that stores information about background candidates.

[0039] The object candidate table T1 contains the fields "Name", "ID", and "Access Information". It possesses. In the "Name" field, enter the name of the object candidate, for example, "Wallpaper_1", "Clock_ "1" etc. are stored. The "ID" field contains an identifier that uniquely identifies the object candidate. For example, "Wp1", "Crt1", etc. will be stored. The "Access Information" item will contain: Image data or audio of each object candidate associated with the identification information of each object candidate. Access information to the data storage location (storage area in memory unit 12) is stored here. In Figure 3, the data example for the "Access Information" item is abbreviated as "xxxx".

[0040] The background candidate table T2 has the fields "ID" and "Name". The "ID" field contains Identification information that uniquely identifies the background candidate, such as "St1" or "St2", is stored. The "Name" field should contain the names of the background candidates, for example, "Studio A," "Studio B," etc. This is stored.

[0041] The background candidate configuration table T3 stores each background candidate and is linked to the background candidate's identification information. It includes the fields "Name of the object candidate," "ID," and "Placement location." (See Figure 3) The background candidate configuration table T3 is, for example, the configuration table for the background candidate "Studio A". In the "Name of object candidate" field, the corresponding background candidate (Studio A) is configured. Names of all possible objects that make up the whole, for example, "wallpaper_1", "clock_1", "desk_1" ", "Book_1", and "BGM_1" ​​are stored. The "ID" field contains the corresponding background candidate( Identification information for all object candidates that make up Studio A), for example, "Wp1", "Wt1", "Tb1", "Bk1", and "Bgm1" are stored. In the "Placement Position" field... The object candidates stored in the "ID" field are positioned on the video screen. Information representing the coordinate data of the center of the object candidate image on the video screen ( The x1, y1) values ​​are stored. Note that the information representing the placement position of the object candidate is stored in the object. The data is not limited to the coordinates of the center of the image of the object candidate; for example, if the image of the object candidate is moving... This may also be informational data indicating the area on the screen of an image. As an example of information data, for example, in the case of a rectangular region, at least the four vertices of the rectangular region It contains coordinate data for two vertices. On the other hand, the object candidate is audio (e.g., BGM_1). In that case, the "Placement Location" field will be blank or contain the "-" shown in the diagram.

[0042] Note that the object candidate table T1, background candidate table T2, and background candidate configuration table The configuration of T3 is not limited to the configuration shown in Figure 3, and the items in each of the above tables may be used as appropriate as needed. You may add or modify it.

[0043] <Example hardware configuration of server 10 and distribution terminal 20> Next, we will describe the hardware configuration of server 10 and distribution terminal 20. Figure 4 shows the hardware configuration of server 10 and distribution terminal 20. This is a block diagram showing an example of the hardware configuration of server 10 according to the embodiment. As shown in Figure 4, the hardware configuration is as follows: CPU (Central Process ing Unit) 10a, ROM (Read Only Memory) 10b, RA M (Random Access Memory) 10c, Non-volatile storage 10d, It also includes a communication interface 10e. CPU 10a, ROM 10b, RAM 10c The non-volatile storage 10d and the communication interface 10e are connected by the bus 10f. They are connected so that they can send and receive information data to each other.

[0044] CPU10a receives the program code for the software that implements the various functions of server 10. The data is read from ROM10b, loaded into RAM10c, and executed. Note that CPU10a Alternatively, you can use a GPU (Graphics Processing Unit), etc. You can also use CPU10a and GPU together.

[0045] ROM10b is composed of a storage medium such as non-volatile memory, and the CPU10a executes It also stores programs, data, etc., that it references.

[0046] RAM10c is composed of a storage medium such as volatile memory, and each of the CPU10a's operations It temporarily stores the information (data) necessary for processing.

[0047] The non-volatile storage 10d stored the program executed by the CPU 10a. It consists of a computer-readable, non-transient recording medium, such as an HDD (Hard Disk Drive). It consists of storage devices such as ISK Drive. Non-volatile storage 10d is CPU 10a is the program that executes each function, OS (Operating System) ), it stores programs and data for controllers, etc., and is also implemented by the CPU 10a. A computer-readable, non-transient recording medium that stores the program to be executed is an HDD. Not limited to, for example, SSDs (Solid State Drives), CDs (Combustion Drives) pact Disc)-ROM, DVD(Digital Versatile Disc) c) Recording media such as ROM may be used.

[0048] The communication interface 10e includes, for example, a NIC (Network Interface Card). CE Cards, etc., are used, and LAN, WAN, dedicated lines, etc. are connected to the NIC terminals. It is possible to send and receive various types of data between devices via this interface.

[0049] Note that server 10 is not limited to the configuration shown in Figure 4, and for example, it can be configured on the cloud. That's good too.

[0050] Next, the hardware configuration of the distribution terminal 20 will be described. Figure 5 shows the configuration according to this embodiment. This is a block diagram showing an example of the hardware configuration of the distribution terminal 20. Compare Figure 5 and Figure 4 to see the difference. Similarly, the distribution terminal 20 has the same CPU 10a, ROM 10b, RAM as the server 10. It comprises 10c, non-volatile storage 10d, and a communication interface 10e. The end 20 further comprises an operation display device 20g, an imaging device 20h, and an audio input device 20i. CPU 10a, ROM 10b, RAM 10c, non-volatile storage 10d, communication input. The interface 10e, operation display device 20g, imaging device 20h, and audio input device 20i are The bus 10f connects them so that they can send and receive information data to each other. Here, C PU10a, ROM10b, RAM10c, non-volatile storage10d, and communication interface -The redundant explanation for Face 10e will be omitted.

[0051] The 20g operation display device uses an LCD (Liquid Crystal Display) or Display devices such as OLED (Electro-luminescence) displays, The display device and operating device consist of, for example, touch sensors, etc. It is formed as an integrated touch panel. The operating device can be a mouse or tablet. It is also possible to configure it as a separate unit from the display device.

[0052] The imaging device 20h consists of a camera, etc. The audio input device 20i consists of a microphone, etc. The imaging device 20h and the audio input device 20i may be configured as a single unit.

[0053] <Example of video generation screen configuration> Before explaining the video generation screen displayed in the distribution terminal 20 according to this embodiment, First, we will explain the problems that arise when broadcasters create videos in conventional video distribution systems. I will reveal it.

[0054] In conventional video streaming systems, the streaming application is accessed from the web and includes background images and virtual elements. Import objects such as space, decorative items, and characters representing the performers, and then use them in the video. It is provided to the broadcaster as a component. Therefore, the broadcasting application can access audio from the web and There is a problem with delays occurring when loading objects such as videos. Also, the flow of the video If you want to change the background when transitioning between scenes, the streamer should prepare several background options in advance. There is the problem that it takes time to set it up. Also, in conventional video streaming systems, the background is independent. It is treated as an object, that is, as a single image. Therefore, the decorative elements included in the background are not included. There is a problem in that items cannot be changed. Also, in conventional video distribution systems If the broadcaster replaces an object placed in the background with another object, Should I delete the object and then add another object, or add another object? Then delete the object. When these operations are performed, the object being modified The object may temporarily disappear, or the object being modified may exist in the video simultaneously with another object. This can lead to issues such as the stream being slowed down.

[0055] The present invention has been made to solve the above problems. Next, the distribution according to this embodiment This section describes an example configuration of the video generation screen displayed on the communication terminal 20. Figure 6 shows the actual configuration. This figure shows an example of a video generation screen U1 displayed on a distribution terminal 20 related to the implementation method.

[0056] As shown in Figure 6, the video generation screen U1 consists of a background candidate selection unit U11 and a video area U12. It has a video editing area U13.

[0057] The background candidate selection unit U11 displays images showing multiple background candidate images, as shown in Figure 6. For example, images showing background options such as "Studio A" and "Studio B" will be displayed.

[0058] Video area U12 is the area that shows the video being created by the broadcaster. In U11, selecting (clicking) any of the background options will move the corresponding background option to the video area. This will be reflected in U12. For example, if "Studio A" is selected, as shown in Figure 6, The background candidate for "Studio A" is set as the background for the video and reflected in the video area U12.

[0059] Background candidates are composed of combinations of multiple objects. For example, "studio "O A" consists of a book object OB1, a desk object OB2, and a clock object. It is composed in combination with OB3. "Studio B" is different from "Studio A". This is a background option, and similarly, it is composed of a combination of multiple objects.

[0060] Furthermore, in the state shown in Figure 6, the broadcaster changes the background in accordance with the scene changes in the video. When setting the studio, for example, if you select (click) "Studio B", then "Studio B" The selected background candidate is set as the background and reflected in the video area U12. In other words, the current background The background option "Studio A" is switched to background option "Studio B".

[0061] Furthermore, this invention does not manage background candidates as a single image, but rather as multiple objects It is managed as a set of objects. Therefore, select the object included in the background candidate and use it in the video. In the editing area U13, the "Add Object Candidate" button U131, described later, and "Object The selected object is changed by operations on buttons such as the "Delete Candidate" button U132. It is possible.

[0062] Specifically, as shown in Figure 6, the video editing area U13 is the "Add Object Candidate" button. Tan U131, "Delete Object Candidate" button U132, and "Save Background" button U1 It has 33, a "Start / Stop Performance" button U134, and a "End Performance" button U135. .

[0063] When the "Add Object Candidate" button U131 is pressed, the object stored in the memory unit 22 is A sub-window is displayed showing all possible objects. The sub-window displays, for example, images representing the image of each object candidate. The believer selects any object included in the background shown in video area U12 and selects "object Press the "Add Candidate" button U131, and in the sub-screen that appears, select any of the objects. When you select an object candidate, the selected object candidate will appear in the sub-window. It can be replaced with. For example, if the broadcaster selects the book object OB1 Press the "Add Object Candidate" button U131, and in the sub-screen that appears, select the bouquet. When you select an object candidate, the book object OB1 becomes the bouquet object candidate. They can be swapped.

[0064] Additionally, the broadcaster can select any object included in the background shown in the video area U12, and then select " When you press the "Delete Candidate Objects" button U132, the selected object will be deleted. The sub-window that displays each object candidate will show the image of each object candidate. It is not limited to displaying the image to be shown; for example, it can also be used to display the names of object candidates. You may display both the name and the image.

[0065] Furthermore, the streamer will select any of the objects in the sub-screen that displays each object candidate. Select an object candidate and place the selected object candidate on the background shown in the video area U12. This is possible. Furthermore, the broadcaster can use a mouse or touch panel (operation display unit 23) In the video area U12, each object that includes a background, and other objects placed on the background, You can also move objects and change their placement. Furthermore, the streamer can control the video's location. Select any object shown in area U12 and click the "Delete Object Candidate" button U13. Pressing 2 will delete the selected object.

[0066] When the "Save Background" button U133 is pressed, the background created by the streamer will appear as a background option. It is stored in memory unit 22.

[0067] When the "Start / Stop Performance" button U134 is pressed, a command is issued to start the video performance and to generate it. The generated video is sent to server 10. Also, during the video's animation, the "Start / Stop Animation" button... When U134 is pressed, a command to stop the video playback is sent to server 10. When 0 receives a command to start or stop the video animation, it will start the video animation according to the received command. Start or stop it.

[0068] When the "End Performance" button U135 is pressed, a command to end the video performance is sent to server 10. The command is received. Server 10 terminates the video presentation (distribution) in accordance with the received command.

[0069] As mentioned above, in the video editing field U13, the broadcaster uses a broadcasting application. You can select and use any one of the multiple background options provided. When switching scenes, simply select one of several background options provided. And you can easily switch backgrounds. Also, before or during a live stream, the background is included Select any object, or one of the multiple object candidates provided. Simply by doing so, the object can be replaced with the selected object candidate. Furthermore, the streamer selects any one of the multiple background options provided and applies it to the background option. Then, add, swap, delete object candidates, etc., and customize the changed background candidates. You can also save it as a customized background option.

[0070] <Delivery Processing Procedure> Next, the procedure for distribution processing in the video distribution system 1 according to this embodiment will be described. Figure 7 shows a flowchart illustrating the distribution process in the video distribution system 1 according to this embodiment. It's a chart.

[0071] First, when the distribution application is installed, the distribution terminal 20 configures the video. Multiple candidate objects, which are candidates for the object to be processed, are registered (stored) in the storage unit 12. (Step S1).

[0072] Next, the distribution terminal 20 uses at least a portion of the registered object candidates. Then, each of the multiple background candidates, which are background candidates, is configured and registered (stored) in the memory unit 12. (Step S2).

[0073] Next, the distribution terminal 20, in response to the distribution operator's operation to launch the distribution application, The application is launched (step S3). Also, in this process, the distribution terminal 20 The system then sends the identification information of the streamer who logged into the streaming application to the server 10.

[0074] Next, the distribution terminal 20 performs various video editing operations performed by the distributor on the video generation screen U1. Obtain production information (Step S4).

[0075] Next, the distribution terminal 20 executes the video generation process (step S5). The procedure will be described in detail in Figure 8 below.

[0076] Next, the viewing terminal 30 logs into the distribution / viewing platform provided by the server 10. The identification information of the subscribed viewer is sent to the server 10 (step S6). Note that this process is Depending on when the viewer logs in, after the processing in step 7 or after the processing in step 8. This may also be done in other situations.

[0077] Next, the distribution terminal 20 receives information about the operation to start the effects performed by the distributor on the video generation screen U1. The report and the generated video are sent to server 10 (step S7).

[0078] Next, server 10 starts streaming video (step S8). Also, in this process, Server 10 notifies both the distribution terminal 20 and the viewing terminal 30 that video distribution has begun.

[0079] Next, the viewing terminal 30 starts watching the video (step S9). The execution timing may vary depending on the execution timing of step S6.

[0080] Next, during video production (distribution), the distribution terminal 20 allows the distributor to use the video generation screen U1. When video editing operations are performed, various operation information from the broadcaster is obtained (Step S10). .

[0081] Next, the distribution terminal 20 executes the video generation process (step S11). The video here The generation process is the same as the video generation process in step S5, and will be described in detail in Figure 8 below. The distribution terminal 20 then sends the generated video to the server 10.

[0082] Next, server 10 updates the video being streamed, that is, it receives new data from streaming terminal 20. Distribute the video (Step S12).

[0083] Next, viewers use the viewing device 30 to post comments, make donations, and perform other prescribed actions. When an operation is performed, the viewing terminal 30 sends information about the predetermined operation to the server 10 (step S13).

[0084] Next, the server 10 uses the information of a predetermined operation received from the viewing terminal 30 to perform the following during distribution. Update the video (Step S14).

[0085] Next, the distribution terminal 20 indicates that the broadcaster performed the action to end on the video generation screen U1. In this case, the broadcaster sends information about the end of the performance to the server 10 (step S15).

[0086] Next, server 10 terminates video distribution according to the received distribution termination operation information ( Step S16). Also, Server 10 will terminate video distribution to distribution terminal 20 and viewing terminal 30. Each of them will be notified. After the processing in step S16, the distribution process will end.

[0087] <Video generation process steps> Next, the procedure for video generation processing in the distribution terminal 20 according to this embodiment will be described. Figure 8 is a flowchart illustrating the video generation process in the distribution terminal 20 according to this embodiment. The process described below is performed in steps S5 and S11 shown in Figure 7. It is called and starts.

[0088] First, the settings unit 212 processes the various video editing operations performed by the broadcaster on the video generation screen U1. Obtain information (step S51).

[0089] Next, the settings unit 212, among the various operation information for video editing that was acquired, the background setting operation... Determine whether or not (Step S52).

[0090] In the process of step S52, if the setting unit 212 determines that there is no background setting operation, If the result is correct (NO determination in step S52), the process described in step S54 below is performed.

[0091] On the other hand, in the process of step S52, the setting unit 212 determines that there is a background setting operation. If this occurs (if the result in step S52 is YES), the background candidate selected by the broadcaster will be moved. Set it as the background of the image (step S53).

[0092] If the NO determination is made in step S52, or after processing in step S53, the setting unit 212 will: This determines whether or not there is information about background replacement operations among the various operation information obtained for video editing. (Step S54).

[0093] In the process of step S54, the setting unit 212 determines that there is no information about the background replacement operation. If the result is determined (NO determination in step S54), the process described in step S56 below is performed.

[0094] On the other hand, in the process of step S54, the setting unit 212 has a background swapping operation. If a determination is made (if the determination is YES in step S54), the current background will be selected by the broadcaster. Change to the selected background candidate (step S55).

[0095] If the NO determination is made in step S54, or after processing in step S55, the setting unit 212 will: Determine whether or not there is information about object modification operations among the various operation information obtained for video editing. (Step S56).

[0096] In the process of step S56, the setting unit 212 does not have information on the modification operation of the object. If it is determined that (the NO determination in step S56), the process in step S58 described below is performed. cormorant.

[0097] On the other hand, in the process of step S56, the setting unit 212 performs an object modification operation. If it is determined that (if the YES determination is made in step S56), the object modification operation information Based on this, the object is modified (step S57). In this process, the setting unit 212 Depending on the object modification operation information, the objects included in the background are selected. You can change the object candidate or add the selected object candidate to the background. Also, change the objects placed on the background to the selected object candidate. To carry out such things.

[0098] If the NO determination is made in step S56, or after processing in step S57, the video generation unit 213 This generates the edited video on the video generation screen U1 (step S58). After processing S58, the video generation process ends.

[0099] <Effects> As described above, the distribution terminal 20 according to this embodiment has multiple objects for composing a video. Target candidates and multiple background candidates are registered in advance. This allows the distributor to use the registered multiple You can set the background simply by selecting one of the available background options. The task involves believers preparing each potential object that makes up the background, and creating the background from scratch. Work will be reduced. Also, when switching scenes in the video, the broadcaster will have background options. You can easily switch backgrounds by simply selecting one of the options. Also, before broadcasting or During live streams, any object included in the background, as well as multiple pre-prepared objects Simply select one of the candidates to add that object to the selected object candidates. It can be replaced. Therefore, according to the present invention, the editing operation of distributed video is simplified, This can improve the usability of the distribution application.

[0100] Furthermore, the present invention is not limited to the embodiments described above, but also includes the embodiments described in the claims. Of course, various other applications and modifications can be taken without departing from the spirit of the present invention. . For example, the above-described embodiment is intended to clearly illustrate the present invention and describes a video distribution system This provides a detailed and specific description of the configuration, and does not necessarily mean that all of the described configurations are present. It is not limited to this. Furthermore, some of the configurations of the embodiments described herein can be used in the configurations of other embodiments. It is possible to swap them, and furthermore, to add the configuration of one embodiment to the configuration of another embodiment. It is also possible to add, delete, or replace some of the configurations of the embodiment with other configurations. It is also possible to do so. Furthermore, the control lines and information lines shown are those deemed necessary for explanatory purposes and do not necessarily represent all of them in the actual product. It does not necessarily indicate control lines or information lines. In reality, almost all components are interconnected. It is reasonable to assume that this is the case.

[0101] Furthermore, the above embodiment describes a process for managing the background in units of sets of objects. However, the present invention is not limited thereto. The present invention allows for any combination of multiple objects Objects can be managed in sets. For example, the present invention allows for the management of characters, Combining multiple objects such as character clothing and character accessories. Objects can be managed in sets. This allows any object The combinations can be switched in sets.

[0102] (Note) The features of the above-described embodiment are noted below. (Note 1) Information for distributing videos in which images of performers are placed against a background image or a virtual space background. In the information processing system, Multiple object candidates which are candidates for objects that constitute the aforementioned video, and the background A memory process that stores multiple background candidates that are candidates for the scene, Using at least a portion of the above-mentioned object candidates, each of the above-mentioned background candidates The configuration process that makes up this, In response to the operation by the video broadcaster to select one of the multiple background candidates, The process of setting the selected background candidate as the background in the video is executed. program. This simplifies the editing process for streamed videos and improves the usability of the streaming application. It is possible. (Note 2) If an operation is performed to change the background candidate that is set as the background to another background candidate, , The setting process changes the background to the other background candidate in response to the operation. The program described in Appendix 1. This simplifies the process of switching backgrounds. (Note 3) An operation is performed to change one of the object candidates that constitute the background to another object candidate. If that happens, The aforementioned setting process, in response to the operation, changes the object candidate to the other object candidate. Change The program described in Appendix 1. This simplifies the process of replacing objects included in the background. (Note 4) When an operation is performed to add one of the multiple object candidates onto the background, The aforementioned setting process places the added object candidates on the background in accordance with the operation. do The program described in Appendix 1. This allows you to add any registered object candidate to the background. (Note 5) The aforementioned configuration process can be performed before and during the distribution of the video. The program described in any one of the appendices 1 to 4. This allows for background switching and the removal of objects from the background before and during video streaming. You can swap out elements and add any object candidates. (Note 6) The memory process stores the background that was changed in the setting process as a background candidate. It is possible The program described in any one of the appendices 2 to 4. This allows streamers to register customized background options. (Note 7) The object candidates include still images, dynamic images, videos, and music. The program described in Appendix 1. This allows us to provide various object candidates for composing the video. (Note 8) The aforementioned object candidate includes an ad space for displaying an advertisement, In the aforementioned advertisement section, the advertisement image or video, the address of the website displaying the advertisement S, and a two-dimensional code or barcode that can read the address of the aforementioned website. The code can be displayed. The program described in Appendix 1. This allows advertisements to be displayed or presented to viewers in the streamed video. ru. (Note 9) The object candidate includes a description field that can be edited by the broadcaster and the viewers of the video. , In the description field, text and / or the object candidates can be displayed. ru The program described in Appendix 1. This creates a platform for communication between broadcasters and viewers in live-streamed videos. We can provide a place. (Note 10) In the description field, in accordance with the predetermined operation of the broadcaster and / or the viewer, The system can display the object candidates corresponding to the operation. The program described in Appendix 9. This allows the broadcaster and / or viewers to communicate in a predetermined manner in the streamed video. Actions can be realized. (Note 11) The aforementioned predetermined operation is the operation of tipping by the viewer, and the broadcaster and / or the viewer. Includes display operations for small items. The program described in Appendix 10. This allows viewers to send donations to streamed videos, and the streamer and / or Viewers can send (display) items such as facial expressions or small objects like bouquets of flowers. (Note 12) Information for distributing videos in which images of performers are placed against a background image or a virtual space background. Information processing device, Multiple object candidates which are candidates for objects that constitute the aforementioned video, and the background A memory unit that stores multiple background candidates that are candidates for the scenery, Using at least a portion of the above-mentioned object candidates, each of the above-mentioned background candidates The components that make up this, In response to the operation by the video broadcaster to select one of the multiple background candidates, The system includes a setting unit that sets the selected background candidate as the background in the video. Information processing device. (Note 13) Information for distributing videos in which images of performers are placed against a background image or a virtual space background. An information processing method in an information processing device, Multiple object candidates which are candidates for objects that constitute the aforementioned video, and the background A memory step to memorize multiple background candidates that are candidates for the scene, Using at least a portion of the above-mentioned object candidates, each of the above-mentioned background candidates The configuration steps that make up this, In response to the operation by the video broadcaster to select one of the multiple background candidates, The setting step includes setting the selected background candidate as the background in the video. Information processing methods. (Note 14) Information for distributing videos in which images of performers are placed against a background image or a virtual space background. It is a report processing system, Multiple object candidates which are candidates for objects that constitute the aforementioned video, and the background A memory unit that stores multiple background candidates that are candidates for the scenery, Using at least a portion of the above-mentioned object candidates, each of the above-mentioned background candidates The components that make up this, In response to the operation by the video broadcaster to select one of the multiple background candidates, The system includes a setting unit that sets the selected background candidate as the background in the video. Information processing system. [Explanation of Symbols]

[0103] 1: Video distribution system 10: Server 20: Distribution device 30: Viewing device 11,21: Processing Unit 12,22: Storage section 13,26: Communications Department 23: Operation display section 24: Imaging Department 25: Voice input section 113,214: Transmitter 111,215: Receiving section 211: Component 212: Settings section 213: Video Generation Unit

Claims

1. Information for distributing videos in which images of performers are placed against a background image or a virtual space background. In the information processing system, Multiple object candidates which are candidates for objects that constitute the aforementioned video, and the background A memory process that stores multiple background candidates that are candidates for the scene, Using at least a portion of the above-mentioned object candidates, each of the above-mentioned background candidates The configuration process that makes up this, In response to the operation by the video broadcaster to select one of the multiple background candidates, The process of setting the selected background candidate as the background in the video is executed. program.

2. If an operation is performed to change the background candidate that is set as the background to another background candidate, 、 The setting process changes the background to the other background candidate in response to the operation. The program according to claim 1.

3. An operation is performed to change one of the object candidates that constitute the background to another object candidate. If that happens, The aforementioned setting process, in response to the operation, changes the object candidate to the other object candidate. Change The program according to claim 1.

4. When an operation is performed to add one of the multiple object candidates onto the background, The aforementioned setting process places the added object candidates on the background in accordance with the operation. do The program according to claim 1.

5. The aforementioned configuration process can be performed before and during the distribution of the video. The program according to any one of claims 1 to 4.

6. The memory process stores the background that was changed in the setting process as a background candidate. It is possible The program according to any one of claims 2 to 4.

7. The object candidates include still images, dynamic images, videos, and music. The program according to claim 1.

8. The aforementioned object candidate includes an ad space for displaying an advertisement, In the aforementioned advertisement section, the image or video of the advertisement, and the website displaying the advertisement are provided. The dress and a QR code or bar that can read the address of the aforementioned website. - The code can be displayed. The program according to claim 1.

9. The aforementioned object candidate includes a description field that can be edited by the video's broadcaster and viewers, In the description field, text and / or the object candidates can be displayed. ru The program according to claim 1.

10. In the description field, in accordance with the predetermined operation of the broadcaster and / or the viewer, The system can display the object candidates corresponding to the operation. The program according to claim 9.

11. The aforementioned predetermined operation is the operation of tipping by the viewer, and the broadcaster and / or the viewer. Includes display operations for small items. The program according to claim 10.

12. Information for distributing videos in which images of performers are placed against a background image or a virtual space background. Information processing device, Multiple object candidates which are candidates for objects that constitute the aforementioned video, and the background A memory unit that stores multiple background candidates that are candidates for the scenery, Using at least a portion of the above-mentioned object candidates, each of the above-mentioned background candidates The components that make up this, In response to the operation by the video broadcaster to select one of the multiple background candidates, The system includes a setting unit that sets the selected background candidate as the background in the video. Information processing device.

13. Information for distributing videos in which images of performers are placed against a background image or a virtual space background. An information processing method in an information processing device, Multiple object candidates which are candidates for objects that constitute the aforementioned video, and the background A memory step to memorize multiple background candidates that are candidates for the scene, Using at least a portion of the above-mentioned object candidates, each of the above-mentioned background candidates The configuration steps that make up this, In response to the operation by the video broadcaster to select one of the multiple background candidates, The setting step includes setting the selected background candidate as the background in the video. Information processing methods.

14. Information for distributing videos in which images of performers are placed against a background image or a virtual space background. It is a report processing system, Multiple object candidates which are candidates for objects that constitute the aforementioned video, and the background A memory unit that stores multiple background candidates that are candidates for the scenery, Using at least a portion of the above-mentioned object candidates, each of the above-mentioned background candidates The components that make up this, In response to the operation by the video broadcaster to select one of the multiple background candidates, The system includes a setting unit that sets the selected background candidate as the background in the video. Information processing system.

Images