Video distribution system, video distribution method, and video distribution program
The video distribution system facilitates character object changes through slot-based transitions, addressing concentration loss and enhancing viewer engagement by allowing dynamic adjustments based on user and viewer interactions.
Patent Information
- Application Number
- JP2023174008
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-10-06
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2039-04-10
AI Technical Summary
Existing video distribution systems face challenges in changing character objects during video distribution without reducing the actor's concentration, which can lead to a decrease in video quality and viewer interest.
A video distribution system that allows for changing character objects by associating them with multiple slots, enabling seamless transitions based on user operations, viewer interactions, or predetermined conditions, without requiring real-time facial capture during the distribution process.
Enables dynamic character object changes without distracting the actor, maintaining concentration and enhancing viewer engagement and motivation.
Smart Images

Figure 0007594761000001 
Figure 0007594761000002 
Figure 0007594761000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a video distribution system, a video distribution method, and a video distribution program, and in particular, the disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program that distributes videos including animations of character objects generated based on the movements of actors. [Background technology]
[0002] Conventionally, there has been known a video distribution system that generates animation of a character object based on the movement of an actor and distributes a video including the animation of the character object. Such a video distribution system is disclosed in, for example, Patent Document 1.
[0003] There is also known a content distribution system that displays a gift object corresponding to an item purchased by a viewing user on a display screen in response to a request from the viewing user who is viewing content. For example, in the video distribution system disclosed in Patent Document 2, a viewing user can purchase a gift item and provide the purchased gift item to a performer (content distributor) as a gift. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2015-184689 A [Patent Document 2] JP 2012-120098 A Summary of the Invention [Problem to be solved by the invention]
[0005] The character objects used in such video distribution are generally set in advance by the actor (distributor) before the video distribution, but there has been an emerging demand to be able to change the character objects even during video distribution in order to increase the motivation of viewing users to provide gifts.
[0006] However, when a character object is changed during video distribution, there is a risk that the actor's concentration on the act may decrease.
[0007] In that case, the quality of the video content may decrease, and viewers may lose interest in watching the video.
[0008] It is an object of the present disclosure to provide a technical improvement that solves or alleviates at least a part of the problems of the prior art described above. A more specific object of the present disclosure is to provide a video distribution system, a video distribution method, and a video distribution program that enable a character object to be changed to another character object without reducing an actor's concentration on the act. [Means for solving the problem]
[0009] A video distribution system according to an embodiment of the present invention is a video distribution system that distributes video including animation of a character object generated based on the movement of an actor, and is equipped with one or more computer processors, which, by executing computer-readable instructions, realize a function of accepting, by user operation, the setting of a plurality of slots to which character objects each consisting of one or more body parts and one or more wearable parts are associated, and a function of distributing a video including animation of a character object associated with a slot among the plurality of slots specified by the user operation, and is characterized in that, when a predetermined condition is satisfied during distribution of the video, the character object included in the video is changed from the one character object to another character object associated with another slot among the plurality of slots.
[0010] Satisfaction of the predetermined condition can be determined based on at least one of an operation, a movement, and a voice of the user and / or a viewing user.
[0011] A GUI for switching character objects is displayed on the user's screen when a video is being distributed, and whether or not a predetermined condition has been satisfied can be determined based on whether or not an operation has been performed on the GUI.
[0012] Whether or not the predetermined condition is satisfied can be determined based on whether or not the number of giftings by the viewing user is equal to or greater than a predetermined number.
[0013] Whether the predetermined condition is satisfied can be determined based on whether the number of viewing users is equal to or greater than a predetermined number.
[0014] Before a video is distributed, a display screen is displayed for a user on which at least a character object, a first GUI, and a second GUI are displayed, the first GUI is a GUI for starting the distribution of the video, and the second GUI is a GUI for starting the display of a list screen of body parts and attached parts, and the list screen can be displayed superimposed on at least a portion of the display screen.
[0015] The list screen includes a third GUI and a fourth GUI, the third GUI being a GUI that shows categories of body parts and attachment parts and allows the display content to be slid in a predetermined first direction, and the fourth GUI being a GUI that shows body parts and attachment parts belonging to each category and allows the display content to be slid in a second direction different from the first direction.
[0016] A third GUI is displayed in a superimposed manner on the display screen, and when a predetermined user operation is performed on the third GUI, a fourth GUI can be further displayed in a superimposed manner on the display screen.
[0017] Regardless of whether distribution of a video has started or not, at least the facial portion of a character object displayed on the display screen can be captured, as can the facial portion of a user.
[0018] Even during distribution of a video, while a character object included in the video is being changed from one character object to another character object associated with another slot among a plurality of slots, at least the facial portion of the character object displayed on the display screen can be made such that the facial portion of the user is not captured.
[0019] Even before the video is distributed, while the list screen is being displayed, at least the facial portion of the character object displayed on the display screen can be set so that the facial portion of the user is not captured.
[0020] A video distribution method according to an embodiment of the present invention is a video distribution method for distributing a video including an animation of a character object generated based on the movement of an actor, and includes a step of accepting, through a user's operation, the setting of a plurality of slots to which character objects each consisting of one or more body parts and one or more wearable parts are associated, and a step of distributing a video including an animation of a character object associated with one of the plurality of slots specified by the user's operation, wherein the step of distributing the video is characterized in that, when a predetermined condition is satisfied during distribution of the video, the character object included in the video is changed from the one character object to another character object associated with another of the plurality of slots.
[0021] A video distribution program according to an embodiment of the present invention is a video distribution program that distributes a video including an animation of a character object generated based on the movement of an actor, and has one or more computer processors realize a process of accepting, through a user's operation, the setting of a plurality of slots to which character objects each consisting of one or more body parts and one or more wearable parts are associated, and a process of distributing a video including an animation of a character object associated with a slot among the plurality of slots specified by the user's operation, and is characterized in that, when a predetermined condition is satisfied during the distribution of the video, the character object included in the video is changed from the one character object to another character object associated with another slot among the plurality of slots. Effect of the Invention
[0022] According to the video distribution system, video distribution method, and video distribution program of the present invention, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional techniques described above. Also, according to the video distribution system, video distribution method, and video distribution program of the present invention, it is possible to change a character object to another character object without reducing the actor's concentration on the act. [Brief description of the drawings]
[0023] [Figure 1] 1 is a system configuration diagram showing the system configuration of a video distribution system according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram showing the configuration of a broadcast user terminal according to one embodiment of the present invention; [Diagram 3] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 4] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Diagram 5] FIG. 13 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 6] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 7] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 8] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 9] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 10] FIG. 13 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 11] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 12] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 13]FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 14] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 15] 1 is a block diagram showing the hardware configurations of a server device, a broadcast user terminal, and a viewer user terminal according to an embodiment of the present invention. [Figure 16] FIG. 4 is a flow diagram showing the flow of a video distribution process according to an embodiment of the present invention. [Figure 17] FIG. 11 is a flowchart showing a process for changing a character object according to an embodiment of the present invention. [Figure 18] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. [Figure 19] FIG. 11 is an image diagram showing an example of a display screen displayed by a distribution application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0024] First, an overview of the video distribution system of the present invention will be described with reference to the drawings.
[0025] The video distribution system of the present invention is a video distribution system that distributes video including animation of a character object that is generated based on the movement of an actor.
[0026] As shown in FIG. 1, a moving image distribution system 100 of the present invention is composed of a server device 200, a distributor user terminal 300, and one or more viewer user terminals 400, as an example.
[0027] 2, the broadcasting user terminal 300 can be an information processing terminal such as a smartphone or tablet that includes a facial expression analysis unit 310, a generation unit 320, a reception unit 330, a video broadcasting unit 340, and a change unit 350 and can realize a facial capture function that recognizes the facial expression of the broadcasting user. Specifically, the facial expression capture function can be realized by the facial expression analysis unit 310. Note that it is not essential for the viewing user terminal 400 to be provided with such a facial capture function.
[0028] A character object is an object having a face that expresses the broadcast user's facial expression using a facial capture function in a dedicated application (hereinafter referred to as the "broadcast app") executed on the broadcast user terminal 300, and at least a part of the torso. In other words, this character object includes not only those that represent the entire body, but also those that represent only the upper body. Note that the movements of the broadcast user may also be displayed for parts of the body other than the face using a motion capture function that recognizes the movements of the broadcast user.
[0029] The character object is composed of one or more body parts and one or more attachment parts. These body parts and attachment parts are stored in the storage of the server device 200 in association with their respective identification numbers.
[0030] The body parts are, for example, eyes, eyebrows, nose, mouth, moles, makeup, etc. Makeup includes further subdivided parts such as blush, eyeshadow, and lipstick. Furthermore, among these body parts, there are parts with different colors that differ only in color.
[0031] The wearable parts include, for example, accessories, clothes, shoes, etc. Clothes include further subdivided parts such as tops, bottoms, socks, etc. Furthermore, among these parts, there are parts with different colors that differ only in color.
[0032] Then, the broadcast user creates a character object to serve as his / her avatar when the broadcast app is launched for the first time. Figures 3 to 6 are image diagrams showing an example of the transition of screen 30 on broadcast user terminal 300 when the broadcast app is launched for the first time.
[0033] First, a screen for starting the creation of a character object is displayed on screen 30 of broadcast user terminal 300, as shown in Fig. 3. Note that, as shown in Fig. 3, the character object created at the initial startup can be changed later.
[0034] Then, as shown in FIG. 4, a specific part (part a1 in FIG. 4) is designated from one or more body parts and one or more attachment parts displayed for each category (A to D in FIG. 4), and a color (color CL2 in FIG. 4) for the designated part is selected to create a character object CO consisting of the designated part a1 in the selected color CL2. Note that each time a part is designated, the display of the character object CO changes accordingly. Note that, although at least one part is generally designated for each category, there may be parts for categories that are not required.
[0035] Then, when the decision button 33 shown in the upper right corner in Fig. 5 is selected as an example, the character object CO displayed on the screen 30 at this stage is created as an initial character object. Also, as shown in Fig. 6, the display of the list of parts can be temporarily removed from the screen 30, allowing the broadcast user to specify each part while checking the entire character object CO.
[0036] The combinations of these body parts and attachment parts are nearly infinite, depending on the type and color of each part. Therefore, broadcast users must carefully consider and create the character object they want by trying out a huge number of part combinations.
[0037] After the initial character object is created, at least a video distribution start button 36 and a closet button 37 are displayed on a top screen 35 of the distribution application, as shown in Fig. 7 as an example. Fig. 7 further displays a settings button 38 for performing detailed settings of the distribution application.
[0038] When the moving image distribution start button 36 is selected, distribution of a moving image begins using the displayed character object CO. Details of the moving image distribution will be described later.
[0039] When the closet button 37 is selected, the display of a list screen of the above-mentioned body parts and attached parts starts, and the character object CO can be changed.
[0040] Note that the change of the character object CO here includes "changing clothes," which is simply changing the parts attached to the character object CO without changing any body parts.
[0041] In the present invention, the broadcasting user can broadcast moving images by preparing a plurality of character objects CO. That is, when the closet button 37 is selected, the character object CO is changed for each slot.
[0042] 8, when closet button 37 is selected, slot buttons 41-43 are displayed on screen 40, each displaying a number that identifies the slot, and by selecting a button to switch between slots, a character object is created and associated with each slot. Note that there may be more than one slot, and there is no need to set an upper limit.
[0043] Fig. 8 shows a character object CO1 associated with slot 1 corresponding to slot button 41. Similarly, Figs. 9 and 10 show character objects CO2 and CO3 associated with slots 2 and 3 corresponding to slot buttons 42 and 43, respectively.
[0044] In this way, the broadcast user can set a character object for each slot, prepare multiple character objects, and start video distribution. The preparation of multiple character objects is performed based on input operations from the broadcast user accepted by the acceptance unit 330 of the broadcast user terminal 300.
[0045] As another example of the present invention, a character object CO may be automatically created from a facial photo of the broadcast user received by the reception unit 330 of the broadcast user terminal 300.
[0046] Then, the broadcast user starts broadcasting a moving image using one character object associated with one of the multiple slots. The broadcast user's terminal 300 executes the moving image broadcast by the video broadcast unit 340.
[0047] The slot designation when starting video distribution may be done by requiring the broadcasting user to input it when starting video distribution, or by having the user designate in advance the slot to be used when starting video distribution when setting a character object in the slot.
[0048] 11, a broadcaster user who is currently broadcasting a moving image can change the character object they are using by selecting change buttons 51-53 displayed on screen 50. Note that change buttons 51-53 correspond to slots 1-3, respectively. Such a change is performed by change unit 350 of broadcaster user terminal 300.
[0049] FIG. 11 shows an example in which a character object CO associated with slot 3 corresponding to change button 53 is used, and the display is such that the broadcast user can recognize which character object CO is being used.
[0050] When switching between character objects, a predetermined dramatic effect may be generated. For example, a dramatic effect may be displayed in which the character object enters a changing room, or a dramatic effect may be displayed in which the character object rotates and transforms. This configuration has the effect of preventing the viewing user from noticing the time required for the character object change process.
[0051] The outline of the video distribution system of the present invention has been explained above. Next, the details of each component will be explained.
[0052] The video distribution system 100 of the present invention is a video distribution system that distributes videos including animations of character objects generated based on the movements of actors, and includes one or more computer processors.
[0053] The one or more computer processors may be processors provided in the above-mentioned server device 200, broadcaster user terminal 300 and viewer user terminal 400. Details of the hardware configurations of the above devices and each terminal will be described later.
[0054] The one or more computer processors then execute the computer readable instructions to realize the following functions:
[0055] First, one or more computer processors execute computer-readable instructions to realize a function of accepting settings of a plurality of slots, each of which is associated with a character object configured with one or more body parts and one or more wearable parts, by an operation of the broadcasting user. This function is realized by the reception unit 330. Details of the reception unit 330 are as described above.
[0056] Secondly, the one or more computer processors execute computer-readable instructions to realize a function of delivering a video including an animation of one character object associated with one of the multiple slots, which is specified by an operation of the broadcast user. This function is realized by the video delivery unit 340. Details of the video delivery unit 340 will be described later.
[0057] The function of distributing a moving image changes a character object included in the moving image from one character object to another character object associated with another slot among the multiple slots when a predetermined condition is satisfied during distribution of the moving image. This function is realized by the changing unit 350. The details of the changing unit 350 are as described above.
[0058] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Furthermore, according to the above configuration, it is possible to change a character object to another character object without reducing the actor's concentration on the act. Specifically, instead of changing each part of a character object during video distribution, it is possible to change a character object using a slot prepared in advance, so that the actor's concentration on the act can be maintained.
[0059] Satisfaction of the above-mentioned predetermined condition can be determined based on at least one of an operation, a movement, and a voice of the broadcast user and / or the viewing user.
[0060] Specifically, when streaming a video, a GUI for switching character objects is displayed on the screen for the streaming user, and satisfaction of specified conditions can be determined based on whether or not an operation has been performed on the GUI.
[0061] Such GUI can be change buttons 51 to 53 displayed on the screen shown in Fig. 11. Note that such change buttons can also display marks other than numbers, or can display reduced versions of the character objects themselves.
[0062] The broadcast user's action may be an action that can be recognized as a change instruction by the facial capture function, such as winking three times.
[0063] The broadcast user's voice can be a voice that can be recognized as a change instruction using a voice recognition function, such as "change."
[0064] Alternatively, whether the predetermined condition is satisfied can be determined based on whether the number of giftings by the viewing user is equal to or greater than a predetermined number. The viewing user can perform a gifting operation on the video via the viewing user terminal. The number of giftings may be tallied, and when the number of giftings is equal to or greater than a predetermined number, the character object may be changed.
[0065] Alternatively, whether or not the predetermined condition is satisfied may be determined based on whether or not the number of viewing users is equal to or greater than a predetermined number.
[0066] The movement and voice of the viewing user can be obtained from information input directly or indirectly from the viewing user terminal. For example, the movement and voice of the viewing user may be obtained from a microphone of the viewing user terminal, glasses worn by the viewing user, a penlight carried by the viewing user, or the like, and the character object may be changed when a predetermined condition is satisfied.
[0067] As described above, when the character object is changed based on the viewing user's information, it is possible to further increase the viewing user's motivation to watch videos and give gifts.
[0068] Before distributing a video, a display screen is displayed for the broadcasting user on which at least a character object, a first GUI, and a second GUI are displayed, the first GUI is a GUI for starting the distribution of the video, the second GUI is a GUI for starting the display of a list screen of body parts and attached parts, and the list screen can be displayed superimposed on at least a portion of the display screen.
[0069] An example of such a GUI is shown in Fig. 7. The first GUI corresponds to a video distribution start button 36, and the second GUI corresponds to a closet button 37. Note that the locations of these GUIs are not limited to those shown in the figure, and can be set appropriately in consideration of the convenience of the distribution user.
[0070] An example of the list screen is shown in Fig. 12. Displaying the list screen 61 superimposed on at least a part of the display screen 60 in this manner is convenient because it allows the user to see each part while viewing the character object. It is preferable to make the list screen transparent so that the character object can be seen even when superimposed on the character object CO.
[0071] Also, as shown in FIG. 12 , the list screen 61 includes a third GUI 62 and a fourth GUI 63, the third GUI 62 being a GUI that shows categories of body parts and attachment parts and allows the display content to be slid in a predetermined first direction X, and the fourth GUI 63 being a GUI that shows body parts and attachment parts belonging to each category and allows the display content to be slid in a second direction Y different from the first direction X.
[0072] 12, the first direction X is the horizontal direction of the screen, and the second direction Y is the vertical direction of the screen, but the second direction Y may be the horizontal direction of the screen, and the first direction X may be the vertical direction of the screen. This setting may be determined using the function of a tilt sensor provided in broadcast user terminal 300 to determine the orientation of the screen, and may be automatically changed to provide a more convenient display.
[0073] 13, a third GUI 62 may be displayed in a superimposed manner on the display screen 60, and when a predetermined distribution user operation is performed on the third GUI 62, a fourth GUI 63 may be further displayed in a superimposed manner on the display screen 60. Furthermore, by performing an operation of pulling the third GUI 62 upward, the fourth GUI 63 may be displayed over the entire display screen 60, as shown in FIG.
[0074] With this configuration, the fourth GUI 63 can be easily displayed / hidden.
[0075] Next, the details of the facial expression analysis unit 310 that realizes the facial capture function will be described. The facial expression analysis unit 310 analyzes an image of the broadcast user's face captured by the camera of the broadcast user terminal 300, and analyzes the broadcast user's facial expression. This method is not particularly limited, and may use technology already known at the time of filing of this application, or may use new technology developed in the future.
[0076] Furthermore, regardless of whether distribution of the video has started or not, at least the facial portion of the character object displayed on the display screen can be captured as the facial portion of the distributor user.
[0077] As an example, after the first launch of the distribution app, when a character object is displayed on the screen, the distribution user's facial expression is always shown on the character object's face.
[0078] According to this configuration, the broadcasting user is made strongly aware that the character object is an avatar of the broadcasting user, and high quality acts can be realized when broadcasting videos.
[0079] However, even before a video is distributed, while the list screen is being displayed, at least the facial portion of the character object displayed on the display screen may be configured so that the facial portion of the distributor user is not captured.
[0080] This is because, while creating a character object, that is, while specifying body parts, there is a risk that the user will not be able to pay attention to his or her own facial expressions.
[0081] Furthermore, even when a video is being distributed, while a character object included in the video is being changed from one character object to another character object associated with another slot among a plurality of slots, at least the facial portion of the character object displayed on the display screen can be made to not capture the facial portion of the distribution user.
[0082] According to this configuration, the processing load associated with the change process can be taken into consideration and the processing load due to facial capture can be eliminated. During this change, it is preferable to generate the above-mentioned dramatic effect, which has a light processing load, instead of facial capture.
[0083] Next, the hardware configurations of server device 200, distributor user's terminal 300 and viewer user's terminal 400 will be described with reference to FIG.
[0084] 15, the broadcast user terminal 300 includes a processor 301, a memory 302, a storage 303, an input / output interface (input / output I / F) 304, and a communication interface (communication I / F) 305. The components are connected to each other via a bus B.
[0085] The broadcast user terminal 300 realizes the functions and methods described in this embodiment through cooperation between a processor 301, a memory 302, a storage 303, an input / output I / F 304, and a communication I / F 305.
[0086] The processor 301 executes functions and / or methods realized by codes or instructions included in a program stored in the storage 303. The processor 301 includes, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may realize each process disclosed in each embodiment by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large scale integration (LSI)), etc.). These circuits may be realized by one or more integrated circuits, and a plurality of processes shown in each embodiment may be realized by one integrated circuit. An LSI may also be called a VLSI, a super LSI, an ultra LSI, etc., depending on the degree of integration.
[0087] The memory 302 temporarily stores the programs loaded from the storage 303 and provides a working area for the processor 301. The memory 302 also temporarily stores various data generated while the processor 301 is executing the programs. The memory 302 includes, for example, a random access memory (RAM) and a read only memory (ROM).
[0088] The storage 303 stores programs. The storage 303 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, and the like.
[0089] The communication I / F 305 is implemented as hardware such as a network adapter, communication software, or a combination of these, and transmits and receives various data via a network. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as the communication between the two devices can be performed. The communication I / F 305 communicates with other information processing devices via the network. The communication I / F 305 transmits various data to the other information processing devices according to instructions from the processor 301. The communication I / F 305 also receives various data transmitted from the other information processing devices and transmits the data to the processor 301.
[0090] Input / output I / F 304 includes an input device for inputting various operations to broadcast user terminal 300, and an output device for outputting processing results processed by broadcast user terminal 300. Input / output I / F 304 may be an integrated input device and output device, or may be separate input device and output device.
[0091] The input device is realized by any one or a combination of all kinds of devices that can receive input from a broadcasting user and transmit information related to the input to the processor 301. The input device includes, for example, a touch panel, a touch display, hardware keys such as a keyboard, a pointing device such as a mouse, a camera (operation input via an image), and a microphone including an audio output device (operation input by voice).
[0092] The output device outputs the results of processing by the processor 301. The output device includes, for example, a display and a speaker.
[0093] Note that the server device 200 and the viewing user's terminal 400 have the same configuration as the distributor user's terminal 300 described above, so illustration and description thereof will be omitted.
[0094] Next, a video distribution process according to one aspect will be described with reference to Fig. 16 and Fig. 17. Fig. 16 is a flow diagram showing the flow of a video distribution process in one embodiment, and Fig. 17 is a flow diagram showing the flow of a process for displaying another character object in one embodiment.
[0095] First, in step S11, face motion data that is a digital representation of the facial movement (expression) of the broadcast user is generated. This step is executed by the expression analysis unit 310.
[0096] Next, in step S12, an animation of a character object that moves in synchronization with the facial expression movement of the broadcast user is generated based on the facial motion data of the broadcast user. This step is executed by the generation unit 320.
[0097] Next, in step S13, a video including an animation of a character object corresponding to the broadcast user is generated. The broadcast user's voice may be synthesized into this video. The animation of the character object may be placed in a virtual space. This step is executed by the generation unit 320.
[0098] Next, the process proceeds to step S14, where the video generated in step S13 is distributed. This video is distributed to the viewing user terminal via a network. The video is continuously distributed for a predetermined distribution period. The distribution period of the video can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, or any other time. This step is executed by the video distribution unit 340.
[0099] Next, the process proceeds to step S15, where it is determined whether or not a termination condition for terminating the distribution of the video has been met. The termination condition is, for example, a condition such as the end time of the distribution being reached. If the termination condition has not been met, the processes of steps S11 to S14 are repeatedly executed, and the distribution of the video including animation synchronized with the movements of the broadcasting user is continued. If it is determined that the termination condition for the video has been met, the distribution process of the video is terminated.
[0100] Next, the process of changing a character object performed during distribution of a moving image will be described with further reference to Fig. 17. The process of changing a character object is performed in parallel with the process of distributing a moving image shown in Fig. 16.
[0101] During distribution of a moving image, in step S21, it is determined whether or not a request for changing a character object has been made.
[0102] When a request to change the character object is made, the display process proceeds to step S22. In step S22, a process is performed to display the other character object requested to be displayed in the video being distributed based on the request to change the character object.
[0103] If no change request has been made for the character object, no change processing is performed.
[0104] Next, a video distribution method according to an embodiment of the present invention will be described.
[0105] The moving image distribution method of the present invention is a moving image distribution method for distributing moving images including animation of a character object generated based on the movement of an actor, and includes the following steps 110 to 130.
[0106] Step 110 accepts the setting of a plurality of slots, each of which is associated with a character object composed of one or more body parts and one or more wearable parts, by an operation of the broadcast user. This step 110 can be executed by the above-mentioned reception unit 330.
[0107] Step 120 distributes a video including an animation of one character object associated with one slot among the multiple slots, which is specified by an operation of the distributor user. This step 120 can be executed by the facial expression analysis unit 310, the generation unit 320, and the video distribution unit 340 described above.
[0108] Then, the step 120 is characterized in that, when a predetermined condition is satisfied during the distribution of the video, a character object included in the video is changed from one character object to another character object associated with another slot among the multiple slots (step 130). Such a step 120 can be executed by the above-mentioned change unit 350.
[0109] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Also, according to the video distribution system, video distribution method, and video distribution program of the present invention, it is possible to change a character object to another character object without reducing the actor's concentration on the act.
[0110] Finally, a video distribution program according to an embodiment of the present invention will be described.
[0111] The video distribution program of the present invention is a video distribution program for distributing video including animation of a character object generated based on the movement of an actor, and causes one or more computer processors to realize the following steps 110 to 130.
[0112] Step 110 accepts the setting of a plurality of slots, each of which is associated with a character object composed of one or more body parts and one or more wearable parts, by an operation of the broadcast user. This step 110 can be executed by the above-mentioned reception unit 330.
[0113] Step 120 distributes a video including an animation of one character object associated with one slot among the multiple slots, which is specified by an operation of the distributor user. This step 120 can be executed by the facial expression analysis unit 310, the generation unit 320, and the video distribution unit 340 described above.
[0114] Then, the step 120 is characterized in that, when a predetermined condition is satisfied during the distribution of the video, a character object included in the video is changed from one character object to another character object associated with another slot among the multiple slots (step 130). Such a step 120 can be executed by the above-mentioned change unit 350.
[0115] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Also, according to the video distribution system, video distribution method, and video distribution program of the present invention, it is possible to change a character object to another character object without reducing the actor's concentration on the act.
[0116] The embodiment of the present invention is not limited to the above-mentioned embodiment, and various modifications are possible within the scope of the gist of the present invention. In the above-mentioned example, it is assumed that the distribution user distributes a video using his / her own smartphone at home, but it is also applicable to the case where a video is distributed in a distribution studio. In that case, a character object in which not only the face but also the body is motion captured is created and used. In addition, the instruction to change the character object may be given not only by the distribution user but also by an assistant.
[0117] In addition, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-described embodiment. Such an information processing device can be realized by storing a program describing the processing contents for realizing each function of the server device or terminal device according to the embodiment in a storage unit of the information processing device, and reading and executing the program by a CPU of the information processing device.
[0118] As described above, the satisfaction of specified conditions in the video distribution function is determined based on at least one of the operations, actions, and voices of the distribution user and / or viewing user, but the content of such specified conditions may be predetermined or may be set by the distribution user.
[0119] In particular, as an example of a setting screen is shown in Figure 18, the broadcasting user may be able to set the contents of specified conditions for each slot from pull-down options such as "voice recognition," "comments," "gestures," "number of comments," and "number of giftings."
[0120] This setting can be performed before or after the start of distribution, when the distribution is paused. Pausing after distribution has started is performed by selecting the pause button shown as an example in FIG. 19.
[0121] When "voice recognition" is selected, the broadcasting user can record and register any voice. In this case, the satisfaction of the predetermined condition is that the matching rate between the voice uttered by the broadcasting user and the registered voice is equal to or greater than a predetermined value. More specifically, by checking the matching rate between the voice uttered within a predetermined period of time and the registered voice, it is determined whether the matching rate is equal to or greater than a predetermined value.
[0122] When "comment" is selected, the broadcast user can register a specific word in text. In this case, the predetermined condition is satisfied when the viewing user comments on the registered word.
[0123] When "number of comments" is selected, the broadcasting user can register the number of comments. In this case, the predetermined condition is met when the total number of comments from the viewing users exceeds the registered number.
[0124] When "number of giftings" is selected, the broadcast user can register the number of giftings. In this case, the predetermined condition is met when the total number of gifts from viewing users exceeds the registered number.
[0125] In addition, these configurations make it possible to change character objects without displaying an operation GUI for the broadcasting user, which can be difficult to display because the screens displayed on the broadcasting user's side and the viewing user's side are the same during video broadcasting.
[0126] Furthermore, in the live video streaming application realized by the present invention, the visual appearance of the character object (avatar) can be changed by satisfying conditions unique to live streaming during streaming, thereby improving the realism of the streaming and increasing the interest of the application.
[0127] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims.
[0128] The method described in the embodiment can be stored as a program that can be executed by a calculator (computer) on a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), or a semiconductor memory (ROM, RAM, flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium side also includes a setting program that configures software means (including not only execution programs but also tables and data structures) that the computer executes. The computer that realizes this device reads the program recorded on the recording medium, and in some cases, configures the software means by the setting program, and executes the above-mentioned processing by controlling the operation of the software means. The recording medium referred to in this specification is not limited to a storage medium for distribution, but also includes a storage medium such as a magnetic disk or semiconductor memory provided inside the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. [Additional Notes] The inventions described in the claims of the original application immediately prior to division are set forth below. [1] A video distribution system that distributes information about a video including animation of a character object generated based on the movement of an actor, the system comprising one or more computer processors, The one or more computer processors execute the computer readable instructions to: A function for accepting settings of a plurality of slots, each of which corresponds to a character object consisting of one or more body parts and one or more attachment parts, by an operation of a broadcasting user; a function of distributing information about a moving image including an animation of one character object associated with one slot among the plurality of slots, the slots being specified by an operation of the distribution user; Realize this, A video distribution system in which the function of distributing information about the video changes a character object included in the video from the one character object to another character object associated with the other slot when a predetermined condition set for another slot among the multiple slots is satisfied during distribution of the video. [2] The video distribution system of claim 1, wherein the specified condition is that a comment is posted that includes a specific word set in the other slot. [3] The video distribution system according to claim 2, characterized in that different specific words are set as the specified conditions for each of the multiple slots. [4] The video distribution system according to claim 1, wherein the specified condition is that the distribution user utters a specific voice set in the other slot. [5] The video distribution system of claim 1, wherein the specified condition is that the total number of comments posted on the video exceeds a specific number set for the other slots. [6] The video distribution system of claim 1, wherein the specified condition is that the total number of giftings for the video exceeds a specific number set for the other slots. [7] The video distribution system according to any one of claims 1 to 6, characterized in that the function of accepting settings further accepts settings of predetermined conditions for each of the plurality of slots. [8] A video distribution system as described in any one of claims 1 to 7, characterized in that the function of distributing information regarding the video automatically changes a character object included in the video from the one character object to another character object associated with another slot among the multiple slots when a predetermined condition is met during the distribution of the video. [9] The one or more computer processors further include: 9. The video distribution system according to claim 8, further comprising an effect generating function for generating a predetermined dramatic effect when the change is made.
[10] The video distribution system of claim 9, characterized in that even during distribution of the video, while a character object included in the video is being changed from the one character object to another character object associated with another slot among the multiple slots, at least the facial portion of the character object included in the video is not captured, and the facial portion of the distribution user is not captured, and the specified dramatic effect is generated by the effect generation function.
[11] A display screen on which at least a character object, a first GUI, and a second GUI are displayed is displayed on a screen for a distributor user before the video is distributed; the first GUI is a GUI for starting distribution of the video, the second GUI is a GUI for starting to display a list screen of the body parts and the attachment parts, 11. The video distribution system according to claim 1, wherein the list screen is displayed so as to be superimposed on at least a part of the display screen.
[12] The list screen includes a third GUI and a fourth GUI; the third GUI is a GUI that indicates categories of the body parts and the attachment parts and is capable of sliding display content in a predetermined first direction; The video distribution system of claim 11, characterized in that the fourth GUI is a GUI that indicates the body parts and the attachment parts that belong to each of the categories and is capable of sliding the display content in a second direction different from the first direction.
[13] The third GUI is displayed in a superimposed manner on the display screen; 13. The video distribution system according to claim 12, wherein when a predetermined distributor user operation is performed on the third GUI, the fourth GUI is further superimposed and displayed on the display screen.
[14] A video distribution method for distributing information about a video including an animation of a character object generated based on the movement of an actor, comprising: receiving settings of a plurality of slots, each of which is associated with a character object constituted by one or more body parts and one or more wearable parts, through an operation by a broadcasting user; a step of distributing information on a moving image including an animation of one character object associated with one slot among the plurality of slots, the one being specified by an operation of the distributor user; Equipped with The step of distributing information about the video includes changing a character object included in the video from the one character object to another character object associated with another slot when a predetermined condition set for another slot among the plurality of slots is satisfied during distribution of the video.
[15] A video distribution program for distributing information about a video including an animation of a character object generated based on the movement of an actor, comprising: one or more computer processors, receiving settings of a plurality of slots, each of which is associated with a character object constituted by one or more body parts and one or more wearable parts, through an operation by a broadcasting user; a step of distributing information on a moving image including an animation of one character object associated with one slot among the plurality of slots, the one being specified by an operation of the distributor user; Realize this, The video distribution program includes a step of distributing information about the video, when a predetermined condition set for another slot among the plurality of slots is satisfied during distribution of the video, changing a character object included in the video from the one character object to another character object associated with the other slot among the plurality of slots. [Explanation of symbols]
[0129] 100 Video distribution system 200 Server device 300 Distribution user terminal 400 Viewing user terminal 310 Facial expression analysis section 320 Generation part 330 Reception 340 Video Distribution Department 350 Changes
Claims
1. one or more computer processors; The one or more computer processors execute the computer readable instructions to: a function of generating information about a moving image in which one character object designated by an operation of a first user from among a plurality of character objects prepared by the first user, the one character object reflecting a movement of the first user, is displayed; a function of performing a change process of changing a character object displayed in the video from the one character object to another character object among a plurality of character objects prepared by the first user based on an instruction from the first user during distribution of the video; An information processing system that makes this possible.
2. one or more computer processors; The one or more computer processors execute the computer readable instructions to: a function of generating information about a moving image in which one character object designated by an operation of a first user from among a plurality of character objects prepared by the first user, the one character object reflecting a movement of the first user, is displayed; a function of performing a change process for changing a character object displayed in the video from the one character object to another character object among a plurality of character objects prepared by the first user when a predetermined condition is satisfied; Make it happen, An information processing system, wherein the predetermined condition is that a comment is posted that includes a specific word set to display the other character object.
3. The one or more computer processors execute the computer readable instructions to further: The information processing system according to claim 1 , further comprising: a performance function for generating a predetermined performance on the video while the change process is being performed.
4. The information processing system according to claim 1 or 2, characterized in that while the change process is being performed, the facial movements of the first user are not reflected in at least the facial portion of the character object displayed in the video.
5. The one or more computer processors execute the computer readable instructions to further:
3. The information processing system according to claim 1, further comprising a function for performing a reflection process for reflecting the movement of the first user on the other character object.
6. 3. The information processing system according to claim 1, wherein the one character object and the other character object have at least one different body part.
7. a change object for changing the character object is displayed in the video displayed on a first user terminal of the first user; the instruction from the first user is given by an operation of the first user on the change object, 2. The information processing system according to claim 1, wherein the change object is an object in which text or a symbol is represented.
8. a change object for changing the character object is displayed in the video displayed on a first user terminal of the first user; the instruction from the first user is given by an operation of the first user on the change object, 2. The information processing system according to claim 1, wherein the changed object is a reduced image of a character object other than the one character object among a plurality of character objects prepared by the first user.
9. The information processing system according to claim 1 or 2, characterized in that the information processing system transmits information for displaying a moving image including an animation of a character object generated based on the movement of the first user to a second user terminal of a second user.
10. The one or more computer processors execute the computer readable instructions to further: The information processing system according to claim 1, characterized in that it realizes a function of accepting the setting of a plurality of slots, each of which is associated with a character object composed of one or more body parts and one or more wearable parts, through operation of the first user.
11. 11. The information processing system according to claim 10, wherein the designation of the one character object by the operation of the first user is designation of one of the plurality of slots.
12. a display screen on which at least a character object, a first GUI, and a second GUI are displayed on a screen for a first user before the video is distributed; the first GUI is a GUI for starting distribution of the video, the second GUI is a GUI for starting to display a list screen of one or more body parts and one or more attachment parts; 3. The information processing system according to claim 1, wherein the list screen is displayed so as to be superimposed on at least a part of the display screen.
13. the list screen includes a third GUI and a fourth GUI, the third GUI is a GUI that indicates categories of the body parts and the attachment parts and is capable of sliding display content in a predetermined first direction; The information processing system described in claim 12, characterized in that the fourth GUI is a GUI that shows the body parts and the attachment parts belonging to each category and is capable of sliding the display content in a second direction different from the first direction.
14. the third GUI is displayed in a superimposed manner on the display screen, 14. The information processing system according to claim 13, wherein when the first user performs a predetermined operation on the third GUI, the fourth GUI is further superimposed and displayed on the display screen.
15. one or more computer processors, generating information about a moving image in which one character object designated by an operation of a first user from among a plurality of character objects prepared by the first user, the one character object reflecting a movement of the first user, is displayed; performing a change process for changing a character object displayed in the video from the one character object to another character object among a plurality of character objects prepared by the first user based on an instruction from the first user during distribution of the video; A method of processing information.
16. one or more computer processors, generating information about a moving image in which one character object designated by an operation of a first user from among a plurality of character objects prepared by the first user, the one character object reflecting a movement of the first user, is displayed; performing a change process for changing a character object displayed in the video from the one character object to another character object among a plurality of character objects prepared by the first user when a predetermined condition is satisfied; Run it, An information processing method, wherein the predetermined condition is that a comment is posted that includes a specific word set to display the other character object.
17. one or more computer processors, a function of generating information about a moving image in which one character object designated by an operation of a first user from among a plurality of character objects prepared by the first user, the one character object reflecting a movement of the first user, is displayed; a function of performing a change process of changing a character object displayed in the video from the one character object to another character object among a plurality of character objects prepared by the first user based on an instruction from the first user during distribution of the video; A computer program that makes things happen
18. one or more computer processors, a function of generating information about a moving image in which one character object designated by an operation of a first user from among a plurality of character objects prepared by the first user, the one character object reflecting a movement of the first user, is displayed; a function of performing a change process for changing a character object displayed in the video from the one character object to another character object among a plurality of character objects prepared by the first user when a predetermined condition is satisfied; Make it happen, The computer program, wherein the predetermined condition is that a comment is posted that includes a specific word that is set to display the other character object.
Citation Information
Patent Citations
Photosensitive body
JP1988082468A
Manufacture of monohalogenated cyclobutalene
JP1989063535A
Method and system for registering avatar
JP2002008062A
Image distribution system, server, its method, and program
JP2010028385A
Information processing system, program and information processing device
JP2010177939A
