Information processing system, information processing method, and computer program

Abstract

To increase the motivation of a delivery user regarding delivery, the motivation of a viewing user regarding viewing and / or the motivation of the users to communicate with each other.SOLUTION: An information processing system is equipped with one or more computer processors, the one or more computer processors including: a receiving unit which receives at least voice information on voice of a first user transmitted from a first user terminal of the first user; a transmission unit which transmits information for causing the first user terminal and / or a second user terminal of a second user to display a video on the first user, to the first user terminal and / or the second user terminal; an analysis unit which analyzes, based on the voice information, whether a specific word is included in the voice; and a display control unit which controls, according to a result analyzed by the analysis unit, display of the video on the basis of display control information associated with the specific word included in the voice.SELECTED DRAWING: Figure 26

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and a computer program.

Background Art

[0002] There is known an information processing system that generates an animation of a character object based on the movement of an actor and distributes a video including such an animation of the character object (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In this technical field, how to improve the distribution motivation of distribution users, the viewing motivation of viewing users, and / or the communication motivation between users is an important issue.

[0005] An object of the present disclosure is to provide a technical improvement that solves or alleviates at least some of the problems of the above-described conventional technologies.

[0006] One more specific object of the present disclosure is to provide an information processing system, an information processing method, and a computer program that can improve the distribution motivation of distribution users, the viewing motivation of viewing users, and / or the communication motivation between users.

Means for Solving the Problems

[0007] The information processing system in the present disclosure is an information processing system including one or more computer processors. The one or more computer processors include a receiving unit configured to receive voice information related to at least the voice of a first user transmitted from a first user terminal of the first user, a transmitting unit configured to transmit information for causing a video related to the first user to be displayed on the first user terminal and / or a second user terminal of a second user, an analyzing unit configured to analyze whether a specific word is included in the voice information, and a display control unit configured to control the display of the video based on display control information associated with the specific word included in the voice information according to the result analyzed by the analyzing unit.

[0008] The specific word is a word related to an action that requires an operation on the first user terminal, and the display control information can be information for causing an operation object associated with the action to appear on the video or the screen of the first user terminal, highlighting and displaying the operation object associated with the action that is displayed on the video or the screen of the first user terminal, and / or displaying an operation screen associated with the action.

[0009] The specific word is a word related to an action that requires an operation on the second user terminal, and the display control information can be information for causing an operation object associated with the action to appear on the video or the screen of the second user terminal, highlighting and displaying the operation object associated with the action that is displayed on the video or the screen of the second user terminal, and / or displaying an operation screen associated with the action.

[0010] When the specific word is a word related to an action that requires an operation on the first user terminal, the display control unit controls the display of the video displayed on the first user terminal and the second user terminal. When the specific word is a word related to an action that requires an operation on the second user terminal, the display control unit can control the display of the video displayed only on the second user terminal.

[0011] One or more computer processors may further include an effect generating unit that generates a specific effect in the first user terminal and / or the second user terminal when an action is executed by selecting an operation object that appears or is highlighted in the video.

[0012] The specific word is a word related to the request, and the display control information may be information for causing an object associated with the request to appear in the video and / or information for highlighting and displaying an object displayed in the video.

[0013] The object associated with the request can be a lottery object that can obtain a real product and / or a product object by lottery, a shop object representing a shop where a real product and / or a product object can be purchased, or an advertisement object for representing an advertisement related to a real product and / or a product object.

[0014] One or more computer processors may include an ordering unit that, when a winning of a real product is determined by an operation on a lottery object in the first user terminal, or when a real product is ordered in the first user terminal via a shop object and / or an advertisement object, transmits information related to the winning or the order and address information of the first user included in at least the user information of the first user to an information processing device of a physical store associated with the lottery object, the shop object, and / or the advertisement object.

[0015] When a real product is ordered in the first user terminal via a shop object and / or an advertisement object, the display control unit can display a product object corresponding to the real product in the video.

[0016] A specific word is a word related to a specific item, and one or more computer processors further include a determination unit that determines whether the specific item is associated with a first user terminal. When the determination unit determines that the specific item is associated with the first user terminal, the display control unit is configured to display information for causing a specific object corresponding to the specific item to appear in the video, information for highlighting and displaying the specific object displayed in the video, and / or information for displaying a list screen of items associated with the first user terminal that includes the specific item. Based on the display control information, the display of the video can be controlled.

[0017] When the determination unit determines that the specific item is not associated with the first user terminal, the display control unit is configured to display information for causing a lottery object that can be obtained by lottery for the specific item, a shop object representing a shop where the specific item can be purchased, or an advertisement object representing an advertisement related to the specific item to appear in the video, and / or information for highlighting and displaying the lottery object, shop object, and / or advertisement object displayed in the video. Based on the display control information, the display of the video can be controlled.

[0018] When the determination unit determines that the specific item is not associated with the first user terminal, the display control unit can control the video based on the display control information, which is information for causing a lead to a screen related to a user terminal of another user having the specific item to appear in the video.

[0019] The specific word is a word related to an event in the real space, and the display control information can be information for causing a real object associated with the event in the real space to appear in the video.

[0020] The specific word is a word included in specific text displayed in the video, and the display control unit can highlight and display the specific text.

[0021] Specific text can be a comment posted from the first user terminal or the second user terminal, or a system comment.

[0022] Highlighting can include displaying an object related to the character object of the user who posted the comment.

[0023] The video can display the character object of the first user and the virtual space in which the character object can move.

[0024] When the second user terminal is associated with the first user terminal, at least a part of the virtual space is shared with the second user terminal, and the effect of controlling the display of the video by the display control unit can extend to both the first user terminal and the second user terminal.

[0025] When the second user terminal is not associated with the first user terminal, at least a part of the virtual space is shared with the second user terminal, but the effect of controlling the display of the video by the display control unit can extend to only one of the first user terminal and the second user terminal.

[0026] One or more computer processors can include a setting unit that can set whether to control the display of the video according to the result analyzed by the analysis unit.

[0027] The first user can be a distributing user, and the second user can be one or more viewing users.

[0028] The receiving unit receives a plurality of pieces of voice information regarding the voices of a plurality of users transmitted from a plurality of user terminals including the first user terminal, the analysis unit analyzes whether each of the plurality of voices contains a specific word, and the display control unit can control the display of the video based on the display control information associated with the specific word included in the voice and the number of voices containing the specific word.

[0029] A specific word can be set based on the operation of the first user terminal.

[0030] The receiving unit receives operation information regarding the operation of the first user transmitted from the first user terminal, and in the video, a character object of the first user who operates based on the operation information can be displayed.

[0031] The information processing method in the present disclosure causes one or more computer processors to execute a receiving step of receiving voice information regarding at least the voice of the first user transmitted from the first user terminal of the first user, a transmitting step of transmitting information for displaying a video regarding the first user to the first user terminal and / or the second user terminal of the second user, an analyzing step of analyzing whether a specific word is included in the voice based on the voice information, and a display control step of controlling the display of the video based on display control information associated with the specific word included in the voice according to the result analyzed in the analyzing step.

[0032] The information processing method in the present disclosure causes one or more computer processors to execute a transmitting step of transmitting voice information regarding at least the voice of the first user to a server device, a receiving step of receiving information for displaying a video regarding the first user from the server device, and a display control step of controlling the display of the video based on display control information associated with a specific word included in the voice according to the result of analyzing whether the specific word is included in the voice based on the voice information.

[0033] The computer program in the present disclosure causes one or more computer processors to have a transmission function of transmitting voice information regarding the voice of at least a first user to a server device, a reception function of receiving, from the server device, information for displaying a video regarding the first user, and a display control function of controlling the display of the video based on display control information associated with a specific word included in the voice according to the result of analyzing whether the voice includes the specific word based on the voice information.

[0034] The information processing method in the present disclosure causes one or more computer processors to execute a reception step of receiving, from the server device, information for displaying a video regarding the first user, and a display control step of controlling the display of the video based on display control information associated with a specific word included in the voice according to the result of analyzing whether the voice includes the specific word based on at least the voice information regarding the voice of the first user.

[0035] The computer program in the present disclosure causes one or more computer processors to have a reception function of receiving, from the server device, information for displaying a video regarding the first user, and a display control function of controlling the display of the video based on display control information associated with a specific word included in the voice according to the result of analyzing whether the voice includes the specific word based on at least the voice information regarding the voice of the first user.

Advantages of the Invention

[0036] According to the present disclosure, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the above-described conventional technologies. Specifically, according to the configuration of the present disclosure, it is possible to improve the distribution motivation of the distributing user, the viewing motivation of the viewing user, and / or the communication motivation between users.

Brief Description of the Drawings

[0037]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Figure 42

Embodiments for Carrying Out the Invention

[0038] First, an overview of the information processing system according to the embodiments of the present disclosure will be described with reference to the drawings.

[0039] The information processing system in the present disclosure is an information processing system including one or more client devices and a server device, and includes one or more computer processors.

[0040] The video displayed on each client device will be described as including animations of 3D or 2D character objects generated based on the movements of the distribution user, but it is not limited to this. It may also include animations of character objects generated according to the operations of the distribution user, or may include the image of the distribution user himself / herself. Further, these character objects and the distribution user may not be displayed, and it may only include the voice of the distribution user.

[0041] Here, the distributing user shall mean the user on the side that transmits information regarding video and / or audio. For example, the distributing user may be a user who distributes videos alone, a collaborative distribution in which multiple people can participate, a video chat or voice chat in which multiple people can participate and / or watch, a user who hosts or holds an event (such as a party) in a virtual space in which multiple people can participate and / or watch, that is, a user who mainly executes these. Therefore, the distributing user in the present disclosure can also be referred to as a host user, a sponsoring user, or a hosting user, etc.

[0042] On the other hand, the viewing user shall mean the user on the side that receives information regarding video and / or audio. However, the viewing user can be a user who not only receives the above information but can also react. For example, the viewing user may be a user who watches a video distribution, a collaborative distribution, or a user who participates in and / or watches a video chat, a voice chat, or an event. Therefore, the viewing user in the present disclosure can also be referred to as a guest user, a participating user, a listener, a viewing user, a cheering user, etc.

[0043] In addition, the information processing system in the embodiment of the present disclosure is a digital world in which many people can participate simultaneously and freely conduct activities at a level close to the real world, such as communication, work, and play through character objects (avatars), and can be used to provide the following Internet space (metaverse) in which social activities can transcend the gap between reality and virtuality.

[0044] In such a space, the avatars of the users can freely walk around in the world and communicate with each other.

[0045] Moreover, one of the plurality of avatars (character objects) in such a virtual space may be configured to be able to distribute a video as the character object of the distributing user. That is, it may be possible to perform one-to-many video distribution in a multi-to-multi metaverse virtual space.

[0046] In such a space, the distributing user and the viewing user may not be particularly distinguished.

[0047] Also, the space represented in the video may be a virtual space, a real space, or an extended reality space in which these are combined. Also, the video may be, for example, a karaoke video or a game live video that reproduces at least predetermined video and the voice of the distributing user, or may be one in which a character object or a real image of the distributing user is superimposed and displayed on these.

[0048] Also, when the distributing user is included in the real space, a character object generated based on the movement of the distributing user may be superimposed and displayed on the real image of the distributing user. Also, an animation such as a gift object may be superimposed and displayed on the captured image of the real space.

[0049] <System Configuration> As shown as an example in FIG. 1, the information processing system 1000 according to the present disclosure can include one or more viewing user terminals 1100 and an information processing device (support computer) 1300 arranged in a video distribution studio or the like, which is connected to these viewing user terminals 1100 via a network 1200.

[0050] Also, the information processing device 1300 may be connected to a predetermined server device via the Internet, and part or all of the processing to be performed by the information processing device 1300 may be performed by the server device. Note that such a server device may be the information processing device 2400 shown in FIG. 2.

[0051] In this specification, the distribution by such an information processing system 1000 shall be referred to as studio distribution.

[0052] In studio distribution, the movements of the whole body of the distributing user (actor) are captured by a camera installed in the studio for the markers attached to the distributing user, and reflected in real time on the character using known motion capture technology.

[0053] Also, the information processing system 1000 of the present invention can cooperate with another information processing system 2000 shown as an example in FIG. 2. The information processing system 2000 shown in FIG. 2 can include a distributing user terminal 2100, one or more viewing user terminals 2200, and an information processing device (server device) 2400 connected to these distributing user terminal 2100 and viewing user terminals 2200 via a network 2300.

[0054] In the above example, the distributing user terminal 2100 can be an information processing terminal such as a smartphone. In this specification, the distribution by such an information processing system 2000 shall be referred to as mobile distribution.

[0055] In mobile distribution, the movements of the face of the distributing user are captured by a camera provided in the distributing user terminal 2100 for the face of the distributing user, and reflected in real time on the face of the character using known face tracking technology.

[0056] Note that there is no particular distinction between the distributing user and the viewing user in mobile distribution. The viewing user can always perform mobile distribution, and the distributing user can become a viewing user when viewing the videos of other distributing users.

[0057] The videos generated by the above information processing system 1000 and information processing system 2000 can be distributed to viewing users from a single video distribution platform as an example.

[0058] Also, in any of the distributions, processes such as generating animation by reflecting motion on a character and processes such as displaying gifts described later may be shared and performed by the distribution user terminal, the viewing user terminal, the information processing apparatus, and other apparatuses.

[0059] That is, "distribution" as used herein refers to transmitting information for enabling a video to be viewed on a viewing user's terminal, and the rendering of the video may be performed on the side of the information processing apparatuses 1300 and 2400, or may be performed on the side of the distribution user terminals 2100, and the viewing user terminals 1100 and 2200.

[0060] Specifically, the distribution user terminal or the information processing apparatus transmits the face motion data and voice data of the distribution user to the terminal or apparatus that generates (renders) the animation of the character object. Also, body motion may be transmitted in addition to the face motion.

[0061] In the present disclosure, the process of generating animation will be described as being performed on each of the distribution user terminal and the viewing user terminal, but it is not limited thereto.

[0062] And the information processing system in the present disclosure is applicable to any of the cases of the examples shown in FIGS. 1 and 2. Therefore, the information processing system 3000 in the embodiment of the present disclosure will be described as including a first user terminal 100, a second user terminal 200, and a server apparatus 400 that can be connected to these first user terminal 100 and second user terminal 200 via a network 300 as shown in FIG. 3.

[0063] The first user terminal 100 and the second user terminal 200 are interconnected with the server device 400 via, for example, a base station, a mobile communication network, a gateway, and the Internet. Communication between the first user terminal 100 and the second user terminal 200 and the server device 400 is performed based on a communication protocol such as the Hypertext Transfer Protocol (HTTP). Also, between the first user terminal 100 and the second user terminal 200 and the server device 400, a connection may first be established by HTTP communication, and then communication may be performed based on WebSocket, which is a two-way communication with a lower cost (less communication load and processing load) than HTTP communication. Note that the communication method between the first user terminal 100 and the second user terminal 200 and the server device 400 is not limited to the above-described method, and any communication method technology may be used as long as the present embodiment can be realized.

[0064] The first user terminal 100 functions at least as the above-described information processing device 1300 or distribution user terminal 2100, the second user terminal 200 functions at least as one or more of the above-described viewing user terminals 1100, 2200, and the server device 400 functions at least as the above-described predetermined server device or information processing device 2400.

[0065] In the present disclosure, the first user terminal 100 and the second user terminal 200 can be a smartphone (multifunctional telephone terminal), a tablet terminal, a personal computer, a console game machine, a head-mounted display (HMD), a wearable computer such as a glasses-type wearable terminal (AR glasses, etc.), and an information processing device capable of playing videos other than these devices. Also, these terminals may be stand-alone devices that operate independently, or may be composed of a plurality of devices connected so as to be able to transmit and receive various data to and from each other.

[0066] <Hardware Configuration> Here, with reference to FIG. 4, the hardware configuration of the first user terminal 100 will be described. The first user terminal 100 includes a processor 101, a memory 102, a storage 103, an input / output interface (input / output I / F) 104, and a communication interface (communication I / F) 105. Each component is interconnected via a bus B.

[0067] The first user terminal 100 can realize the functions and methods described in this embodiment through the cooperation of the processor 101, the memory 102, the storage 103, the input / output I / F 104, and the communication I / F 105.

[0068] The processor 101 executes functions and / or methods realized by code or instructions included in a program stored in the storage 103. The processor 101 includes, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may realize each process disclosed in each embodiment by a logic circuit (hardware) formed in an integrated circuit (IC (Integrated Circuit) chip, large scale integration (LSI)) or a dedicated circuit. Further, these circuits may be realized by one or more integrated circuits, and it is also possible that a plurality of processes shown in each embodiment are realized by one integrated circuit. Also, LSI may be referred to as VLSI, super LSI, ultra LSI, etc. depending on the degree of integration.

[0069] Memory 102 temporarily stores the program loaded from storage 103 and provides a working area for processor 101. Memory 102 also temporarily stores various data generated while processor 101 is executing the program. Memory 102 includes, for example, RAM (Random Access Memory), ROM (Read Only Memory), etc.

[0070] Storage 103 stores programs. Storage 103 includes, for example, HDD (Hard Disk Drive), SSD (Solid State Drive), flash memory, etc.

[0071] Communication I / F 105 is implemented as hardware such as a network adapter, communication software, or a combination thereof, and transmits and receives various data via network 300. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication can be executed. Communication I / F 105 executes communication with other information processing devices via network 300. Communication I / F 105 transmits various data to other information processing devices according to instructions from processor 101. Also, communication I / F 105 receives various data transmitted from other information processing devices and transmits them to processor 101.

[0072] Input / output I / F 104 includes an input device for inputting various operations to first user terminal 100 and an output device for outputting the processing results processed by first user terminal 100. Input / output I / F 104 may integrate the input device and the output device, or may separate the input device and the output device.

[0073] The input device is implemented by any one or a combination of all types of devices that can receive input from a user and transmit information related to the input to the processor 101. The input device includes, for example, hardware keys such as a touch panel, a touch display, a keyboard, a pointing device such as a mouse, a camera (operation input via an image), and a microphone (operation input by voice).

[0074] The input device can include a sensor unit. The sensor unit is one or more sensors that detect a face motion indicating a change in the user's expression and a body motion indicating a change in the relative position of the user's body with respect to the sensor unit. The face motion includes movements such as blinking and opening / closing of the mouth. Known sensors can be used for the sensor unit. An example of the sensor unit is a ToF sensor that measures and detects the time of flight from when light is irradiated toward the user until it is reflected back from the user's face or the like, a camera that captures the user's face, and an image processing unit that processes the data captured by the camera. Also, the sensor unit may include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. For the RGB camera and the near-infrared camera, for example, "True Depth" of "iphoneX (registered trademark)" or "LiDAR" of "iPad Pro (registered trademark)" or other ToF sensors mounted on smartphones can be used. Specifically, this camera projects tens of thousands of invisible dots (points) onto the user's face or the like by a dot projector. Then, the reflected light of the dot pattern is detected and analyzed to form a depth map of the face, and an infrared image of the face or the like is captured to capture accurate face data. The arithmetic processing unit of the sensor unit generates various types of information based on the depth map and the infrared image, compares the information with registered reference data, and calculates the depth of each point on the face (the distance between each point and the near-infrared camera) and the displacement at positions other than the depth.

[0075] In addition, the sensor unit may have a function of tracking (hand tracking) not only the user's face but also the user's hand. The sensor unit may further include sensors other than the above-mentioned sensors such as an acceleration sensor and a gyro sensor. The sensor unit may have a spatial mapping function of recognizing an object in the real space where the user exists based on the detection results of the above-mentioned ToF sensor and other known sensors and mapping the recognized object to a spatial map. Hereinafter, when explaining without particularly distinguishing the detection data of face motion and the detection data of body motion, it is simply referred to as "tracking data". Note that the image processing unit of the sensor unit may be provided with a control unit that the information processing system of the present invention can include.

[0076] As the operation unit as an input device, one corresponding to the type of the user terminal can be used. An example of the operation unit is a touch panel integrated with a display, operation buttons provided on the housing of the user terminal, a keyboard, a mouse, a controller operated by the user's hand, and the like. The controller may incorporate various known sensors such as inertial measurement sensors (IMU: Inertial Measurement Unit) such as an acceleration sensor and a gyro. Another example of the operation unit may be a tracking device that specifies the movement of the user's hand, the movement of the eyes, the movement of the head, the direction of the line of sight, and the like. In this aspect, for example, based on the movement of the user's hand, the user's instruction can be determined, and various operations such as starting or ending the distribution of a video, evaluating a message or a video, and requesting the display of a predetermined object (for example, a gift described later) can be executed. Note that when the sensor unit also has an input interface function such as a hand tracking function, the operation unit can be omitted.

[0077] The output device outputs the processing result processed by the processor 101. The output device includes, for example, a touch panel, a speaker, and the like.

[0078] Note that the functions realized by the components described in this specification may be implemented in circuitry or processing circuitry including a general-purpose processor, a specific-purpose processor, an integrated circuit, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), a conventional circuit, and / or a combination thereof, which are programmed to realize the described functions. A processor includes transistors and other circuits and is regarded as circuitry or processing circuitry. The processor may be a programmed processor that executes a program stored in a memory.

[0079] In this specification, circuitry, a unit, and a means are hardware programmed to realize the described functions or hardware that executes them. The hardware may be any hardware disclosed in this specification or any hardware known to be programmed or execute to realize the described functions.

[0080] When the hardware is a processor regarded as a type of circuitry, the circuitry, means, or unit is a combination of hardware and software used to configure the hardware and / or the processor.

[0081] Also, the second user terminal 200 and the server device 400 in the present disclosure can be configured with a hardware configuration similar to that of FIG. 4, except in cases where special mention is required.

[0082] Subsequently, various functions executable on a user terminal that has launched an application realized by the information processing system according to an embodiment of the present disclosure, and the transition of the displayed screens will be described with reference to the drawings.

[0083] Figure 5 shows the top screen T10 displayed on the user terminal (where it is not yet specified whether the user will watch / deliver) when the video delivery / viewing application is launched.

[0084] As shown in Figure 5, the user can watch the video played on a particular delivery channel by selecting one delivery channel (referred to as a delivery frame, a delivery program, a delivery video, etc.) from the thumbnail images of one or more recommended delivery channels T12 listed in the recommended tab T11 on the top screen T10.

[0085] Alternatively, the user can watch the video played on a particular delivery channel by accessing the fixed link of that particular delivery channel. Such a fixed link can be obtained from a notification from the first user being followed, or a share notification sent from another user.

[0086] In this way, the user who watches the video becomes the viewing user, and the terminal on which the video is watched becomes the second user terminal 200.

[0087] Also, as shown in Figure 5, a display column T13 for notifications such as campaigns and events may be displayed on the top screen T10. This display column T13 can be switched to display other notifications by a slide operation.

[0088] From the top screen T10, a follow tab T14, a game tab T15 for displaying game categories, a tab T16 for waiting for collaboration delivery channels, and a beginner tab T17 for displaying beginner delivery channels are displayed. By selecting these (by switching tabs), the top screen T10 transitions to different screens respectively.

[0089] Note that the service name display T18 and the search button T19 in the upper frame of the top screen T10 may remain fixed and displayed on the transition destination screen.

[0090] Similarly, the home button T20, message button T21, distribution preparation button T22, gacha button T23, and profile button T24 in the lower frame of the top screen T10 may also be fixedly displayed on the transition destination screen.

[0091] In the top screen T10 and the like shown in FIG. 5, a user who selects the thumbnail image T12 being displayed becomes a viewing user (second user) who views the video as described above, and a user who selects the distribution preparation button T22 can become a distribution user (first user) who distributes the video.

[0092] As an example, when the distribution preparation button T22 is selected on the top screen T10 shown in FIG. 5, the screen transitions to the avatar setting screen D10 shown in FIG. 6. Then, when the distribution button D11 is selected on the avatar setting screen D10, the screen transitions to the distribution setting screen D20 shown in FIG. 7. Then, when the distribution start button D25 is selected on the distribution setting screen D20, the screen transitions to the avatar distribution screen D30 shown in FIG. 8.

[0093] Subsequently, the details of the flow until the start of video distribution will be described.

[0094] One or more computer processors in the present disclosure can include a distribution start request receiving unit, a distribution setting unit, and a distribution start unit.

[0095] The distribution start request receiving unit receives a distribution start request for a first video including an animation of a character object from a first user terminal of a first user.

[0096] Here, the first video refers to a video including an animation of a character object. In this specification, the character object may sometimes be referred to as an "avatar".

[0097] Then, the above distribution start request can be transmitted from the user terminal to the server device 400 by selecting the distribution button D11 arranged on the avatar setting screen D10 or the like that has transitioned from the above-described top screen displayed on the user terminal (which will later become the first user terminal) that has launched a dedicated application (video distribution / viewing application) for accessing the above video distribution platform.

[0098] FIG. 6 shows an example of the avatar setting screen D10. On the avatar setting screen D10, a character object CO, a distribution button D11, a gacha button D12, a dressing button D13, a photo button D14, etc. can be displayed.

[0099] When the dressing button D13 is selected by the user, a closet screen for selecting various avatar parts such as the eyes, nose, mouth, hair, accessories, clothes, and background of the character object CO is expanded.

[0100] When the gacha button D12 is selected by the user, a lottery screen for obtaining the above avatar parts is expanded.

[0101] When the photo button D14 is selected by the user, a shooting screen for taking a still image of the character object is expanded.

[0102] Then, when the distribution button D11 is selected by the user, a distribution start request is transmitted to the server device 400.

[0103] The distribution setting unit sets the distribution setting of the first video according to the distribution start request of the first video received by the distribution start request reception unit based on the designation from the first user terminal 100.

[0104] As an example, when the above distribution button D11 is selected, the screen displayed on the first user terminal 100 transitions from the avatar setting screen D10 shown in FIG. 6 to the distribution setting screen D20 shown in FIG. 7.

[0105] The distribution settings can include at least one of settings related to the title of the first video, settings related to whether other users can appear in the first video, settings related to the number of people who can appear in the first video, and settings related to the password.

[0106] These distribution settings can be set in the title setting column D21, the collaboration availability setting column D22, the number setting column D23, and the password setting column D24 in FIG. 7 respectively. In FIG. 7, furthermore, the collaboration availability setting column D26 for anyone and the SNS posting availability column D27 are also displayed.

[0107] The title of the first video can be freely determined by the distributing user within the range of the allowable maximum number of characters. In addition, when there is no input by the distributing user, a preset title including the name of the character object (distributing user), such as "Delivery of ○○○♪", may be automatically determined.

[0108] Whether other users can appear in the first video can be freely determined by the first user. In the case of approval, other users can submit an appearance application to the distributing user, and in the case of rejection, other users cannot submit an appearance application to the distributing user. The state where other users appear in the first user's video may be referred to as "collaboration" in this specification. Details of the collaboration will be described later.

[0109] The number of people who can appear in the first video can be set only when other users' appearance in the first video is approved as described above, and the distributing user can freely determine it within the range of the allowable maximum number of people.

[0110] The password can be set arbitrarily only when other users are allowed to appear in the above-mentioned first video, and the distribution user can freely determine the numbers of the specified number of digits. When other users apply to appear in the first video, input of such a password is required. Note that it may be configured such that the password setting field D24 becomes active only when anyone sets the collaboration availability setting field D26 to OFF.

[0111] The distribution start unit distributes information about the first video to the second user terminal 200 of the viewing user based on the conditions set by the distribution setting unit.

[0112] The instruction to start such distribution is transmitted by selecting the distribution start button D25 shown in FIG. 7.

[0113] As an example, the distribution start unit distributes (avatar-distributes) information about a video (first video) including the animation of the character object of the first user to the second user terminal 200 of the second user.

[0114] The information about the first video includes, for example, motion information indicating the movement of the character object, voice information of the first user, and gift object information indicating gifts sent from other viewing users. The gift object information includes at least gift object identification information for identifying the type of the gift object and position information indicating the position where the gift object is displayed.

[0115] Then, the distribution start unit can live-distribute the video via the above-described video distribution platform.

[0116] FIG. 8 shows an avatar distribution screen D30 displayed on the first user terminal 100.

[0117] On the avatar delivery screen D30, in addition to displaying the character object CO, there can be displayed a comment input button D31 for the delivery user to enter comments, a photo button D32 for saving a still image of the screen, a play start button D33 for playing a game described later, an external service link button D34 for viewing videos provided by an external service, and a gacha button D12 for obtaining avatar parts.

[0118] Also, at the upper part of the avatar delivery screen D30, there can be displayed a cumulative viewer count display D35, a cumulative like count display D36, a collaboration person count display D37, a share button D38 to an external SNS, a guest details button D39, a ranking display button D40, a settings button D41, and a voice switching button D42 for switching the ON / OFF of the voice. Also, an end button D43 for ending the delivery is also displayed.

[0119] Although detailed explanations of these displays and buttons are omitted, by selecting the settings button D41, it is possible to change the delivery settings set on the delivery settings screen D20.

[0120] Note that Fig. 8 shows an example in which on the delivery settings screen D20, the appearance of other users in the first video is enabled and the delivery is started with three people being able to appear in the first video. Therefore, the character object CO is displayed in a state shifted towards the lower left. In the empty space, up to three character objects of other users can appear.

[0121] The above is the explanation of the screen transition when performing avatar delivery of the invention in the present disclosure.

[0122] Subsequently, an explanation will be given regarding the screen transition when the delivery user plays a game during the delivery.

[0123] One or more computer processors in the present disclosure can include a game request reception unit, a game video delivery unit, and a game display processing unit.

[0124] During the avatar distribution as shown in Fig. 8, the distributing user can request to start the game by selecting the play start button D33.

[0125] Note that the game displayed by selecting the play start button D33 is a dedicated game implemented in an application realized by the information processing system in the present disclosure, and can be different from a general-purpose game provided by an external service. Therefore, the game distribution in the present disclosure may be distinguished from the distribution of a play video of a general-purpose game provided by an external service along with the live commentary of the distributing user.

[0126] Alternatively, the play start request can be transmitted from the first user terminal 100 to the server device 400 by selecting a play start button arranged on a predetermined screen displayed on the first user terminal 100 of the first user.

[0127] Fig. 9 shows an example of a screen G10 on which a play start button G11 is arranged as the above-mentioned predetermined screen. The screen G10 shown in Fig. 9 is a screen that has transitioned from the top screen T10 (Fig. 5) displayed on the user terminal that has launched the application realized by the information processing system in the present disclosure by selecting the game tab T15.

[0128] On the screen G10, at least a play start button G11 capable of transmitting a play start request for a predetermined game is displayed.

[0129] When the game request reception unit receives a play start request for a predetermined game, the game video distribution unit distributes information regarding the second video to the second user terminal 200.

[0130] Here, the second video is a play video of a predetermined game. In this specification, the distribution such that such a video is displayed on the screen of the second user terminal 200 is called "game distribution".

[0131] In addition, after the user starts the application realized by the invention of the present disclosure, by selecting the play start object arranged on the game list screen and the game detail screen, as the first user, the user can transmit a request for starting the distribution of the second video to the information processing apparatus 2400.

[0132] These game list screens or game detail screens are the first screens to be described in detail below.

[0133] That is, the game display processing unit performs display processing of the first screen including a distribution start object capable of transmitting a distribution start request, a play start object capable of transmitting a play start request for a predetermined game, and a thumbnail image of a video during which the play video of the predetermined game is being distributed.

[0134] The screen G10 shown in FIG. 9 corresponds to the game list screen among the first screens. The first screen which is the game list screen is a screen that has transitioned from the top screen T10 by selecting the game tab T15.

[0135] Such a first screen includes a distribution preparation button T22 as a distribution start object, a play start button G11 as a play start object, and a thumbnail image indicating the distribution channel of the video.

[0136] On the first screen, for each of a plurality of playable games, a play start button G11, a game icon G12, a game name G13, the total number of viewers of the distribution channel of the game G14, and a distribution list G15 including a thumbnail image of the distribution channel during which the game is being distributed are respectively displayed.

[0137] Note that the order of the thumbnail images displayed in the distribution list G15 shown here can be changed by the viewing user. As an example, the order is arranged in the priority order of the users being followed by the viewing user, in descending order of the number of views by that viewing user, in descending order of the total number of viewers, and in descending order of the earliest distribution start. Note that the thumbnail images in this distribution list G15 can be changed in the display range by horizontal scrolling.

[0138] Also, the games displayed on this game list screen shall load the top 10 titles in the following priority. As an example, the priority is determined by within 48 hours from the game distribution start date and time, in descending order of the date when the viewing user last played within 30 days, in descending order of the high priority of the period ID, and in descending order of the period ID.

[0139] This distribution list G15 shall be updated when returning from the screens of other tabs and when a refresh operation (Pull-to-Refresh) is performed.

[0140] And, FIG. 10 corresponds to the game details screen among the first screens. The first screen, which is the game details screen, is G20, which is a screen that has transitioned by selecting the game icon G12 or the game name G13 displayed on the game list screen shown in FIG. 9.

[0141] Such a first screen includes a distribution preparation button T22 that is a distribution start object, a play start button G21 that is a play start object, and a thumbnail image indicating the distribution channel of the video.

[0142] Also, on the first screen, a game icon G22, a game name G23, the total number of viewers G24 of the distribution channel of the game, and a distribution list G25 including the thumbnail image of the distribution channel during the game distribution are respectively displayed.

[0143] Note that the order of the thumbnail images displayed in the distribution list G25 shown here can be changed by the viewing user. As an example, the order is arranged in the priority order of the users followed by the viewing user and in descending order of the number of views by that viewing user, the number of cumulative viewers, and the order of the oldest distribution start. Note that the thumbnail images in this distribution list G25 can be changed in the display range by vertical scrolling.

[0144] This distribution list G25 is to be updated when returning from the screens of other tabs and when a refresh operation (Pull-to-Refresh) is performed.

[0145] As described above, the user who selects the distribution start object (distribution preparation button T22) or the play start object (play start buttons G11, 21) becomes the first user to make a distribution start request or a play start request.

[0146] Also, the user who selects a thumbnail image becomes the second user to view the second video.

[0147] Also, the first screen includes a first area where a scroll operation is impossible and a second area where a scroll operation is possible.

[0148] The first screen mentioned here is the first screen shown in FIG. 10. The first screen includes a first area R1 and a second area R2. Specifically, the game title is displayed in the first area R1, and the above-described play start button G21, game icon G22, game name G23, number of viewers G24, and distribution list G25 are displayed in the second area R2.

[0149] The first area R1 is a part that is fixedly displayed on the display screen and where a scroll operation is impossible, and the second area R2 is a part where a scroll operation is possible by the user. By scrolling the second area R2, the user can check the thumbnail images hidden outside the screen.

[0150] However, since the play start button G21 may be hidden off the screen by scrolling the second area, the display processing unit in the present disclosure can display the play start object (play start button G21) in the first area R1 according to the display state of the play start object (play start button G21) displayed in the second area R2.

[0151] As an example, in FIG. 10, the play start button G21 is displayed in the second area R2, but in FIG. 11, it is displayed in the first area R1. That is, when part or all of the play start button G21 is no longer displayed in the second area R2, the play start button G21 appears in the first area.

[0152] Also, the game display processing unit may gradually display the play start object in the first area R1 according to the display state of the play start object displayed in the second area R2.

[0153] Such an expression can be realized by changing the transparency of the play start object according to the scroll amount of the second area R2.

[0154] As an example, let the scroll amount (unit: pixel) of 0 to 50 correspond to the transparency of the button from 0.0 (completely transparent) to 1.0 (completely opaque). Then, in the initial display state, the object is completely transparent and invisible, and when it scrolls more than 50 pixels, the object is completely displayed. During that period (0 to 50), it is preferable to linearly change the transparency of the object. Note that the unit of the scroll amount is logical pixels and may be different from the actual pixels of the display.

[0155] Also, it is assumed that the game request reception unit can receive a play end request for a predetermined game from the first user terminal 100 after the distribution of information regarding the second video by the game video distribution unit.

[0156] The end-of-play request can be sent by selecting an end button placed on the game screen.

[0157] And when the game request reception unit receives an end-of-play request for a predetermined game, the distribution start unit can end the distribution of information regarding the second video and distribute information regarding the first video.

[0158] That is, what is distributed here is not a part of the information of the first video but all of the information of the first video.

[0159] And when the distribution start unit ends the distribution of information regarding the second video and distributes information regarding the first video, it is assumed that the first video is displayed on the second user terminal 200.

[0160] Subsequently, a flow for starting video viewing will be described.

[0161] One or more processors in the present disclosure can further include a viewing reception unit.

[0162] The viewing reception unit receives a video viewing request from a user.

[0163] The distribution start unit distributes information regarding video and audio as video information to the user's information processing terminal in response to the viewing request.

[0164] FIG. 12 is an example showing a viewing screen V10 of an avatar video displayed on the second user terminal 200.

[0165] The viewing user can input text in the comment input field V11 and post a comment by pressing the send button V12.

[0166] Also, by pressing the gift button V13, a list of gifts (screen V30 in FIG. 13) is displayed to the viewing user, and a display request for the gift specified by selection can be sent.

[0167] At this time, one or more processors in the present disclosure can include a determination unit. The determination unit determines whether there is a gift display request from the second user terminal 200.

[0168] The display request can include gift object information. The gift object information includes at least gift object identification information that identifies the type of the gift object and position information that indicates the position where the gift object is to be displayed.

[0169] Also, as shown in FIG. 13, gifts can be displayed separately for each classification (free (paid) gifts, accessories, cheering goods, appeals, variety, etc.).

[0170] Here, a paid gift is a gift (coin gift) that can be purchased by consuming the my coins purchased by the viewing user, and a free gift is a gift (point gift) that can be obtained by consuming or without consuming the my points obtained by the viewing user for free.

[0171] Note that the term "gift" used in the present application means the same concept as the term "token". Therefore, it is also possible to understand the technology described in the present application by replacing the term "gift" with the term "token".

[0172] Also, the viewing user can post an evaluation indicating favor by pressing the like button V14. In addition to / Instead of the like button V14, it is also possible to display buttons for posting negative evaluations and other emotions.

[0173] Also, when the first user sets the availability of other users' appearances in the distribution settings to yes, an appearance application for the video can be sent by selecting the collaboration application button V15.

[0174] In addition, on the screen of a video broadcast by a first user whom a second user has not yet followed, a follow button V16 for the second user to follow the broadcast user is displayed. On the screen of a video broadcast by a first user whom the second user has already followed, this follow button functions as an unfollow button.

[0175] Note that this "following" may be performed from a second user to another second user, from a first user to a second user, or from a first user to another first user. However, following is managed as a one-way association, and the reverse association is managed separately as a follower.

[0176] Also, a photo button V25 for saving a still image of the screen can be displayed.

[0177] In addition, on the viewing screen V10, a support ranking display button V17, a share button V18, and a ranking display button V19 are also displayed.

[0178] The support ranking displays the ranking of second users who are supporting the first user, and the ranking can be calculated according to the amount of gifts (points / coins), etc.

[0179] Regarding sharing a video, the second user can press the share button V18 to check a list of shareable SNS (Social Networking Services) and send a fixed link to a specified location on the specified SNS by selection.

[0180] Also, by pressing the collaboration application button V15, a request for collaborative broadcasting can be made to the first user. Collaborative broadcasting means having the character object of the second user appear in the broadcast video of the first user.

[0181] At the upper part of the viewing screen V10, a distribution user icon V21, a distribution user name (character object name) V22, a cumulative viewer count display V23, and a cumulative like count display V24 can be displayed.

[0182] Also, when the viewing end button V20 is selected, a screen for ending the viewing is expanded, and a viewing end request can be sent.

[0183] The screen for ending such viewing will be described in detail. Such a screen is called "small window voice distribution" and is for viewing in a mode where only the audio is played while the video image is not displayed.

[0184] The selection of the above viewing end button V20 is received by the viewing reception unit as a viewing end request for the video.

[0185] At this time, in response to the viewing end request, the distribution start unit ends the distribution of information related to the video, while not ending the distribution of information related to the audio.

[0186] And, when information related to the video and audio is being distributed on the user terminal, the video is displayed on the main screen of the user terminal, and when only information related to the audio is being distributed, no video is displayed on the user terminal, and a sub-screen indicating that a video is being viewed is displayed, which is a feature.

[0187] FIG. 14 shows an image of a screen V50 on which the above sub-screen V51 is displayed.

[0188] When this sub-screen V51 is displayed, the main screen displayed in the background transitions to the screen before viewing the video. For example, if moving from the recommended tab to the viewing frame, it returns to the display of the recommended tab, and if moving from the follow tab to the viewing frame, it transitions to the follow tab.

[0189] When this sub-screen V51 is being displayed, operations on the main screen are possible, and transitions to other screens are possible.

[0190] On the sub-screen V51, a profile image, name, title, and a voice icon that can be visually identified as having voice flowing are displayed.

[0191] And by selecting the end icon V52 displayed on the sub-screen V51, viewing can be completely terminated.

[0192] Regarding the end of video display, information may be transmitted from the server device but not displayed on the terminal side, or the transmission of information itself from the server device may be stopped.

[0193] According to such a configuration, it becomes possible to search for other distributions while only listening to the voice, or to enjoy chatting with other users.

[0194] Subsequently, the "collaboration" in which other users appear in the video of the first user will be described.

[0195] As described above, the second user can send a participation request to the above video through the confirmation screen of the collaboration distribution participation request displayed by pressing the collaboration application button V15 shown in FIG. 12.

[0196] The collaboration avatar display unit provided in one or more computer processors in the present disclosure causes a character object generated based on the movement of the viewing user who made the participation request to be displayed in the video in response to the received participation request.

[0197] FIG. 15 shows, as an example, a viewing or distribution screen when the second avatar CO4, which is the character object of the guest user, participates in the video in which the first avatar CO3, which is the character object of the host user, is displayed. Note that the display of objects other than the avatar is omitted in FIG. 15.

[0198] Further, as shown in FIG. 16, a third avatar CO1, which is a character object generated based on the movements of another viewing user, may participate in the video. In FIG. 16, the third avatar CO1 is arranged behind the avatars A2 of the first avatars CO3 and CO4, but they may be arranged in a horizontal row of three. Also, the arrangement position of the avatars may be specified by the distribution user.

[0199] FIG. 17 shows a list screen T30 of users having a mutual follow relationship, which is displayed by selecting the follow tab T14 on the top screen shown in FIG. 5. Mutual follow means a relationship where each party follows the other.

[0200] On this list screen T30, the profile images and names of users having a mutual follow relationship are displayed.

[0201] As shown in FIG. 17, a first object T31 is to be displayed for each of the users having a mutual follow relationship on the list screen T30. Also, a chat object T32 may be displayed together with the first object T31. By selecting this chat object, it is possible to transition to an individual chat screen with the second user.

[0202] The first object T31 sends a predetermined notification to the terminal of the user associated with the first object T31.

[0203] As an example, the predetermined notification can be a call notification.

[0204] Subsequently, the details of the flow for executing a video chat in the embodiment of the present disclosure will be described.

[0205] As an example, a user can execute a video chat from an individual chat screen or a group chat screen.

[0206] These chat screens can be transitioned to, for example, from the chat list screen C10 (FIG. 18) that is expanded by selecting the message button T21 on the top screen T10 (FIG. 5).

[0207] On the chat list screen C10 shown in FIG. 18, icons of users (character objects) or group icons that have sent and / or received messages (chats) in the past are displayed together with names or titles. Note that the group icon can include the icons of users (character objects) who participate in the group.

[0208] Then, the user can select one user or group on the chat list screen C10, open the individual chat screen C20 (FIG. 19) or the group chat screen, and start a video chat by selecting the video chat button C21.

[0209] Also, by selecting the chat creation button C12 or the group creation button C13 that is displayed by selecting the edit button C11 on the chat list screen C10 (FIG. 20), a chat screen for a user or group that is not displayed on the chat list screen C10 can be created.

[0210] FIG. 21 is a user selection screen C30 that is expanded when the chat creation button C12 is selected, and a chat screen with the recommended user or the user searched using the search bar C31 that is displayed is shown / generated. The configuration of the generated chat screen is the same as the chat screen C20 shown in FIG. 19, and a video chat can be started by selecting the video chat button C21.

[0211] Similarly, FIG. 22 shows a group creation screen C40 that expands when the group creation button C13 is selected. The user can add users other than themselves as group members by selecting the user addition button C41. As an example, up to 7 group members can be added. Also, the group name can be set on this screen.

[0212] When a group is created, the chat screen C50 of the group is displayed (FIG. 23). Also on the chat screen C50 of the group, a video chat can be started by selecting the video chat button C51.

[0213] Note that the above chat screen C20 can also transition from the chat object T32 on the follow list screen T30 (FIG. 17).

[0214] Also, a chat icon can be placed on the profile screens of other users, and the user can transition from various pages to the chat screen and start a video chat.

[0215] Note that when a video chat is started, a notification is sent to the other party, and the other party can participate in the video chat by responding to such notification. Whether or not to receive such notification can be set by the user.

[0216] Also, it may be configured such that a video chat can be executed only with users in a mutual follow relationship. At this time, an icon indicating that a user in a mutual follow relationship is in a video chat with another user is displayed on the follow list screen, and by selecting such icon, it may be configured to be able to participate in the ongoing video chat.

[0217] The video chat in the present disclosure can be said to be a function in which the above-described collaborative distribution can be viewed only by specific users. Here, the specific users referred to mean the users participating in the video chat.

[0218] Next, an image of the expansion of the virtual space in the present disclosure will be described with reference to FIG. 24.

[0219] As shown as an example in FIG. 24, in this embodiment, the virtual space is arranged such that a disk-shaped island (world) floats in the air. This island is an object in a state where the top and bottom of a tower-shaped cake are reversed, and it can be configured such that various objects are arranged on the disk-shaped ground. Note that this island and the ground are shown as examples, and their display modes are not particularly limited.

[0220] As objects, at least a character object CO of the first user, a gift object G1 corresponding to a gift for which a display request has been made from the second user, and an object S1 that controls the display position and display timing in the server device 400 (system side) can be displayed.

[0221] It is possible to move and jump the character object within the world by a user operation, and such a function can be provided as one of the games described above as an example. In the present disclosure, this is specifically called "world distribution", and the start and end procedures of the game distribution described above are applied.

[0222] Specifically, the switch from normal distribution (avatar distribution) to world distribution can be performed by selecting the play start button D33 (FIG. 8) of the game displayed in the video of avatar distribution or one of the play buttons G11, G21 (FIGS. 9 and 10) of a game selected from the game list displayed on the screen transitioned to by selecting the play start button D33.

[0223] Also, the switch from world distribution to avatar distribution can be performed by selecting the play end button displayed in the video of world distribution.

[0224] Next, various functions executable in the information processing system 3000 according to the embodiments in the present disclosure will be described with reference to the drawings.

[0225] As shown in FIG. 25, one or more computer processors included in the information processing system 3000 according to the embodiments of the present disclosure include a receiving unit 410, a transmitting unit 420, an analyzing unit 430, and a display control unit 440.

[0226] The receiving unit 410 receives at least voice information regarding the voice of the first user transmitted from the first user terminal 100 of the first user.

[0227] As an example, the voice information may include voice corresponding to the utterance of the first user picked up by a microphone provided in or connected to the first user terminal 100, and / or information regarding other voices other than the utterance of the first user.

[0228] Other voices are, for example, environmental sounds or the utterances of other users. Whether the utterance is by the user or by other users can be identified by using known voice recognition technology. In addition, environmental sounds include the sound of a TV, the sound of an intercom, the ringing sound of a phone, the sound of an animal's cry, the announcement sound at a station, the sound of a train, a car, a motorcycle, etc., and the voices of multiple people talking.

[0229] The transmitting unit 420 transmits information for causing a video related to the first user to be displayed on the first user terminal 100 and / or the second user terminal 200 of the second user to the first user terminal 100 and / or the second user terminal 200.

[0230] As an example, the video related to the first user can be a video in which a character object of the first user or a real image of the first user is displayed, or a video that does not display these character objects or the real image of the first user and includes only the voice of the first user.

[0231] Also, at least a part of the video displayed on the first user terminal 100 and the video displayed on the second user terminal 200 can be different from each other.

[0232] Also, as described above, the information for displaying the video includes information for displaying the video rendered in the server device 400 on the client terminal (the first user terminal 100 and / or the second user terminal 200) and / or information for rendering the video on the client terminal. Also, a part of the video may be rendered by the server device and the other part of the video may be rendered by the client terminal.

[0233] The analysis unit 430 analyzes whether a specific word is included in the audio based on the audio information received by the reception unit 410.

[0234] The information regarding the specific word can be pre-stored in a predetermined storage device provided in the one or more computer processors or a predetermined storage device connectable to the information processing system 3000.

[0235] FIG. 26 shows an image of the data configuration regarding the specific word stored in a predetermined storage device.

[0236] As shown in FIG. 26, in the predetermined storage device, the specific word and the display control information are stored in association with each other.

[0237] As an example, the display control information includes information regarding an operation object (control target) for performing an operation necessary for an action corresponding to a specific word and information regarding control information (control content) for the operation object, but is not limited thereto and may include other information.

[0238] For example, for a specific word "gacha", an operation object called "gacha button" for performing operations necessary for gacha execution and control content for "appearing" or "highlighting" the gacha button are associated with each other.

[0239] As an example, specific words include, but are not limited to, words related to actions that require operations on the first user terminal 100, words related to actions that require operations on the second user terminal 200, words related to requests, words related to specific items, words related to events in the real space, words included in specific text displayed in a video, and / or words set on the first user terminal 100.

[0240] Words related to actions that require operations on the first user terminal 100 can be, for example, words related to actions that the first user needs to perform on the first user terminal 100, such as lottery execution like gacha or event participation (as an example, words indicating "gacha", "event", etc.). Details will be described later.

[0241] Words related to actions that require operations on the second user terminal 200 can be, for example, words related to actions that the second user needs to perform on the second user terminal 200, such as gifting or posting comments (as an example, words indicating "gift", "comment", etc.). Details will be described later.

[0242] Words related to requests can be, for example, words representing the requests (desires) of the first user (as an example, words indicating "hungry", "sleepy", etc.). Details will be described later.

[0243] Words related to specific items can be, for example, words indicating electronic items that can be associated with the first user terminal 100 (as an example, words indicating "accessory", "clothes", etc.). Details will be described later.

[0244] Words related to events in the real space can be, for example, words representing weather, location, date and time (as an example, words such as "nice weather", "Christmas", etc.). Details will be described later.

[0245] Words included in specific text displayed in the video can be, for example, words included in comments posted from the first user terminal 100 or the second user terminal 200, or system comments posted from the operation side of the system. Details will be described later.

[0246] Words set in the first user terminal 100 can be, for example, words selected or input in the first user terminal 100 (as an example, passwords, themes, catchphrases, quiz answers, etc.). Details will be described later.

[0247] Then, based on the voice information, the analysis unit 430 analyzes whether the above-mentioned specific words are included in the voice.

[0248] As an analysis method, it is possible to apply known voice recognition technology or future voice recognition technology. As an example, there are methods for directly analyzing whether specific words are included in the voice information, and methods for analyzing whether specific words are included after converting the voice information into text information.

[0249] In addition, instead of or additionally analyzing whether the above-mentioned specific words are included in the voice, the analysis unit 430 may analyze the content of the voice based on the voice information and analyze whether the content corresponding to the above-mentioned specific words is included.

[0250] Also in this case, it is possible to apply known voice recognition technology or future voice recognition technology for the analysis and analysis methods.

[0251] Then, the display control unit 440 controls the display of the video based on the display control information associated with a specific word included in the audio according to the result analyzed by the analysis unit 430.

[0252] As described above, it is assumed that the display control information is stored in a predetermined storage device in association with a specific word.

[0253] Then, performing the control of the display of the video includes changing at least a part of the display in the video.

[0254] As an example, the control of the display of the video includes causing a predetermined object to appear in the video, emphasizing and displaying a predetermined object displayed in the video, displaying another screen instead of or additionally to the screen displayed in the video, and the like.

[0255] For example, as shown in FIG. 27, in a video related to avatar distribution, when a first user makes a statement such as "Should I do a gacha pull?", the display control is performed so that the gacha button D12 displayed in the video lights up.

[0256] Alternatively, as shown in FIG. 28, in a video related to avatar distribution, when a first user makes a statement such as "Should I do a gacha pull?", the display control is performed so that a gacha object D44 for performing a gacha appears in the video.

[0257] For example, in a video related to avatar distribution, when a first user makes a statement such as "I want a duckling", as shown in FIG. 29, the screen of the second user terminal 200 unfolds a gift list screen V30, and the display control is performed so that the frame of the corresponding gift has a different mode from other frames.

[0258] Similarly, as shown in FIG. 30, in a video related to world distribution, when a first user makes a statement such as "I'm hungry", the display control is performed so that a shop object D45 appears in the video.

[0259] Alternatively, as shown in FIG. 31, in the video related to world distribution, when the first user makes a statement such as "want to eat a hamburger", the display is controlled so that the advertisement object D46 appears in the video.

[0260] Note that the specific examples of the control of the display of the above video are illustrative and not limited thereto.

[0261] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the prior art described above.

[0262] In particular, according to the above configuration, it is possible to improve the video distribution willingness of the first user, the video viewing willingness of the second user, and / or the communication willingness between users.

[0263] Specifically, by appropriately controlling the display of the video based on the speech of the first user in the video, the quality of the video as content can be improved.

[0264] With this improvement in quality, the video viewing willingness of the second user is also improved, and thereby the video distribution willingness of the first user is also improved.

[0265] In particular, the display control based on the speech of the first user in the video serves as an example to support the operation of the first user and / or the second user and the communication between users.

[0266] For example, conventionally, when the first user wants to execute a lottery such as a gacha during video distribution, it is common to tap an operation object such as a gacha button displayed on the screen and further tap a lottery button on the transition destination lottery screen.

[0267] At this time, if the first user focuses on searching for and selecting a target operation object from various operation objects displayed on the screen, there is a risk that the talk of the first user in the video will become sparse. Talk is a part that greatly contributes to the quality of the video and communication between users, and this should be avoided. In particular, since information processing terminals such as smartphones assumed as the first user terminal tend to have a small screen, the above problem is more prominent.

[0268] Conventionally, there has been a technology for operating a computer by voice. However, in this technical field where basically all the voices input from the first user terminal are reproduced at the second user terminal, having the first user utter words for voice operation may sometimes degrade the quality of the content.

[0269] On the other hand, in the invention according to the present disclosure, by automatically recognizing specific words from the natural talk of the first user, it is possible to support the operation of the first user and / or the operation of the second user, and the communication between users without degrading the quality as content.

[0270] Here, the video related to the first user can be a video related to avatar distribution or world distribution as described above.

[0271] In world distribution, the video related to the first user displays the character object of the first user and a virtual space (metaverse) in which the character object can move. In the case of a video related to world distribution, the first user and the second user may each be a user (distribution user) whose character objects are both in the world, or the second user may simply be a viewing user who is just watching.

[0272] Also, in the case of a video related to avatar distribution, the first user is the distribution user and the second user is the viewing user.

[0273] Here, in the video related to the first user, a character object of the first user that operates based on the operation information related to the actions of the first user transmitted from the first user terminal 100 can be displayed. At this time, it is assumed that the operation information (motion data) is received by the receiving unit 410 described above.

[0274] Subsequently, a case where a specific word is a word related to an action that requires an operation on the first user terminal 100 will be described.

[0275] As described above, a word related to an action that requires an operation on the first user terminal 100 is, for example, a word related to an action that the first user needs to operate on the first user terminal 100, such as performing a lottery like a gacha or participating in an event (as an example, words indicating "gacha", "event", etc.).

[0276] The specific word may be a single word or a sentence.

[0277] At this time, the display control information can be information for causing an operation object associated with the action to appear on the video or the screen of the first user terminal 100, highlighting and displaying the operation object associated with the action displayed on the video or the screen of the first user terminal 100, and / or displaying an operation screen associated with the action.

[0278] Causing an operation object associated with an action to appear on the video or the screen of the first user terminal 100 means, for example, causing a gacha object or an event participation object to appear on the video or the screen of the first user terminal 100.

[0279] Here, regarding the appearance of the operation object, although there is no difference in the sense that the operation object is displayed on the screen of the first user terminal 100 whether it is in the video or the operation object appears on the first user terminal 100, when the operation object appears on the first user terminal 100, it shall include causing the operation object to appear superimposed on the video or at a position separate from the video.

[0280] Also, when these are already displayed in the video or on the first user terminal 100, the above operation object is displayed in an emphasized manner. Displaying in an emphasized manner means causing a predetermined production effect on the operation object, for example, adding an effect such as shining brightly, adding an effect such as blinking or rotating, or attaching a mark or frame serving as a landmark.

[0281] Also, when there are multiple gacha categories, etc., further, an emphasized display such as making the corresponding gacha banner shine can be performed.

[0282] And, displaying the operation screen associated with the action means, as an example, displaying the gacha lottery screen or displaying a pop-up image for transitioning to the gacha lottery screen.

[0283] Any display control information can be information for controlling the video in a manner that arouses the attention of the first user.

[0284] Subsequently, the case where a specific word is a word related to an action that requires an operation on the second user terminal 200 will be described.

[0285] A word related to an action that requires an operation on the second user terminal 200 is, as described above, for example, a word related to an action that requires an operation by the second user on the second user terminal 200 such as gifting or posting a comment (a word indicating, as an example, "gift", "comment", etc.).

[0286] At this time, the display control information can be information for causing an operation object associated with an action to appear on the video or the screen of the second user terminal 200, emphasizing and displaying the operation object associated with the action that is displayed on the video or the screen of the second user terminal 200, and / or displaying a screen associated with the action.

[0287] Causing an operation object associated with an action to appear on the video or the screen of the second user terminal 200 means, for example, causing a gift button or a comment input field to appear on the video or the screen of the second user terminal 200.

[0288] Also, a present button associated with the action of sending a real product to the first user may be caused to appear. Note that when a real product has already been given to the first user by another user, the present button displayed on the screen of the second user terminal 200 may be terminated / grayed out.

[0289] Here, regarding the appearance of the operation object, causing the operation object to appear on the video and the second user terminal 200 both mean that the operation object is displayed on the screen of the second user terminal 200, but in the latter case, it includes causing the operation object to appear superimposed on the video or at a position different from the video.

[0290] Also, when these are already displayed on the video or the second user terminal 200, the above operation object is emphasized and displayed. Emphasizing and displaying means causing a predetermined production effect to occur on the operation object, for example, adding an effect such as shining brightly, adding an effect such as blinking or rotating, or attaching a mark or a frame serving as a landmark.

[0291] And causing a screen for operation associated with an action to be displayed means, for example, displaying a gift list screen or displaying a pop-up image for transitioning to the gift list screen.

[0292] Any of the display control information can be used as information for controlling the video in a manner that attracts the attention of the second user.

[0293] In addition, when a specific word is a word related to an action that requires an operation on the first user terminal 100, the display control unit 440 can control the display of the video on the first user terminal 100 and the second user terminal 200.

[0294] The reason for controlling the display of the video on the second user terminal 200 as well is that the reaction of the first user to the result of the control of the display of the video can also be provided to the second user as part of the content.

[0295] On the other hand, when a specific word is a word related to an action that requires an operation on the second user terminal 200, the display control unit 440 can control the display of the video only in the video displayed on the second user terminal 200.

[0296] This is because the reaction of the second user to the result of the control of the display of the video is unlikely to become part of the content, and also to reduce the mental distress of the first user requesting an operation from the second user.

[0297] In addition, as shown in FIG. 32, one or more computer processors in the present disclosure can further include an effect generating unit 450.

[0298] When the above action is executed by selecting the video or an operation object that appears or is highlighted and displayed on the first user terminal 100 / second user terminal 200, the effect generating unit 450 generates an advantageous effect on the first user terminal 100 and / or the second user terminal 200.

[0299] In other words, when the action is executed through a route different from the above, the effect generation unit 450 does not generate the effect that becomes the above privilege.

[0300] As an example, the effect that becomes a privilege includes a discount on the fee (paid coins) paid when executing a gacha or gifting, an increase in the number, size, or value of items obtained in a gacha, an increase in the number, size, or value of objects displayed by gifting, generating a special effect in a video, awarding points when participating in an event, and the like.

[0301] Such a privilege is given as a reward for the first user's execution or promotion of actions such as gacha, gift, and event in the video.

[0302] Next, the case where the above-described specific word is a word related to a request will be described in detail.

[0303] Words related to a request can be, for example, words indicating the intention expression of the first user's desire. Also, words related to a request include words directly indicating a request such as "want to eat ○○", "want to sleep", "want it to be cooler", "want it to be warmer", "want it to be brighter", "want it to be darker", etc., and also include words indirectly indicating a request such as "hungry", "sleepy", "hot", "cold", "dark", "dazzling", etc.

[0304] At this time, the display control information can be information for causing an object associated with a request to appear in the video and / or information for emphasizing the display of an object displayed in the video.

[0305] The object associated with a request can be, for example, a lottery object.

[0306] The lottery object can be a lottery object D47 as shown in FIG. 33. Also, the lottery object may be the above-described gacha button D12.

[0307] The lottery object D47 is for the first user to obtain real products and / or product objects by lottery.

[0308] The lottery may be executed for a fee (consumption of paid tickets or paid coins), or may be executed for free (consumption of free tickets or free points). When the lottery can be executed for free, the configuration may be such that whether or not to display the above lottery object is determined by lottery.

[0309] Note that the real products and / or product objects to be the lottery targets do not need to be limited to one type, and may be a plurality of types.

[0310] For example, when a specific word is a word that appeals to hunger, a lottery that does not limit the food as a product can be executed. For example, when the first user makes a statement of "hungry", a lottery is conducted among a plurality of products including pizza, hamburger, sushi, etc., and the winning or losing of one product is determined from among these.

[0311] On the other hand, when a specific word is a word that requests a specific food, a lottery that limits the food as a product can be executed. For example, when the first user makes a statement of "want to eat a hamburger", a lottery for hamburgers is conducted, and the winning or losing of the hamburger is determined.

[0312] Also, when a specific word is a word that appeals to cold, a lottery that does not limit food or cold-proof goods as products can be executed. For example, when the first user makes a statement of "cold", a lottery is conducted among a plurality of products including soup, hot drinks, gloves, mufflers, etc. that are cold-proof goods, and the winning or losing of one product is determined from among these.

[0313] On the other hand, if a specific word is a word that requests a specific product, a lottery limited to the dish as a product can be executed. For example, when the first user makes a statement "I want gloves", a lottery for gloves is conducted, and the winning or losing of the gloves is determined.

[0314] The lottery object D47 may represent a lottery device as shown in FIG. 33, may represent the product to be the lottery target, or may represent a representative object related to the product to be the lottery target.

[0315] Note that when the lottery object D47 displayed on the screen by the first user is selected, the lottery result may be displayed on that screen, or the lottery result may be displayed on the transition destination lottery screen.

[0316] And according to the winning result of the lottery, an actual product and / or a product object is given to the first user terminal 100.

[0317] Also, the above giving may be automatically performed, or may be performed according to the operation of the first user as described later.

[0318] Giving an actual product means that the right to obtain an actual product is given to the first user, and giving a product object means that data related to the product object is associated with the first user terminal 100.

[0319] The product object is an object representing a product, and can be an object worn on a character object associated with the first user, or a non-worn object that is temporarily or constantly displayed in a virtual space (world, room, etc.) associated with the first user terminal 100.

[0320] Also, when the lottery object D47 is already displayed, the lottery object is displayed in an emphasized manner. Displaying in an emphasized manner means causing a predetermined production effect on the lottery object, for example, adding an effect such as glittering light, adding an effect such as blinking or rotating, or attaching a mark or frame serving as a landmark.

[0321] Also, causing the display of a screen associated with an action means, as an example, displaying a lottery screen or displaying a pop-up image for transitioning to the lottery screen.

[0322] Any of the display control information can be used as information for controlling the video in a manner that attracts the attention of the first user.

[0323] The object associated with the request can be, as an example, a shop object.

[0324] Note that the shop object can be the shop object D45 shown in FIG. 30.

[0325] The shop object D45 is an object representing a shop where real goods and / or product objects can be purchased.

[0326] The shop object D45 may be an object for an operation that causes a transition to a product selection / purchase screen when selected, or may be arranged within a virtual space displayed in the video, and characters can enter it to view, touch, or purchase products.

[0327] The object associated with the request can be, as an example, an advertisement object.

[0328] The advertisement object can be the advertisement object D46 shown in FIG. 31.

[0329] Advertising object D46 is an object representing an advertisement related to real products and / or product objects.

[0330] The advertising object D46 can be displayed in the form of a flag, signage, billboard, balloon, vehicle wrapping such as a bus or train, etc. displayed in the virtual space.

[0331] And the advertising object D46 may be an object for operation that transitions to a site for online sales when selected, or it may be placed within the virtual space displayed in a video and move to a virtual shop where a character object can enter to view, touch, or purchase products.

[0332] These lottery objects D47, shop objects D45, and advertising objects D46 may be displayed for a predetermined time, or may be displayed until selected by the first user. Also, it may be configured to end the display in response to the voice of the first user.

[0333] In the case of a first-person perspective video in world distribution, these objects may be pop-up displayed at the edge of the screen as if a character object or the first user is wearing AR glasses.

[0334] Also, at least a part of the virtual space can be shared with the second user terminal 200.

[0335] And when the second user terminal 200 is associated with the first user terminal 100, the effect of controlling the display of the video by the display control unit 440 can cover both the first user terminal 100 and the second user terminal 200.

[0336] On the other hand, when the second user terminal 200 is not associated with the first user terminal 100, the effect of controlling the display of the video by the display control unit 440 can be made to apply to only one of the first user terminal 100 and the second user terminal 200.

[0337] The case where the second user terminal 200 is associated with the first user terminal 100 shall include the case where they are in a mutual following relationship and the case where the second user unilaterally follows the first user.

[0338] The case where the second user terminal 200 is not associated with the first user terminal 100 shall include the case where they are not in a mutual following relationship and the case where the first user unilaterally follows the second user.

[0339] When the virtual space is provided by a plurality of servers, users in a mutual following relationship coexist in the virtual space of the same server and are highly likely to communicate, so the same display can be used to prevent conversation conflicts. Similarly, the same space can be shared with the second user who is a follower of the first user.

[0340] On the other hand, it is not possible to share the same space with a second user existing in the virtual space of a different server.

[0341] According to the above configuration, by restricting the range of sharing the effect, the drawing load of the object can be reduced.

[0342] Also, as shown in FIG. 32, one or more computer processors in the present disclosure can further include an ordering unit 460.

[0343] When the order unit 460 determines the winning of an actual product through an operation on the lottery object D47 in the first user terminal 100, or when an actual product is ordered in the first user terminal 100 via the shop object D45 and / or the advertisement object D46, the order unit 460 can transmit information related to the winning or the order, and the address information of the first user included in at least the user information of the first user, to the information processing device of the physical store associated with the lottery object, the shop object, and / or the advertisement object.

[0344] As a result, by registering an address such as a home in the information processing system of the present disclosure, the first user can receive the actual product at hand without the trouble of entering the address each time.

[0345] Note that the actual product can be a product that may satisfy the request. As an example, when the request is related to hunger, food and drinks such as hamburgers, pizzas, and soups; when the request is related to sleep, sleep goods such as pillows and futons; when the request is related to temperature such as hot or cold, food and drinks, cold feeling / warm keeping goods; when the request is related to dark or bright, lighting fixtures, etc. can be mentioned, but it is not limited to these, and any product that may satisfy a part of the request is acceptable.

[0346] When an actual product is ordered in the first user terminal 100 via the shop object D45 and / or the advertisement object D46, the display control unit 440 can display the product object corresponding to the actual product in a video.

[0347] That is, it is assumed that a product object corresponding to an actual product that can be provided is stored in a predetermined storage device in the present disclosure. As a result, the sense of linkage between the first user and the character object is enhanced, and the second user can see what the first user has ordered, so communication becomes active.

[0348] For example, when a first user makes a statement such as "I'm hungry," real food is delivered to the first user and a food object is also attached to the character object of the first user.

[0349] Note that the product object can be displayed at the time of ordering, after ordering and before the real product arrives, or after the real product has arrived. In this case, the timing when the product arrives may be obtained from the delivery side or input by the first user.

[0350] As described above, for a company that provides real products, displaying product objects in a virtual space can be expected to have an advertising effect for product placement. It can also lead to an expansion of brand awareness and the acquisition of new customers. As a result, the operator can obtain advertising revenue and make the usage fee from users free or increase the revenue of the distribution users.

[0351] In addition, the company can introduce a new advertising method that is not available in conventional advertising, such as targeting an advertisement to a distribution user (influencer) with many viewers / followers.

[0352] Subsequently, the case where a specific word is a word related to a specific item will be described.

[0353] At this time, as shown in FIG. 32, one or more computer processors in the present disclosure can further include a determination unit 470.

[0354] The determination unit 470 determines whether a specific item is associated with the first user terminal 100.

[0355] The database to be determined may be stored in a storage device provided in the server device 400 or may be stored in a storage device provided in the first user terminal 100.

[0356] A word related to a specific item can be, for example, a word indicating an electronic item that can be associated with the first user terminal 100 (as an example, words indicating "accessories", "clothes", etc.).

[0357] When the determination unit 470 determines that a specific item is associated with the first user terminal 100, the display control unit is based on display control information that is information for causing a specific object corresponding to the specific item to appear in the video, information for emphasizing and displaying the specific object displayed in the video, and / or information for displaying a list screen of items associated with the first user terminal including the specific item, and controls the video.

[0358] Causing a specific object corresponding to a specific item to appear in the video means, as an example, causing a specific object to appear in the video. When the specific object is a wearable item such as an accessory, it is to be displayed in association with a specific part of the character object.

[0359] Also, when a specific object is already displayed in the video, the specific object is emphasized and displayed. Emphasizing and displaying means causing a predetermined production effect on the specific object, for example, adding an effect such as glittering, adding an effect such as blinking or rotating, or attaching a mark or frame serving as a landmark.

[0360] Displaying a list screen of items associated with the first user terminal including a specific item means, as an example, displaying the above-described closet screen.

[0361] When it is determined by the determination unit 470 that a specific item is not associated with the first user terminal 100, the display control unit may control the display of the video based on display control information that is information for causing the video to appear an object of lottery that can obtain the specific item by lottery, a shop object representing a shop where the specific item can be purchased, or an advertisement object video representing an advertisement related to the specific item, and / or information for emphasizing and displaying the lottery object, the shop object, and / or the advertisement object displayed in the video.

[0362] That is, when a speech is made about a specific item that the first user does not have, the display of the video is controlled based on information for obtaining the specific item. Details of the lottery object, the shop object, and the advertisement object are as described above.

[0363] Also, when it is determined by the determination unit 470 that a specific item is not associated with the first user terminal 100, the display control unit may control the display of the video based on display control information that is information for causing the video to appear a lead to a screen related to the user terminal of another user who has the specific item.

[0364] The first user can exchange, transfer, or receive (hereinafter referred to as "exchange, etc.") items with other users. This may be during the period when the first user is distributing the video or at a timing when the video is not being distributed.

[0365] And causing a lead to a screen related to the user terminal of another user who has the specific item to appear in the video includes causing a screen for exchanging items with other users or a pop-up image for transitioning to the screen to appear.

[0366] The above screen can be the profile screen of another user or a dedicated screen for exchange, etc.

[0367] In addition, item exchanges with other users, etc. may be freely negotiated through messages (chat), or a function to appeal the intention of transfer or receipt in advance may be implemented.

[0368] Subsequently, the case where a specific word is a word related to an event in the real space will be described.

[0369] Words related to events in the real space can be, for example, words representing weather, location, date and time (as an example, words such as "nice weather" and "Christmas").

[0370] At this time, the display control information can be information for causing a real object associated with an event in the real space to appear in the video.

[0371] Causing a real object associated with an event in the real space to appear in the video means, for example, causing a wallpaper object to appear in the video. A wallpaper object is an object displayed at the back position of a character object and functions as the background of the video.

[0372] For example, when the first user makes a statement such as "nice weather", a clear sky wallpaper object and a sun object will appear in the video, and the display will be controlled accordingly.

[0373] Similarly, when the first user makes a statement such as "it's starting to rain!", the display will be controlled so that a wallpaper object with rain appears in the video.

[0374] Subsequently, the case where a specific word is a word included in specific text displayed in the video will be described.

[0375] The words included in the specific text displayed in the video can be, for example, the words included in the comments posted from the first user terminal 100 or the second user terminal 200, or the system comments posted from the operation side of the system.

[0376] The system comment is a comment automatically displayed in the video, and usually, a text notification of the entry and exit of the second user to / from the distribution frame or the gift being thrown is displayed.

[0377] Note that the specific text is not particularly limited as long as it is displayed on the screen. Therefore, it may include the above-mentioned comments, the text represented in the displayed objects (gift object, whiteboard object, memo object, etc.).

[0378] At this time, the display control unit 440 can cause the specific text to be highlighted.

[0379] The highlighting of the specific text means causing a predetermined production effect on the object related to the specific text. For example, adding an effect such as shining brightly, adding an effect such as blinking or rotating, or attaching a mark or frame as a landmark. Also, the display color of the specific text may be changed.

[0380] Note that it is not necessary for all of the specific text to be read aloud to the first user, and the text corresponding to a predetermined ratio of the specific text may be recognized as a specific word.

[0381] The highlighting can be made to include displaying an object related to the character object of the user who posted the comment.

[0382] The related object can be a two-dimensionalized character object or a character object with a reduced size, and can be made not to operate based on the movement of the distribution user.

[0383] When compared with the case of rendering a three-dimensional character object with a large processing load, the rendering cost can be reduced when the above configuration is adopted.

[0384] Those with a reduced size of the character object shall include those with a changed balance of the character's height-to-body ratio. For example, a chibi avatar with an equal ratio of the head to the body part is included. Note that the chibi avatar may be 2D or 3D.

[0385] When multiple people are collaborating, the receiving unit 410 receives a plurality of pieces of audio information regarding the voices of a plurality of users transmitted from a plurality of user terminals including the first user terminal 100.

[0386] At this time, the analysis unit 430 analyzes whether a specific word is included in the voice. Further, the analysis unit 430 specifies the number of specific words included in the voice.

[0387] The display control unit 440 can control the display of the video based on the specific word included in the voice and the display control information associated with the number of voices in which the specific word is included.

[0388] In this way, in the case of collaboration, the display of the video can be controlled differently depending on the number of people who uttered a specific word. For example, when a specific word is said by one person and when a specific word is said by multiple people, more elaborate video display control can be performed when it is said by multiple people.

[0389] In the case of a video of multiple people playing a game, special effects can be generated or skills can be activated within the game.

[0390] In addition, for a specific word to be the password set by the first user who is the host as described later, the unity among participating users in the collaborative video will be enhanced, communication will be activated, and the quality of the video can be improved.

[0391] In addition, when only the host knows a specific word and the guest does not, it becomes possible to provide content such as a quiz program.

[0392] Subsequently, a case where the specific word is a set word set by an operation on the first user terminal 100 will be described.

[0393] At this time, as shown in FIG. 32, one or more computer processors in the present disclosure can further include a setting unit 480.

[0394] The setting unit 480 sets a specific word based on the operation of the first user received by the receiving unit 410.

[0395] The first user may be able to perform the above setting operation on the distribution setting screen D20 described above, or may be able to perform the operation via the setting button D41 displayed during video distribution. Further, the above setting operation may be able to be performed regardless of whether or not there is distribution on the profile screen of the first user.

[0396] In addition, the setting of the specific word may be performed by selecting from the presented candidate words, or may be performed by freely inputting text. The candidate words are assumed to be pre-stored in a predetermined storage device provided or connectable to one or more computer processors of the present disclosure.

[0397] The words set on the first user terminal are stored in the storage device in association with the display control information, as in the data table shown in FIG. 26. This display control information is assumed to be pre-associated in the case of candidate words, and in the case of words entered freely, the actions, control targets, and / or control contents associated with specific words can be freely set.

[0398] Such set words may take effect only in the single avatar distribution or world distribution by the first user terminal, or may take effect in the collaborative distribution or world distribution involving multiple users.

[0399] That is, in the latter collaborative distribution or world, the set words function as passwords among users and help to further activate communication among multiple users.

[0400] Also, when a specific word is set by the system side, the specific word may be known to the user in advance, or may not be disclosed to the user. When the set specific word is not disclosed, the fun of guessing the correct answer as a secret keyword can be created, or the sense of surprise when the correct answer is given can be produced.

[0401] Further, the setting unit 480 may be configured to set whether to control the display of the video according to the result analyzed by the analysis unit 430.

[0402] The setting unit 480 performs the above setting based on the operation of the first user received by the receiving unit 410. The first user may perform the above setting operation on the distribution setting screen D20 described above, or may perform the operation via the setting button D41 displayed during the video distribution. Also, the above setting operation may be performed regardless of the presence or absence of distribution on the profile screen of the first user.

[0403] According to such a configuration, the first user can select whether to control the display of the video according to the result analyzed by the analysis unit 430 according to his own will, and it is possible to prevent the control of the display of the video from being performed unintentionally by the first user.

[0404] In the above embodiment, an example in which the display control unit 440 controls the display of the video based on the display control information associated with the specific word included in the voice according to the result analyzed by the analysis unit 430 has been described. However, the analysis unit 430 may analyze whether a specific action is included in the action based on the action information received by the reception unit 410.

[0405] At this time, the display control unit may control the display of the video based on the display control information associated with the specific action included in the action according to the result analyzed by the analysis unit 430.

[0406] The information about the specific action can be stored in advance in a predetermined storage device provided in the above one or more computer processors, or a predetermined storage device connectable to the information processing system 3000.

[0407] In addition, in the predetermined storage device, the specific action and the display control information are stored in association with each other.

[0408] As an example, the display control information includes information about an operation object (control target) for performing an operation necessary for an action corresponding to a specific action and information about control information (control content) for the operation object, but is not limited thereto and may include other information.

[0409] For example, for a specific action of "yawning", control content is associated such that the gift list screen V30 is expanded on the second user terminal 20 and the corresponding eye mask gift is displayed so as to shine.

[0410] In addition, for a specific action of "stroking the belly", control content is associated such that on the second user terminal 200, a gift list screen V30 is expanded, and control is performed to display the corresponding meat gift in a highlighted manner.

[0411] The embodiments related to the above-described specific words can also be appropriately combined and applied when adopting the above-described specific actions.

[0412] Subsequently, an information processing method according to an embodiment of the present disclosure will be described.

[0413] The information processing method according to an embodiment of the present disclosure can be executed in an information processing system 3000 including one or more user terminals 100, 200 and a server device 400.

[0414] As shown as an example in FIG. 34, the information processing method according to the present disclosure can cause one or more computer processors included in the information processing system 3000 to execute a reception step S410, a transmission step S420, an analysis step S430, and a display control step S440.

[0415] In the reception step S410, voice information related to at least the voice of the first user, transmitted from the first user terminal of the first user, is received.

[0416] Such a reception step S410 can be executed by the above-described reception unit 410.

[0417] The reception step S410 can be executed on the server side (server device 400).

[0418] In the transmission step S420, information for causing a video related to the first user to be displayed on the first user terminal and / or the second user terminal of the second user is transmitted to the first user terminal and / or the second user terminal.

[0419] Such a transmission step S420 can be executed by the above-described transmission unit 420.

[0420] The transmission step S420 can be assumed to be executed on the server side (server device 400).

[0421] In the analysis step S430, based on the voice information, it is analyzed whether the voice contains a specific word.

[0422] Such an analysis step S430 can be executed by the above-described analysis unit 430.

[0423] The analysis step S430 may be executed on the server side (server device 400), or may be executed on the client side (first user terminal 100).

[0424] The display control step S440 controls the display of the video based on the display control information associated with the specific word included in the voice according to the result analyzed in the analysis step S430.

[0425] Such a display control step S440 can be executed by the above-described display control unit 440.

[0426] The display control step S440 may be executed on the server side (server device 400), or may be executed on the client side (first user terminal 100 / second user terminal 200).

[0427] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the above-described conventional technology.

[0428] Subsequently, the computer program in the embodiment of the present disclosure will be described.

[0429] The computer program according to an embodiment of the present disclosure can be executed in an information processing system 3000 including one or more user terminals 100, 200 and a server device 400.

[0430] The computer program according to the present disclosure causes one or more computer processors included in the information processing system 3000 to realize a reception function, a transmission function, an analysis function, and a display control function.

[0431] The reception function receives voice information related to at least the voice of the first user, which is transmitted from the first user terminal of the first user.

[0432] The transmission function transmits information for causing a video related to the first user to be displayed on the first user terminal and / or the second user terminal of the second user to the first user terminal and / or the second user terminal.

[0433] The analysis function analyzes whether a specific word is included in the voice based on the voice information.

[0434] The display control function controls the display of the video based on display control information associated with a specific word included in the voice according to the result analyzed by the analysis function.

[0435] The above functions can be realized by a reception circuit 1410, a transmission circuit 1420, an analysis circuit 1430, and a display control circuit 1440 shown in FIG. 35. The reception circuit 1410, the transmission circuit 1420, the analysis circuit 1430, and the display control circuit 1440 are assumed to be realized by the reception unit 410, the transmission unit 420, the analysis unit 430, and the display control unit 440 described above, respectively. Details of each unit are as described above.

[0436] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0437] Next, an information processing apparatus according to an embodiment of the present disclosure will be described. The information processing apparatus corresponds to the first user terminal 100 in the information processing system 3000 described above.

[0438] The information processing apparatus is an information processing apparatus including one or more computer processors, and the one or more computer processors include a transmission unit 110, a reception unit 120, and a display control unit 130 as shown in FIG. 36.

[0439] The transmission unit 110 transmits at least voice information regarding the voice of the first user to the server device.

[0440] The reception unit 120 receives information for displaying a video regarding the first user from the server device.

[0441] The display control unit 130 controls the display of the video based on display control information associated with a specific word included in the voice according to the result of analyzing whether the voice includes the specific word based on the voice information. The display control unit 130 can have the same configuration as the display control unit 440 described above.

[0442] Further, the one or more computer processors may include an analysis unit that analyzes whether the voice includes a specific word based on the voice information. At this time, the analysis unit can have the same configuration as the analysis unit 430 described above.

[0443] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0444] Next, an example of an information processing method according to an embodiment of the present disclosure will be described. Such an information processing method is an information processing method executed in the above-described information processing apparatus (first user terminal 100).

[0445] As shown as an example in FIG. 37, the information processing method in the present disclosure is characterized in that one or more computer processors included in an information processing apparatus execute a transmission step S110, a reception step S120, and a display control step S130.

[0446] The transmission step S110 transmits voice information regarding the voice of at least a first user to a server apparatus. Such a transmission step S110 can be executed by the above-described transmission unit 110.

[0447] The reception step S120 receives information for displaying a video regarding the first user from the server apparatus. Such a reception step S120 can be executed by the above-described reception unit 120.

[0448] The display control step S130 controls the display of the video based on display control information associated with a specific word included in the voice according to the result of analyzing whether the voice includes the specific word based on the voice information. Such a display control step S130 can be executed by the above-described display control unit 130.

[0449] Also, the information processing method in the embodiment of the present disclosure may be such that the one or more computer processors execute an analysis step of analyzing whether the voice includes a specific word based on the voice information. At this time, the analysis step can have the same configuration as the above-described analysis step S430.

[0450] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the above-described conventional technology.

[0451] Subsequently, a computer program in the embodiment of the present disclosure will be described. Such a computer program is a computer program executed in the above-described information processing apparatus (first user terminal 100).

[0452] The computer program in the present disclosure causes one or more processors included in an information processing apparatus to realize a transmission function, a reception function, and a display control function.

[0453] The transmission function transmits voice information related to the voice of at least a first user to a server device.

[0454] The reception function receives, from a server device, information for displaying a video related to the first user.

[0455] The display control function controls the display of the video based on display control information associated with a specific word included in the voice according to the result of analyzing whether the voice includes the specific word based on the voice information.

[0456] The above functions can be realized by a transmission circuit 1110, a reception circuit 1120, and a display control circuit 1130 shown in FIG. 38. It is assumed that the transmission circuit 1110, the reception circuit 1120, and the display control circuit 1130 are realized by the above-described transmission unit 110, reception unit 120, and display control unit 130, respectively. Details of each unit are as described above.

[0457] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0458] Subsequently, an information processing apparatus according to an embodiment of the present disclosure will be described. The information processing apparatus corresponds to the second user terminal 200 in the information processing system 3000 described above.

[0459] The information processing apparatus is an information processing apparatus including one or more computer processors, and the one or more computer processors include a reception unit 210 and a display control unit 220 as shown in FIG. 39.

[0460] The reception unit 210 receives, from a server device, information for displaying a video related to the first user.

[0461] The display control unit 220 controls the display of the video based on the display control information associated with the specific word included in the voice according to the result of analyzing whether the voice includes a specific word based on the voice information. The display control unit 220 can have the same configuration as the above-described display control unit 440.

[0462] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the above-described prior art.

[0463] Subsequently, an example of the information processing method in the embodiment of the present disclosure will be described. Such an information processing method is an information processing method executed in the above-described information processing apparatus (second user terminal 200).

[0464] The information processing method in the present disclosure is characterized in that one or more computer processors included in the information processing apparatus execute a reception step S210 and a display control step S220, as shown as an example in FIG. 40.

[0465] The reception step S210 receives, from the server device, information for displaying a video related to the first user. Such a reception step S210 can be executed by the above-described reception unit 210.

[0466] The display control step S220 controls the display of the video based on the display control information associated with the specific word included in the voice according to the result of analyzing whether the voice includes a specific word based on at least the voice information related to the voice of the first user. Such a display control step S220 can be executed by the above-described display control unit 220.

[0467] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the above-described prior art.

[0468] Finally, a computer program in an embodiment of the present disclosure will be described. Such a computer program is a computer program executed in the information processing apparatus (second user terminal 200) described above.

[0469] The computer program in the present disclosure is characterized in that it causes one or more processors included in the information processing apparatus to realize a reception function and a display control function.

[0470] The reception function receives information for displaying a video related to the first user from the server device.

[0471] The display control function controls the display of the video based on display control information associated with a specific word included in the voice, according to the result of analyzing whether the voice contains a specific word based on at least voice information related to the voice of the first user.

[0472] The above functions can be realized by the reception circuit 1210 and the display control circuit 1220 shown in FIG. 41. It is assumed that the reception circuit 1210 and the display control circuit 1220 are respectively realized by the reception unit 210 and the display control unit 220 described above. Details of each unit are as described above.

[0473] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0474] In addition, in order to function as the server device or the terminal device according to the above-described embodiment, an information processing apparatus such as a computer or a mobile phone can be preferably used. Such an information processing apparatus can be realized by storing a program describing the processing content for realizing each function of the server device or the terminal device according to the embodiment in the storage unit of the information processing apparatus and reading out and executing the program by the CPU of the information processing apparatus.

[0475] FIG. 42 is a block diagram of a processing circuit that executes computer-based operations in accordance with the present disclosure. FIG. 42 shows a processing circuit 600, which corresponds to the CPU of the terminals and devices in the present disclosure.

[0476] The processing circuit 600 is used to control any computer-based and cloud-based control processes, and the flowchart descriptions or blocks can be understood as representing modules, segments, or portions of code that include one or more executable instructions for implementing specific logical functions or steps within the process. Alternative implementations are included within the scope of the exemplary embodiments of the present disclosure in which the functions can be executed. The order from that illustrated or discussed can include substantially simultaneous or reverse order depending on the functionality involved, as understood by those skilled in the art. The functionality of the elements disclosed herein can be implemented using a circuit or processing circuit that can include a general-purpose processor, a special-purpose processor, an integrated circuit, an ASIC ("application-specific integrated circuit"), a conventional circuit configured or programmed to execute the disclosed functions, and / or a combination thereof. The processor processes a circuit or circuits, such as by including transistors and other circuits therein. The processor can be a programmed processor that executes a program stored in a memory. In the present disclosure, a processing circuit, unit, or means is hardware that performs or is programmed to perform the recited functions. The hardware can be any hardware disclosed herein or any other hardware known in any other way programmed or configured to perform the recited functions.

[0477] In FIG. 42, the processing circuit 600 includes a CPU 601 that executes one or more control processes discussed in this disclosure. Process data and instructions may be stored in the memory 602. These processes and instructions may also be stored in a storage medium disk 604 such as a hard drive (HDD) or a portable storage medium, or may be stored remotely. Further, the claimed advancement is not limited by the form of the computer-readable medium in which the instructions of the processes of the present invention are stored. For example, the instructions may be stored on a CD, DVD, flash memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk, or any other non-transitory computer-readable medium of an information processing apparatus that the processing circuit 600 communicates with, such as a server or a computer. The processes may also be stored and executed in a network-based storage, cloud-based storage, or other mobile-accessible storage by the processing circuit 600.

[0478] Further, the advancement of the claims may be provided as a utility application, background daemon, or component of an operating system, or a combination thereof, and is executed with the CPU 601 and an operating system, such as Microsoft Windows, UNIX, Solaris, LINUX, Apple MAC-OS, Apple iOS, and other systems known to those skilled in the art.

[0479] The hardware elements for realizing the processing circuit 600 may be realized by various circuit elements. Also, each function of the above-described embodiments may be realized by a circuit including one or more processing circuits. The processing circuit particularly includes a programmed processor, for example, a processor (CPU) 601 as shown in FIG. 42. The processing circuit also includes devices such as application-specific integrated circuits (ASICs) and conventional circuit components arranged to execute the recited functions.

[0480] Alternatively, or in addition, the CPU 601 may be implemented on an FPGA, ASIC, PLD, or using discrete logic circuitry, as would be recognized by one of ordinary skill in the art. Further, the CPU 601 may be realized as a plurality of processors that operate in parallel and cooperate to execute the instructions of the present invention process described above.

[0481] The processing circuit 600 of FIG. 42 also includes a network controller 606, such as an Ethernet PRO network interface card, for interfacing with a network 700. As can be appreciated, the network 700 can be a public network such as the Internet, or a private network such as a local area network (LAN) or wide area network (WAN), or any combination thereof, and can include a public switched telephone network (PSTN) or an integrated services digital network (ISDN) subnetwork. The network 700 can also be wired, such as an Ethernet network, a universal serial bus (USB) cable, or wireless, such as a cellular network including an EDGE, 3G, and 4G wireless cellular system. The wireless network can also be Wi-Fi, a wireless LAN, Bluetooth, or any other known wireless communication modality. Further, the network controller 606 may conform to other direct communication standards such as Bluetooth, near field communication (NFC), infrared, or others.

[0482] The processing circuit 600 further includes a display controller 608, such as a graphics card or graphics adapter, for interfacing with a display 609, such as a monitor. The I / O interface 612 interfaces with a keyboard and / or mouse 614, and a touch screen panel 616 that is either on or separate from the display 609. The I / O interface 612 also connects to various peripheral devices 618.

[0483] The storage controller 624 connects the storage medium disk 604 to a communication bus 626 which can be ISA, EISA, VESA, PCI, or the like, and interconnects all components of the processing circuit 600. Explanation of the general features and functionality of the display 609, keyboard and / or mouse 614, and the display controller 608, storage controller 624, network controller 606, and I / O interface 612 is omitted in this specification for the sake of brevity since these features are well-known.

[0484] The exemplary circuit elements described in the context of the present disclosure may be replaced with other elements and may have a structure different from the embodiments provided herein. Further, a circuit configured to perform the functions described herein may be implemented with multiple circuit units (e.g., chips), or the features may be combined in a circuit on a single chipset.

[0485] The functions and features described herein may also be performed by various distributed components of the system. For example, one or more processors may execute these system functions, where the processors are distributed among multiple components communicating within a network. The distributed components can include one or more clients and server machines that can share the processing, in addition to various human interface and communication devices (e.g., display monitors, smartphones, tablets, personal digital assistants (PDAs)). The network may be a private network such as a LAN or WAN, or a public network such as the Internet. Inputs to the system can be received directly via user input or remotely as a real-time or batch process. Further, some implementations may be executed on modules or hardware that are not the same as those described. Thus, other implementations are within the scope that may be claimed.

[0486] Although some embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalent scope thereof.

[0487] In addition, the method described in the embodiment can be stored as a program executable on a computer (computer) in a recording medium such as a magnetic disk (floppy (registered trademark) disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), a semiconductor memory (ROM, RAM, flash memory, etc.), etc., and can also be transmitted and distributed by a communication medium. Note that the program stored on the medium side includes a setting program for configuring software means (including not only an execution program but also a table and a data structure) to be executed on a computer in the computer. The computer that realizes this device reads the program recorded on the recording medium, and in some cases, constructs software means by a setting program, and executes the above-described processing by being controlled by this software means. Note that the recording medium referred to in this specification includes not only a storage medium such as a magnetic disk or a semiconductor memory provided inside a computer or in a device connected via a network, but also a storage medium for distribution. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. 〔Supplementary Note〕 The description of the claims of the original application of the present application at the time of filing is appended below. [1] An information processing system including one or more computer processors, wherein the one or more computer processors include a receiving unit that receives voice information related to at least the voice of the first user transmitted from a first user terminal of the first user, A transmission unit that transmits information for causing a video related to the first user to be displayed on the first user terminal and / or a second user terminal of the second user to the first user terminal and / or the second user terminal, An analysis unit that analyzes whether a specific word is included in the voice based on the voice information, A display control unit that controls the display of the video based on display control information associated with a specific word included in the voice according to the result analyzed by the analysis unit An information processing system comprising: [2] The specific word is a word related to an action that requires an operation on the first user terminal, The display control information is information for causing an operation object associated with the action to appear on the video or the screen of the first user terminal, highlighting and displaying the operation object associated with the action displayed on the video or the screen of the first user terminal, and / or displaying an operation screen associated with the action. The information processing system according to claim 1, characterized in that [3] The specific word is a word related to an action that requires an operation on the second user terminal, The display control information is information for causing an operation object associated with the action to appear on the video or the screen of the second user terminal, highlighting and displaying the operation object associated with the action displayed on the video or the screen of the second user terminal, and / or displaying an operation screen associated with the action. The information processing system according to claim 1, characterized in that [4] The display control unit When the specific word is a word related to an action that requires an operation on the first user terminal, controls the display of the video in the videos displayed on the first user terminal and the second user terminal, The information processing system according to claim 1, wherein when the specific word is a word related to an action that requires an operation on the second user terminal, the control of the display of the video is performed only in the video displayed on the second user terminal. [5] The one or more computer processors further The information processing system according to claim 2 or 3, further comprising an effect generation unit that generates a specific effect in the first user terminal and / or the second user terminal when the action is executed by selecting the operation object that appears or is highlighted and displayed in the video. [6] The specific word is a word related to a request, The information processing system according to claim 1, wherein the display control information is information for causing an object associated with the request to appear in the video and / or information for causing the object displayed in the video to be highlighted and displayed. [7] The object associated with the request is an actual product and / or a lottery object that can be obtained by lottery for a product object, a shop object representing a shop where the actual product and / or the product object can be purchased, or an advertisement object for representing an advertisement related to the actual product and / or the product object. The information processing system according to claim 6. [8] The one or more computer processors When the winning of the actual product is determined by an operation on the lottery object in the first user terminal, or when an actual product is ordered via the shop object and / or the advertisement object in the first user terminal, an order unit that transmits information regarding the winning or the order and at least the address information of the first user included in the user information of the first user to an information processing device of a physical store associated with the lottery object, the shop object, and / or the advertisement object. The information processing system according to claim 7, characterized by comprising the above. [9] When an actual product is ordered via the shop object and / or the advertisement object in the first user terminal, the display control unit causes a product object corresponding to the actual product to be displayed in the video. The information processing system according to claim 7 or 8, characterized by the above.

[10] The specific word is a word related to a specific item, The one or more computer processors further, Comprise a determination unit for determining whether the specific item is associated with the first user terminal, When it is determined by the determination unit that the specific item is associated with the first user terminal, The display control unit, Information for causing a specific object corresponding to the specific item to appear in the video, Information for highlighting and displaying the specific object displayed in the video, and / or, Information for displaying a list screen of items associated with the first user terminal including the specific item Based on the display control information as described above, the information processing system according to claim 1, characterized in that the display of the video is controlled.

[11] When it is determined by the determination unit that the specific item is not associated with the first user terminal, The display control unit information for causing a lottery object that can acquire the specific item by lottery, a shop object representing a shop where the specific item can be purchased, or an advertisement object for representing an advertisement related to the specific item to appear in the video, and / or information for causing the lottery object, the shop object, and / or the advertisement object displayed in the video to be displayed in an emphasized manner Based on the display control information, the information processing system according to claim 10, wherein the display of the video is controlled.

[12] When it is determined by the determination unit that the specific item is not associated with the first user terminal, the display control unit controls the video based on display control information that is information for causing a lead wire to a screen related to a user terminal of another user having the specific item to appear in the video. The information processing system according to claim 10.

[13] The specific word is a word related to an event in the real space, The information processing system according to claim 1, wherein the display control information is information for causing a real object associated with the event in the real space to appear in the video.

[14] The specific word is a word included in specific text displayed in the video, The information processing system according to claim 1, wherein the display control unit highlights the specific text.

[15] The information processing system according to claim 14, wherein the specific text is a comment posted from the first user terminal or the second user terminal, or a system comment.

[16] The information processing system according to claim 15, wherein the highlighted display includes displaying an object related to the character object of the user who posted the comment.

[17] The information processing system according to claim 1, wherein the video displays the character object of the first user and a virtual space in which the character object can move.

[18] When the second user terminal is associated with the first user terminal, At least a part of the virtual space is shared with the second user terminal, The information processing system according to claim 17, wherein the effect of controlling the display of the video by the display control unit extends to both the first user terminal and the second user terminal.

[19] When the second user terminal is not associated with the first user terminal, At least a part of the virtual space is shared with the second user terminal, The information processing system according to claim 18, wherein the effect of controlling the display of the video by the display control unit extends to only one of the first user terminal and the second user terminal.

[20] The one or more computer processors The information processing system according to claim 1, further comprising a setting unit capable of setting whether to control the display of the video according to the result analyzed by the analysis unit.

[21] The information processing system according to claim 1, wherein the first user is a distribution user and the second user is one or more viewing users.

[22] The receiving unit receives a plurality of pieces of audio information regarding the voices of a plurality of users transmitted from a plurality of user terminals including the first user terminal, The analysis unit analyzes whether each of the plurality of voices includes a specific word, The information processing system according to claim 1, wherein the display control unit controls the display of the video based on specific words included in the voice and display control information associated with the number of voices including the specific words.

[23] The information processing system according to claim 1, wherein the specific word is set based on an operation of the first user terminal.

[24] The receiving unit receives operation information regarding the operation of the first user, which is transmitted from the first user terminal. The information processing system according to claim 1, wherein a character object of the first user that operates based on the operation information is displayed in the video.

[25] On one or more computer processors, a receiving step of receiving voice information regarding at least the voice of the first user, which is transmitted from the first user terminal of the first user; a transmitting step of transmitting information for displaying a video regarding the first user to the first user terminal and / or the second user terminal of the second user; an analyzing step of analyzing whether specific words are included in the voice based on the voice information; a display control step of controlling the display of the video based on display control information associated with specific words included in the voice according to the result analyzed in the analyzing step An information processing method for causing the execution.

[26] On one or more computer processors, a transmitting step of transmitting at least voice information regarding the voice of the first user to a server device; a receiving step of receiving information for displaying a video regarding the first user from the server device; A display control step of controlling the display of the video based on display control information associated with a specific word included in the voice according to a result of analyzing whether the specific word is included in the voice based on the voice information An information processing method for causing execution.

[27] On one or more computer processors, A transmission function of transmitting voice information regarding the voice of at least a first user to a server device, A reception function of receiving, from the server device, information for displaying a video regarding the first user, A display control function of controlling the display of the video based on display control information associated with a specific word included in the voice according to a result of analyzing whether the specific word is included in the voice based on the voice information A computer program for realizing.

[28] On one or more computer processors, A reception step of receiving, from a server device, information for displaying a video regarding a first user, A display control step of controlling the display of the video based on display control information associated with a specific word included in the voice according to a result of analyzing whether the specific word is included in the voice based on at least the voice information regarding the voice of the first user An information processing method for causing execution.

[29] On one or more computer processors, A reception function of receiving, from a server device, information for displaying a video regarding a first user, A display control function of controlling the display of the video based on display control information associated with a specific word included in the voice according to a result of analyzing whether the specific word is included in the voice based on at least the voice information regarding the voice of the first user A computer program for realizing.

Explanation of Signs

[0488] 100 First user terminal 200 Second user terminal 300 Network 400 Server device 410 Receiver 420 Transmitter 430 Analysis unit 440 Display control unit

Claims

1. An information processing system including one or more computer processors, the one or more computer processors: A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis unit that analyzes whether the voice includes a specific word based on the voice information; a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit; Equipped with The display control unit of the information processing system displays a specific object displayed in the video in an emphasized manner, or displays another screen instead of or in addition to the screen displayed in the video.

2. 2. The information processing system according to claim 1, wherein the video displays a character object of the first user and a virtual space in which the character object can move.

3. If the second user terminal is associated with the first user terminal, At least a portion of the virtual space is shared with a second user terminal; 3 . The information processing system according to claim 2 , wherein the effect of the control of the display of the video by the display control unit extends to both the first user terminal and the second user terminal.

4. if the second user terminal is not associated with the first user terminal, At least a portion of the virtual space is shared with a second user terminal, 4. The information processing system according to claim 3, wherein the effect of the control of the display of the video by the display control unit extends to only one of the first user terminal and the second user terminal.

5. the one or more computer processors: The information processing system according to claim 1 , further comprising a setting unit capable of setting whether or not to control the display of the video in accordance with the result of the analysis by the analysis unit.

6. 2. The information processing system according to claim 1, wherein the first user is a distribution user, and the second user is one or more viewing users.

7. 2. The information processing system according to claim 1, wherein the specific word is set based on an operation of the first user terminal.

8. The receiving unit receives motion information regarding a motion of the first user transmitted from the first user terminal; 2. The information processing system according to claim 1, wherein the video includes a character object of the first user that moves based on the action information.

9. The receiving unit receives a plurality of pieces of voice information related to voices of a plurality of users transmitted from a plurality of user terminals including the first user terminal, The analysis unit analyzes whether each of the plurality of voices includes a specific word, The information processing system according to claim 1, characterized in that the display control unit controls the display of the video based on display control information associated with a specific word contained in the audio and a number of audio containing the specific word.

10. one or more computer processors, a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis step of analyzing whether the voice includes a specific word based on the voice information; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step; Run the command, An information processing method in which the display control step highlights a specific object displayed in the video, or displays another screen instead of or in addition to the screen displayed in the video.

11. one or more computer processors, a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device; a receiving step of receiving information for displaying a video related to the first user from the server device; a display control step of controlling display of the video based on display control information associated with the specific word included in the audio in response to a result of analyzing whether the audio includes a specific word based on the audio information; Run the command, An information processing method in which the display control step highlights a specific object displayed in the video, or displays another screen instead of or in addition to the screen displayed in the video.

12. one or more computer processors, A transmission function of transmitting voice information related to at least the voice of the first user to the server device; a receiving function for receiving information for displaying a video related to the first user from the server device; a display control function that controls display of the video based on display control information associated with a specific word included in the audio in response to a result of an analysis of whether the audio includes a specific word based on the audio information; Realize this, The display control function is a computer program that highlights a specific object displayed in the video, or displays another screen instead of or in addition to the screen displayed in the video.

Images