Information processing system, information processing method, and computer program

Abstract

To increase the motivation of a delivery user regarding delivery, the motivation of a viewing user regarding viewing and / or the motivation of the users to communicate with each other.SOLUTION: An information processing system is equipped with one or more computer processors, the one or more computer processors including: a receiving unit which receives at least voice information on voice of a first user transmitted from a first user terminal of the first user; a transmission unit which transmits information for causing the first user terminal and / or a second user terminal of a second user to display a video on the first user, to the first user terminal and / or the second user terminal; an analysis unit which analyzes, based on the voice information, whether a specific word is included in the voice; and a display control unit which controls, according to a result analyzed by the analysis unit, display of the video on the basis of display control information associated with the specific word included in the voice.SELECTED DRAWING: Figure 26

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and a computer program. [Background technology]

[0002] 2. Description of the Related Art There is known an information processing system that generates animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-184689 A Summary of the Invention [Problem to be solved by the invention]

[0004] In this technical field, how to increase distribution users' willingness to distribute, viewing users' willingness to view, and / or users' willingness to interact with each other is an important issue.

[0005] An object of the present disclosure is to provide technical improvements that solve or mitigate at least some of the problems of the prior art discussed above.

[0006] One of the more specific objectives of the present disclosure is to provide an information processing system, an information processing method, and a computer program that can increase distribution users' motivation to distribute, viewing users' motivation to watch, and / or users' motivation to interact with each other. [Means for solving the problem]

[0007] The information processing system of the present disclosure is an information processing system having one or more computer processors, the one or more computer processors being characterized in having a receiving unit that receives audio information related to at least the voice of the first user transmitted from a first user terminal of a first user, a transmitting unit that transmits information to the first user terminal and / or the second user terminal for displaying a video related to the first user on the first user terminal and / or the second user terminal of a second user, an analysis unit that analyzes whether the audio contains specific words based on the audio information, and a display control unit that controls the display of the video based on display control information associated with the specific words contained in the audio in accordance with the results of the analysis by the analysis unit.

[0008] The specific word is a word related to an action that requires operation on the first user terminal, and the display control information can be information for causing an operation object associated with the action to appear on the video or the screen of the first user terminal, for highlighting an operation object associated with the action displayed on the video or the screen of the first user terminal, and / or for displaying an operation screen associated with the action.

[0009] The specific word is a word related to an action that requires operation on the second user terminal, and the display control information can be information for causing an operation object associated with the action to appear on the video or the screen of the second user terminal, for highlighting an operation object associated with the action displayed on the video or the screen of the second user terminal, and / or for displaying an operation screen associated with the action.

[0010] The display control unit controls the display of the video in the video displayed on the first user terminal and the second user terminal when the specific word is a word related to an action that requires an operation on the first user terminal, and controls the display of the video only in the video displayed on the second user terminal when the specific word is a word related to an action that requires an operation on the second user terminal.

[0011] The one or more computer processors may further include an effect generation unit that generates a particular effect in the first user terminal and / or the second user terminal when an action is performed by selecting an operation object that appears or is displayed highlighted in the video.

[0012] The specific word may be a word related to the request, and the display control information may be information for causing an object associated with the request to appear in the video and / or information for causing an object displayed in the video to be displayed in an emphasized manner.

[0013] The object associated with the request may be a lottery object that allows real products and / or product objects to be obtained by lottery, a shop object that represents a shop where real products and / or product objects can be purchased, or an advertising object for representing an advertisement for real products and / or product objects.

[0014] The one or more computer processors may be equipped with an order unit that, when a win of a real product is determined by an operation on a lottery object on the first user terminal, or when a real product is ordered via a shop object and / or an advertising object on the first user terminal, sends information regarding the win or information regarding the order, and at least the first user's address information contained in the user information of the first user, to an information processing device of a physical store associated with the lottery object, shop object, and / or advertising object.

[0015] When a real product is ordered on the first user terminal via the shop object and / or the advertisement object, the display control unit can cause a product object corresponding to the real product to be displayed in the video.

[0016] The specific word is a word related to a specific item, and the one or more computer processors further include a judgment unit that determines whether the specific item is associated with the first user terminal, and when the judgment unit determines that the specific item is associated with the first user terminal, the display control unit can control the display of the video based on display control information that is information for making a specific object corresponding to the specific item appear in the video, information for highlighting a specific object displayed in the video, and / or information for displaying a list screen of items associated with the first user terminal, including the specific item.

[0017] If the determination unit determines that a specific item is not associated with the first user terminal, the display control unit can control the display of the video based on display control information, which is information for making a lottery object that can obtain the specific item by lottery, a shop object representing a shop where the specific item can be purchased, or an advertising object representing an advertisement related to the specific item appear in the video, and / or information for highlighting and displaying the lottery object, shop object and / or advertising object displayed in the video.

[0018] When the determination unit determines that a specific item is not associated with the first user terminal, the display control unit can control the video based on display control information, which is information for making a line to a screen associated with a user terminal of another user who has the specific item appear in the video.

[0019] The specific word may be a word related to an event in real space, and the display control information may be information for causing a real object associated with the event in real space to appear in the video.

[0020] The specific word is a word contained in a specific text displayed in the video, and the display control unit can highlight the specific text.

[0021] The specific text may be a comment posted from the first user terminal or the second user terminal, or a system comment.

[0022] The highlighting may include displaying an object related to the character object of the user who posted the comment.

[0023] The video may display a character object of the first user and a virtual space in which the character object can move.

[0024] When the second user terminal is associated with the first user terminal, at least a portion of the virtual space is shared with the second user terminal, and the effect of controlling the display of the video by the display control unit can extend to both the first user terminal and the second user terminal.

[0025] When the second user terminal is not associated with the first user terminal, at least a portion of the virtual space is shared with the second user terminal, but the effect of controlling the display of the video by the display control unit can extend to only one of the first user terminal and the second user terminal.

[0026] The one or more computer processors may include a setting unit capable of setting whether or not to control the display of the moving image in accordance with the results of the analysis by the analysis unit.

[0027] The first user may be a broadcast user and the second user may be one or more viewing users.

[0028] The receiving unit receives multiple pieces of audio information regarding the audio of multiple users transmitted from multiple user terminals including the first user terminal, the analysis unit analyzes whether each of the multiple pieces of audio contains a specific word, and the display control unit controls the display of the video based on display control information associated with the specific word contained in the audio and the number of audios containing the specific word.

[0029] The specific word may be set based on an operation of the first user terminal.

[0030] The receiving unit receives motion information regarding a motion of the first user transmitted from the first user terminal, and the video can display a character object of the first user moving based on the motion information.

[0031] The information processing method of the present disclosure is characterized in that it has one or more computer processors execute a receiving step of receiving audio information related to at least the audio of a first user, transmitted from a first user terminal of a first user; a transmitting step of transmitting information to the first user terminal and / or the second user terminal for displaying a video related to the first user on the first user terminal and / or the second user terminal of a second user; an analysis step of analyzing whether the audio contains specific words based on the audio information; and a display control step of controlling the display of the video based on display control information associated with the specific words contained in the audio according to the results of the analysis in the analysis step.

[0032] The information processing method of the present disclosure is characterized in that it has one or more computer processors execute a transmitting step of transmitting audio information regarding at least the audio of a first user to a server device, a receiving step of receiving information for displaying a video regarding the first user from the server device, and a display control step of controlling the display of the video based on display control information associated with a specific word contained in the audio, depending on the result of analyzing whether the audio contains a specific word based on the audio information.

[0033] The computer program of the present disclosure is characterized in that it causes one or more computer processors to realize a transmitting function of transmitting audio information regarding at least the voice of a first user to a server device, a receiving function of receiving information for displaying a video regarding the first user from the server device, and a display control function of controlling the display of the video based on display control information associated with specific words contained in the audio, depending on the results of an analysis of whether the audio contains specific words based on the audio information.

[0034] The information processing method of the present disclosure is characterized in that it has one or more computer processors execute a receiving step of receiving information for displaying a video related to a first user from a server device, and a display control step of controlling the display of an image based on display control information associated with a specific word contained in the audio, depending on the result of analyzing whether the audio contains a specific word based on audio information related to at least the first user's audio.

[0035] The computer program of the present disclosure is characterized in that it implements in one or more computer processors a receiving function for receiving information for displaying a video related to a first user from a server device, and a display control function for controlling the display of the video based on display control information associated with specific words contained in the audio, depending on the results of an analysis of whether the audio contains specific words based on audio information related to at least the first user's audio. Effect of the Invention

[0036] According to the present disclosure, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the configuration of the present disclosure, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other. [Brief description of the drawings]

[0037] [Figure 1]1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Diagram 2] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Diagram 3] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 4] 2 is a configuration diagram showing an example of the hardware configuration of a server device, a broadcast user terminal, and a viewing user terminal in the present disclosure. [Diagram 5] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 6] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 7] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 8] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 9] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 10] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 11] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 12] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 13] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 14] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 15] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 16] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 17] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 18] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 19] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 20] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 21] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 22] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Diagram 23] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 24] FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. [Diagram 25] FIG. 2 is a configuration diagram illustrating an example of a functional configuration of a server device according to the present disclosure. [Figure 26] FIG. 2 is a data configuration diagram showing an example of a data table stored in a storage device in the present disclosure. [Figure 27] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 28] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 29] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Diagram 30] 11 is a conceptual diagram showing a first user and an image of a screen displayed on a user terminal. FIG. [Diagram 31] 11 is a conceptual diagram showing a first user and an image of a screen displayed on a user terminal. FIG. [Diagram 32] FIG. 13 is a configuration diagram showing another example of the functional configuration of the server device in the present disclosure. [Diagram 33] 11 is a conceptual diagram showing a first user and an image of a screen displayed on a user terminal. FIG. [Diagram 34] FIG. 1 is a flow diagram showing an example of the flow of an information processing method according to the present disclosure. [Diagram 35] FIG. 2 is a circuit configuration diagram showing an example of a circuit configuration for implementing a computer program according to the present disclosure. [Diagram 36] FIG. 2 is a configuration diagram showing an example of a functional configuration of a first user terminal in the present disclosure. [Figure 37] 11 is a flow diagram showing an example of the flow of an information processing method in a first user terminal in the present disclosure. [Figure 38] FIG. 2 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a first user terminal in the present disclosure. [Figure 39] FIG. 2 is a configuration diagram showing an example of a functional configuration of a second user terminal in the present disclosure. [Diagram 40] 11 is a flow diagram showing an example of the flow of an information processing method in a second user terminal in the present disclosure. [Diagram 41] FIG. 11 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a second user terminal in the present disclosure. [Diagram 42] FIG. 1 is a block diagram of processing circuitry for performing computer-based operations in the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0038] First, an overview of an information processing system according to an embodiment of the present disclosure will be described with reference to the drawings.

[0039] The information processing system in the present disclosure is an information processing system including one or more client devices and a server device, and includes one or more computer processors.

[0040] The video displayed on each client device will be described as including animation of a 3D or 2D character object generated based on the broadcaster's movements, but is not limited to this and may include animation of a character object generated in response to the broadcaster's operation, or may include an image of the broadcaster himself / herself. Also, these character objects and the broadcaster may not be displayed, and only the voice of the broadcaster may be included.

[0041] Here, a distribution user refers to a user who transmits information related to video and / or audio. For example, a distribution user may be a user who hosts or organizes a single video distribution, a collaborative distribution in which multiple people can participate, a video chat or voice chat in which multiple people can participate and / or watch, or an event (such as a party) in a virtual space in which multiple people can participate and / or watch, that is, a user who mainly carries out these activities. Therefore, a distribution user in this disclosure can also be referred to as a host user, organizer user, or organizer user.

[0042] On the other hand, a viewing user means a user who receives information about video and / or audio. However, a viewing user can be a user who is capable of not only receiving the above information but also reacting to it. For example, a viewing user may be a user who watches a video distribution or a collaboration distribution, or a user who participates in and / or watches a video chat, a voice chat, or an event. Therefore, a viewing user in the present disclosure can also be referred to as a guest user, a participating user, a listener, a viewing user, a supporting user, or the like.

[0043] In addition, the information processing system in an embodiment of the present disclosure can be used to provide a next Internet space (metaverse) in which many people can participate simultaneously and freely engage in activities such as interacting, working, and playing through character objects (avatars) at a level close to that of the real world, and in which social activities can take place beyond the gap between reality and virtuality.

[0044] In such a space, users' avatars can move freely around the world and communicate with each other.

[0045] One of the avatars (character object) in the virtual space may be configured to distribute video as a character object of a distribution user. In other words, one-to-many video distribution may be possible in a many-to-many metaverse virtual space.

[0046] In such a space, there may be no particular distinction between broadcast users and viewing users.

[0047] The space shown in the video may be a virtual space, a real space, or an augmented reality space that combines these. The video may be something like a karaoke video or a game commentary video that reproduces at least a predetermined image and the voice of the broadcasting user, or may be a display in which a character object or an actual image of the broadcasting user is superimposed on the video.

[0048] Furthermore, when a broadcast user is included in the real space, a character object generated based on the movement of the broadcast user may be displayed superimposed on an actual image of the broadcast user. Also, an animation of a gift object or the like may be displayed superimposed on an image captured in the real space.

[0049] <System configuration> As shown as an example in FIG. 1, the information processing system 1000 according to the present disclosure may include one or more viewing user terminals 1100, and an information processing device (support computer) 1300 located in a video distribution studio or the like, which is connected to these viewing user terminals 1100 via a network 1200.

[0050] Moreover, the information processing device 1300 may be connected to a predetermined server device via the Internet, and a part or all of the processing to be performed by the information processing device 1300 may be performed by the server device. Such a server device may be the information processing device 2400 shown in FIG.

[0051] In this specification, such distribution by the information processing system 1000 is referred to as studio distribution.

[0052] In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.

[0053] Furthermore, the information processing system 1000 of the present invention can cooperate with another information processing system 2000 shown as an example in Fig. 2. The information processing system 2000 shown in Fig. 2 can include a broadcaster user terminal 2100, one or more viewer user terminals 2200, and an information processing device (server device) 2400 connected to the broadcaster user terminal 2100 and the viewer user terminal 2200 via a network 2300.

[0054] In the above example, the broadcaster user terminal 2100 may be an information processing terminal such as a smartphone. In this specification, such broadcasting by the information processing system 2000 is referred to as mobile broadcasting.

[0055] In mobile distribution, the broadcast user's facial movements are captured by a camera mounted on the broadcast user terminal 2100, and are reflected on the character's face in real time using known face tracking technology.

[0056] In addition, there is no particular distinction between distributor users and viewing users in mobile distribution; viewing users can perform mobile distribution at any time, and distributor users can become viewing users when viewing videos of other distributor users.

[0057] The moving images generated by the information processing system 1000 and the information processing system 2000 can be distributed to viewing users from one moving image distribution platform, for example.

[0058] In addition, in any broadcast, the process of generating animation by reflecting motion on a character and the process of displaying gifts, which will be described later, may be shared and performed by the broadcasting user terminal, the viewing user terminal, an information processing device, and other devices.

[0059] In other words, "distribution" here refers to the transmission of information to enable the video to be viewed on the viewing user's terminal, and the rendering of the video may be performed on the information processing device 1300, 2400 side, or on the distribution user terminal 2100 or the viewing user terminal 1100, 2200 side.

[0060] Specifically, face motion data and voice data of a broadcast user are transmitted from a broadcast user terminal or an information processing device to a terminal or device that generates (renders) animation of a character object. Also, body motion may be transmitted in addition to face motion.

[0061] In the present disclosure, the process of generating animation will be described as being performed by each of the broadcasting user terminal and the viewing user terminal, but this is not limited to the above.

[0062] The information processing system in the present disclosure can be applied to both of the examples shown in Fig. 1 and Fig. 2. Therefore, an information processing system 3000 in the embodiment of the present disclosure will be described as including a first user terminal 100, a second user terminal 200, and a server device 400 connectable to the first user terminal 100 and the second user terminal 200 via a network 300, as shown in Fig. 3.

[0063] The first user terminal 100 and the second user terminal 200 are connected to the server device 400 via, for example, a base station, a mobile communication network, a gateway, and the Internet. Between the first user terminal 100 and the second user terminal 200 and the server device 400, communication is performed based on a communication protocol such as Hypertext Transfer Protocol (HTTP). In addition, between the first user terminal 100 and the second user terminal 200 and the server device 400, a connection is first established by HTTP communication, and thereafter, communication may be performed based on WebSocket, which performs bidirectional communication with lower cost (lower communication load and processing load) than HTTP communication. Note that the communication method between the first user terminal 100 and the second user terminal 200 and the server device 400 is not limited to the above-mentioned method, and any communication method technology may be used as long as it can realize this embodiment.

[0064] The first user terminal 100 functions at least as the above-mentioned information processing device 1300 or the broadcasting user terminal 2100, the second user terminal 200 functions at least as one or more of the above-mentioned viewing user terminals 1100, 2200, and the server device 400 functions at least as the above-mentioned specified server device or information processing device 2400.

[0065] In the present disclosure, the first user terminal 100 and the second user terminal 200 may be a smartphone (multifunction phone terminal), a tablet terminal, a personal computer, a console game machine, a head mounted display (HMD), a wearable computer such as a glasses-type wearable terminal (AR glasses, etc.), or an information processing device capable of playing videos other than these devices. Furthermore, these terminals may be standalone devices that operate independently, or may be composed of multiple devices connected to each other so that they can transmit and receive various data.

[0066] <Hardware configuration> Here, the hardware configuration of the first user terminal 100 will be described with reference to Fig. 4. The first user terminal 100 includes a processor 101, a memory 102, a storage 103, an input / output interface (input / output I / F) 104, and a communication interface (communication I / F) 105. The components are connected to each other via a bus B.

[0067] The first user terminal 100 can realize the functions and methods described in this embodiment through cooperation between a processor 101, a memory 102, a storage 103, an input / output I / F 104, and a communication I / F 105.

[0068] The processor 101 executes functions and / or methods realized by codes or instructions included in a program stored in the storage 103. The processor 101 includes, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may realize each process disclosed in each embodiment by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large scale integration (LSI)), etc.). These circuits may be realized by one or more integrated circuits, and a plurality of processes shown in each embodiment may be realized by one integrated circuit. An LSI may also be called a VLSI, a super LSI, an ultra LSI, etc., depending on the degree of integration.

[0069] The memory 102 temporarily stores the programs loaded from the storage 103 and provides a working area for the processor 101. The memory 102 also temporarily stores various data generated while the processor 101 is executing the programs. The memory 102 includes, for example, a random access memory (RAM) and a read only memory (ROM).

[0070] The storage 103 stores programs. The storage 103 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, and the like.

[0071] The communication I / F 105 is implemented as hardware such as a network adapter, communication software, or a combination of these, and transmits and receives various data via the network 300. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication I / F 105 executes communication with other information processing devices via the network 300. The communication I / F 105 transmits various data to other information processing devices according to instructions from the processor 101. The communication I / F 105 also receives various data transmitted from other information processing devices and transmits it to the processor 101.

[0072] The input / output I / F 104 includes an input device for inputting various operations to the first user terminal 100, and an output device for outputting processing results processed by the first user terminal 100. The input / output I / F 104 may be an integrated input device and output device, or may be separate input device and output device.

[0073] The input device is realized by any one or a combination of all kinds of devices that can receive input from a user and transmit information related to the input to the processor 101. The input device includes, for example, a touch panel, a touch display, hardware keys such as a keyboard, a pointing device such as a mouse, a camera (operation input via an image), and a microphone (operation input by voice).

[0074] The input device may include a sensor unit. The sensor unit is one or more sensors that detect face motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body with respect to the sensor unit. Face motions include blinking, opening and closing of the mouth, and other movements. The sensor unit may be a publicly known one. An example of the sensor unit includes a ToF sensor that measures and detects the time of flight (Time of Flight) until light irradiated toward the user is reflected by the user's face or the like and returns, a camera that photographs the user's face, and an image processing unit that performs image processing on the data photographed by the camera. The sensor unit may also include an RGB camera that photographs visible light and a near-infrared camera that photographs near-infrared light. For the RGB camera or near-infrared camera, for example, True Depth of the "iPhoneX (registered trademark)", or "LiDAR" of the "iPad Pro (registered trademark)", or other ToF sensors mounted on smartphones can be used. Specifically, this camera projects tens of thousands of invisible dots (points) onto the user's face or the like using a dot projector. Then, the reflected light of the dot pattern is detected and analyzed to form a depth map of the face, and an infrared image of the face, etc. is captured, thereby capturing accurate facial data. The arithmetic processing unit of the sensor unit generates various information based on the depth map and the infrared image, and compares the information with registered reference data to calculate the depth of each point of the face (the distance between each point and the near-infrared camera) and positional deviations other than the depth.

[0075] The sensor unit may have a function of tracking not only the user's face but also the user's hands (hand tracking). The sensor unit may further include sensors other than the above-mentioned sensors, such as an acceleration sensor or a gyro sensor. The sensor unit may have a spatial mapping function of recognizing an object in the real space where the user exists based on the detection result of the above-mentioned ToF sensor or other known sensors, and mapping the recognized object on a spatial map. Hereinafter, when the face motion detection data and the body motion detection data are not particularly distinguished from each other, they are simply referred to as "tracking data". The image processing unit of the sensor unit may be provided in a control unit that can be provided in the information processing system of the present invention.

[0076] The operation unit as an input device can be one that corresponds to the type of the user terminal. Examples of the operation unit include a touch panel integrated with a display, operation buttons provided on the housing of the user terminal, a keyboard, a mouse, and a controller operated by the user's hand. The controller may incorporate various known sensors such as an acceleration sensor and an inertial measurement unit (IMU) such as a gyroscope. Another example of the operation unit may be a tracking device that identifies the user's hand movement, eye movement, head movement, line of sight, and the like. In this aspect, for example, the user's instruction can be determined based on the user's hand movement, and various operations can be performed, such as starting or ending the distribution of a video, rating a message or a video, and requesting the display of a predetermined object (for example, a gift, which will be described later). Note that if the sensor unit also has an input interface function such as a hand truck function, the operation unit can be omitted.

[0077] The output device outputs the results of processing performed by the processor 101. The output device includes, for example, a touch panel, a speaker, and the like.

[0078] It should be noted that the functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the functions described. Processors include transistors and other circuits and are considered to be circuitry or processing circuitry. A processor may be a programmed processor that executes a program stored in a memory.

[0079] In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed in this specification or any hardware known to be programmed to realize or perform the described functions.

[0080] If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.

[0081] Moreover, the second user terminal 200 and the server device 400 in the present disclosure can also be configured with the same hardware configuration as that in FIG. 4, unless otherwise noted.

[0082] Next, various functions that can be executed on a user terminal that has launched an application realized by the information processing system according to an embodiment of the present disclosure, and transitions of displayed screens will be described with reference to the drawings.

[0083] FIG. 5 shows a top screen T10 that is displayed on a user terminal (it is not yet specified here whether the user will be viewing / distributing) when a video distribution / viewing application is launched.

[0084] As shown in FIG. 5, a user can watch a video being played on a distribution channel (also called a distribution slot, distribution program, distribution video, etc.) by selecting the distribution channel from among thumbnail images of one or more recommended distribution channels T12 listed in the recommendation tab T11 on the top screen T10.

[0085] Alternatively, a user can view a video being played on a specific distribution channel by accessing a fixed link of the specific distribution channel. Such a fixed link can be obtained by a notification from a first user who the user is following, or a share notification sent by another user.

[0086] In this way, the user who watches the video becomes a viewing user, and the terminal at which the video is watched becomes the second user terminal 200.

[0087] 5, the top screen T10 may display a display field T13 for announcements such as campaigns and events. This announcement display field T13 can be switched to display other announcements by a sliding operation.

[0088] From the top screen T10, a follow tab T14, a game tab T15 for displaying game categories, a collaboration waiting tab T16 for displaying distribution channels waiting for collaboration, and a beginner tab T17 for displaying distribution channels for beginners are displayed. By selecting these (by switching between tabs), the top screen T10 transitions to each of the different screens.

[0089] The service name display T18 and the search button T19 in the upper frame of the top screen T10 may be fixed and remain displayed on the transition destination screen.

[0090] Similarly, the home button T20, message button T21, delivery preparation button T22, gacha button T23, and profile button T24 in the lower frame of the top screen T10 may also be fixed and remain displayed on the transition destination screen.

[0091] A user who selects a displayed thumbnail image T12 on the top screen T10 shown in FIG. 5, for example, can become a viewing user (second user) who watches the video as described above, and a user who selects the distribution preparation button T22 can become a distribution user (first user) who distributes the video.

[0092] As an example, when a distribution preparation button T22 is selected on the top screen T10 shown in Fig. 5, the screen transitions to an avatar setting screen D10 shown in Fig. 6. Then, when a distribution button D11 is selected on the avatar setting screen D10, the screen transitions to a distribution setting screen D20 shown in Fig. 7. Then, when a distribution start button D25 is selected on the distribution setting screen D20, the screen transitions to an avatar distribution screen D30 shown in Fig. 8.

[0093] Next, we will explain the details of the flow up to the start of video distribution.

[0094] The one or more computer processors in the present disclosure may include a distribution start request receiving unit, a distribution setting unit, and a distribution starting unit.

[0095] The distribution start request receiving unit receives a distribution start request for a first moving image including an animation of a character object from a first user terminal of a first user.

[0096] Here, the first moving image refers to a moving image including animation of a character object. In this specification, a character object may be called an "avatar."

[0097] The distribution start request can be transmitted from a user terminal (later to become a first user terminal) to the server device 400 by selecting a distribution button D11 located on an avatar setting screen D10 or the like transitioned from the above-mentioned top screen displayed on the user terminal (which will later become the first user terminal) that has launched a dedicated application (video distribution / viewing application) for accessing the video distribution platform.

[0098] 6 shows an example of an avatar setting screen D10. A character object CO, a distribution button D11, a gacha button D12, a change of clothes button D13, a photo button D14, and the like can be displayed on the avatar setting screen D10.

[0099] When the user selects the change clothes button D13, a closet screen appears for selecting various avatar parts for the character object CO, such as eyes, nose, mouth, hair, accessories, clothes, and background.

[0100] When the user selects the gacha button D12, a lottery screen for obtaining the avatar parts appears.

[0101] When the user selects the photo button D14, a shooting screen for taking a still image of the character object appears.

[0102] When the user selects the distribution button D11, a distribution start request is transmitted to the server device 400.

[0103] The distribution setting unit sets distribution settings for the first moving image based on a specification from the first user terminal 100 in response to a distribution start request for the first moving image accepted by the distribution start request accepting unit.

[0104] As an example, when the distribution button D11 is selected, the screen displayed on the first user terminal 100 transitions from the avatar setting screen D10 shown in FIG. 6 to a distribution setting screen D20 shown in FIG.

[0105] The distribution settings may include at least one of a setting regarding the title of the first video, a setting regarding whether other users may appear in the first video, a setting regarding the number of people who may appear in the first video, and a setting regarding a password.

[0106] These distribution settings can be set in a title setting field D21, a collaboration permission setting field D22, a number of people setting field D23, and a password setting field D24 in Fig. 7. In Fig. 7, a collaboration permission setting field D26 for anyone and an SNS posting permission field D27 are also displayed.

[0107] The title of the first video can be freely determined by the broadcasting user within the range of the maximum number of characters allowed. If there is no input by the broadcasting user, a preset title including the name of the character object (broadcasting user), such as "This is XXX's broadcast," may be automatically determined.

[0108] The first user can freely decide whether or not other users can appear in the first video. If yes, other users can make an appearance request to the distribution user, and if no, other users cannot make an appearance request to the distribution user. In this specification, the state in which other users appear in the first user's video is sometimes called "collaboration." Details of collaboration will be described later.

[0109] The number of people who can appear in the first video can only be set if other users are allowed to appear in the first video as described above, and can be freely determined by the distribution user within the range of the allowable upper limit.

[0110] The password can be set arbitrarily only if other users are allowed to appear in the first video, and the distribution user can freely decide the number of digits specified. When other users apply to appear in the first video, they are required to enter the password. Note that the password setting field D24 may be configured to be active only when the collaboration permission setting field D26 for anyone is OFF.

[0111] The distribution starting unit distributes information about the first moving image to the second user terminal 200 of the viewing user based on the conditions set by the distribution setting unit.

[0112] The instruction to start such distribution is transmitted by selecting the distribution start button D25 shown in FIG.

[0113] As an example, the distribution starting unit distributes (avatar distributes) information about a video (first video) including animation of a character object of the first user to the second user terminal 200 of the second user.

[0114] The information about the first video includes, for example, motion information indicating the movement of a character object, voice information of the first user, gift object information indicating gifts sent from other viewing users, etc. The gift object information includes at least gift object identification information specifying the type of the gift object, and position information indicating the position where the gift object is displayed.

[0115] The distribution starting unit can then live-distribute the video via the video distribution platform described above.

[0116] FIG. 8 shows an avatar delivery screen D30 displayed on the first user terminal 100.

[0117] The avatar distribution screen D30 displays a character object CO, as well as a comment input button D31 for the distribution user to input a comment, a photo button D32 for saving a still image of the screen, a start play button D33 for playing a game described below, an external service linkage button D34 for watching videos provided by an external service, and a gacha button D12 for obtaining avatar parts.

[0118] Also, at the top of the avatar distribution screen D30, a cumulative viewer count display D35, a cumulative like count display D36, a collaborator count display D37, a share button for external SNS D38, a guest details button D39, a ranking display button D40, a settings button D41, and an audio switch button D42 for switching audio ON / OFF can be displayed. Also, an end button D43 for ending the distribution is displayed.

[0119] Although detailed description of these displays and buttons will be omitted, by selecting the setting button D41, it is possible to change the distribution settings made on the distribution setting screen D20.

[0120] 8 shows an example in which distribution has been started with the distribution setting screen D20 set to allow other users to appear in the first video and the number of people who can appear in the first video set to three, so character object CO is displayed shifted to the lower left. Up to three character objects of other users can appear in the empty space.

[0121] This concludes the description of the screen transitions when delivering an avatar according to the invention of the present disclosure.

[0122] Next, the screen transitions that occur when a broadcaster user plays a game during broadcast will be described.

[0123] The one or more computer processors in the present disclosure may include a game request receiving unit, a game video distribution unit, and a game display processing unit.

[0124] During avatar distribution as shown in FIG. 8, the distributor user can request to start playing the game by selecting the start play button D33.

[0125] Note that the game displayed by selecting the play start button D33 is a dedicated game implemented in an application realized by the information processing system in the present disclosure, and may be different from a general-purpose game provided by an external service. Therefore, the game distribution in the present disclosure may be distinguished from the distribution of a play video of a general-purpose game provided by an external service together with a live commentary by a distribution user.

[0126] Alternatively, the request to start playing can be transmitted from the first user terminal 100 to the server device 400 by selecting a start playing button located on a specified screen displayed on the first user terminal 100 of the first user.

[0127] Fig. 9 shows an example of a screen G10 on which a play start button G11 is arranged as the above-mentioned predetermined screen. The screen G10 shown in Fig. 9 is a screen transitioned to by selecting a game tab T15 from a top screen T10 (Fig. 5) displayed on a user terminal that has started an application realized by the information processing system in the present disclosure.

[0128] At least a play start button G11 capable of transmitting a request to start playing a predetermined game is displayed on the screen G10.

[0129] Then, when the game request receiving unit receives a request to start playing a predetermined game, the game video distribution unit distributes information about the second video to the second user terminal 200.

[0130] Here, the second video is a video of a specific game being played. In this specification, the delivery of such a video so that it is displayed on the screen of the second user terminal 200 is referred to as "game delivery."

[0131] In addition, after launching the application realized by the invention of the present disclosure, the user can, as the first user, send a request to start streaming of the second video to the information processing device 2400 by selecting a play start object placed on the game list screen and the game details screen.

[0132] The game list screen or the game details screen is the first screen, which will be described in detail next.

[0133] That is, the game display processing unit performs display processing of a first screen including a distribution start object capable of sending a request to start distribution, a play start object capable of sending a request to start playing a specified game, and a thumbnail image of a video of gameplay of a specified game currently being distributed.

[0134] 9 corresponds to a game list screen of the first screen. The first screen, which is the game list screen, is a screen transitioned to by selecting the game tab T15 from the top screen T10.

[0135] The first screen includes a distribution preparation button T22 as a distribution start object, a play start button G11 as a play start object, and a thumbnail image indicating a distribution channel of the video.

[0136] The first screen displays, for each of the multiple playable games, a start play button G11, a game icon G12, the game name G13, the total number of viewers of the game's distribution channel G14, and a distribution list G15 including thumbnail images of the distribution channels currently distributing the game.

[0137] The order of thumbnail images displayed in the distribution list G15 can be different for each viewing user. As an example, the order is arranged in the order of the number of views by the viewing user who follows them, the number of cumulative viewers, and the oldest distribution start. The display range of the thumbnail images in the distribution list G15 can be changed by scrolling horizontally.

[0138] The games displayed on this game list screen are the top 10 titles with the following priorities: As an example, the priorities are determined by the most recent date the viewing user last played the game within 48 hours of the game distribution start date and time within the last 30 days, the highest priority of the period ID, and descending order of the period ID.

[0139] This distribution list G15 is updated when the user returns from another tab screen or when a pull-to-refresh operation is performed.

[0140] 10 corresponds to the game details screen of the first screen. The first screen, which is the game details screen, is G20, which is a screen transitioned to by selecting the game icon G12 or the game name G13 displayed on the game list screen shown in FIG.

[0141] The first screen includes a distribution preparation button T22 which is a distribution start object, a play start button G21 which is a play start object, and a thumbnail image indicating a distribution channel of the video.

[0142] The first screen also displays a game icon G22, a game name G23, the total number of viewers of the game's distribution channel G24, and a distribution list G25 including thumbnail images of distribution channels currently distributing the game.

[0143] The order of thumbnail images displayed in the distribution list G25 can be different for each viewing user. As an example, the order is arranged in the order of the number of views by the viewing user who follows the content, the number of cumulative viewers, and the oldest distribution. The display range of the thumbnail images in the distribution list G25 can be changed by vertical scrolling.

[0144] This distribution list G25 is updated when the user returns from another tab screen or when a pull-to-refresh operation is performed.

[0145] As described above, a user who selects the distribution start object (distribution preparation button T22) or the play start object (play start button G11, G21) becomes the first user to make a distribution start request or a play start request.

[0146] Furthermore, the user who selects the thumbnail image becomes the second user who views the second moving image.

[0147] The first screen also includes a first area in which scrolling is not possible, and a second area in which scrolling is possible.

[0148] The first screen here refers to the first screen shown in Fig. 10. The first screen includes a first area R1 and a second area R2. Specifically, the game title is displayed in the first area R1, and the above-mentioned play start button G21, game icon G22, game name G23, viewer count G24, and distribution list G25 are displayed in the second area R2.

[0149] The first area R1 is a fixed area on the display screen that cannot be scrolled, and the second area R2 is an area that can be scrolled by the user. By scrolling the second area R2, the user can check thumbnail images that are hidden outside the screen.

[0150] However, since there is a risk that the play start button G21 will be hidden off-screen by scrolling the second area, the display processing unit in the present disclosure can display the play start object (play start button G21) in the first area R1 depending on the display state of the play start object (play start button G21) displayed in the second area R2.

[0151] As an example, the play start button G21 is displayed in the second area R2 in Fig. 10, but is displayed in the first area R1 in Fig. 11. That is, when a part or all of the play start button G21 is no longer displayed in the second area R2, the play start button G21 appears in the first area.

[0152] Furthermore, the game display processing unit may cause the play start object to be displayed in the first area R1 in stages according to the display state of the play start object displayed in the second area R2.

[0153] Such an expression can be realized by changing the transparency of the play start object in accordance with the amount of scrolling of the second region R2.

[0154] As an example, a scroll amount (unit: pixels) of 0 to 50 corresponds to a button transparency of 0.0 (completely transparent) to 1.0 (completely opaque). In this way, in the initial display state, the object is completely transparent and cannot be seen, but when the object is scrolled 50 pixels or more, it becomes completely visible. It is preferable to change the object's transparency linearly during this period (0 to 50). Note that the unit of the scroll amount is logical pixels, which may differ from the actual pixels on the display.

[0155] The game request receiving unit is also capable of receiving a request to end play of a specific game from the first user terminal 100 after the game video distribution unit has distributed information about the second video.

[0156] A request to end play can be sent by selecting an end button located on the game screen.

[0157] Then, when the game request receiving unit receives a request to end play of a specific game, the distribution starting unit can end the distribution of information about the second moving image and distribute information about the first moving image.

[0158] In other words, what is distributed here is not just a portion of the information about the first moving image, but the entire information about the first moving image.

[0159] Then, when the distribution starting unit finishes distributing the information about the second moving image and distributes the information about the first moving image, it is assumed that the first moving image is displayed on the second user terminal 200.

[0160] Next, the flow for starting to watch a video will be described.

[0161] The one or more processors in the present disclosure may further include a viewing acceptance unit.

[0162] The viewing acceptance unit accepts a video viewing request from a user.

[0163] In response to a viewing request, the distribution starting unit distributes information relating to video and audio as moving image information to the user's information processing terminal.

[0164] FIG. 12 shows an example of a viewing screen V10 of an avatar video displayed on the second user terminal 200. As shown in FIG.

[0165] A viewing user can post a comment by entering text in a comment input field V11 and pressing a send button V12.

[0166] Moreover, by pressing the gift button V13, a list of gifts (screen V30 in FIG. 13) is displayed to the viewing user, and a display request for a specified gift can be sent by selection.

[0167] In this case, the one or more processors in the present disclosure may include a determination unit. The determination unit determines whether or not a gift display request has been made from the second user terminal 200.

[0168] The display request may include gift object information, which includes at least gift object identification information for identifying the type of the gift object, and location information for indicating the location where the gift object is to be displayed.

[0169] As shown in FIG. 13, gifts can be displayed by classification (free (paid) gifts, accessories, support goods, appeals, variety, etc.).

[0170] Here, a paid gift is a gift (coin gift) that can be purchased by the viewing user by consuming their purchased My Coins, and a free gift is a gift (point gift) that can be obtained by the viewing user with or without consuming their purchased My Points.

[0171] In addition, the term "gift" used in this application has the same concept as the term "token." Therefore, it is possible to understand the technology described in this application by replacing the term "gift" with the term "token."

[0172] Furthermore, the viewing user can post a rating showing a favorable opinion by pressing the like button V14. Note that in addition to / instead of the like button V14, it is also possible to display a button for posting a negative rating or other emotions.

[0173] In addition, if the first user has set the availability of other users to appear in the video in the distribution settings, the first user can send a request to appear in the video by selecting the collaboration request button V15.

[0174] In addition, a follow button V16 for the second user to follow the broadcasting user is displayed on the screen of a video distributed by a first user who is not yet followed by the second user. This follow button functions as an unfollow button on the screen of a video distributed by a first user who is already being followed by the second user.

[0175] This "following" may be from a second user to another second user, from a first user to a second user, or from a first user to another first user. However, following is managed as a one-way association, and associations in the reverse direction are managed separately as followers.

[0176] A photo button V25 for saving a still image of the screen may also be displayed.

[0177] In addition, the viewing screen V10 also displays a support ranking display button V17, a share button V18, and a ranking display button V19.

[0178] The support ranking displays the ranking of second users who are supporting the first user, and the ranking can be calculated according to the amount of the gift (points / coins) or the like.

[0179] In addition, regarding sharing the video, the second user can press the share button V18 to check a list of SNS (social networking services) on which the video can be shared, and by selecting it, send a fixed link to a specified location on a specified SNS.

[0180] In addition, by pressing a collaboration request button V15, a request for collaboration distribution can be made to the first user. Collaborative distribution refers to having a character object of a second user appear in a video distributed by the first user.

[0181] At the top of the viewing screen V10, a broadcasting user icon V21, a broadcasting user name (character object name) V22, a cumulative number of viewers display V23, and a cumulative number of likes display V24 can be displayed.

[0182] Moreover, when the viewing end button V20 is selected, a screen for ending viewing appears, and a viewing end request can be sent.

[0183] The screen for ending viewing will be described in detail below. This screen is called "small window audio distribution" and is used for viewing in a mode where only audio is played without displaying the video image.

[0184] Selection of the viewing end button V20 is accepted by the viewing acceptance unit as a request to end viewing of the video.

[0185] At this time, the distribution starting unit ends the distribution of the information relating to the video in response to the viewing end request, but does not end the distribution of the information relating to the audio.

[0186] When information relating to video and audio is distributed to the user terminal, the video is displayed on the main screen of the user terminal, and when information relating to audio only is distributed, the video is not displayed on the user terminal but a sub-screen indicating that a video is being viewed is displayed.

[0187] FIG. 14 shows an image of the screen V50 on which the sub-screen V51 is displayed.

[0188] When this sub-screen V51 is displayed, the main screen displayed in the background transitions to the screen before watching the video. For example, if you move from the recommendation tab to the viewing frame, it returns to the display of the recommendation tab, and if you move from the follow tab to the viewing frame, it transitions to the follow tab.

[0189] When this sub-screen V51 is displayed, operations on the main screen are possible, and transitions to other screens are possible.

[0190] The sub-screen V51 displays a profile picture, a name, a title, and an audio icon that visually indicates that audio is being played.

[0191] Then, by selecting the end icon V52 displayed on the sub-screen V51, viewing can be completely ended.

[0192] Regarding the end of the video display, the information may be transmitted from the server device but not displayed on the terminal side, or the transmission of information itself may be stopped from the server device.

[0193] According to this configuration, it becomes possible to search for other broadcasts and enjoy chatting with other users while listening to only the audio.

[0194] Next, a "collaboration" in which another user appears in a video of a first user will be described.

[0195] As described above, the second user can transmit a request to participate in the video via the collaboration distribution participation request confirmation screen that is displayed by pressing the collaboration request button V15 shown in FIG.

[0196] A collaboration avatar display unit included in one or more computer processors in the present disclosure displays, in response to the accepted participation request, a character object generated based on the movement of the viewing user who has made the participation request in a video.

[0197] As an example, Fig. 15 shows a viewing or distribution screen in which a second avatar CO4, which is a character object of a guest user, is participating in a video in which a first avatar CO3, which is a character object of a host user, is displayed. Note that in Fig. 15, the display of objects other than the avatars is omitted.

[0198] Furthermore, as shown in Fig. 16, a third avatar CO1, which is a character object generated based on the movement of another viewing user, may also participate in the video. Note that in Fig. 16, the third avatar CO1 is placed behind the first avatars CO3 and CO4's avatar A2, but the three may be placed in a horizontal line. Also, the placement positions of the avatars may be specified by the distribution user.

[0199] Fig. 17 shows a list screen T30 of users having mutual follow relationships, which is displayed by selecting the Follow tab T14 on the top screen shown in Fig. 5. Mutual follow refers to a relationship in which two users follow each other.

[0200] This list screen T30 displays the profile images and names of users with whom a user has a mutual follow relationship.

[0201] 17, the list screen T30 displays a first object T31 for each user having a mutual follow relationship. In addition, a chat object T32 may be displayed together with the first object T31. By selecting this chat object, it is possible to transition to an individual chat screen with the second user.

[0202] The first object T31 transmits a predetermined notification to the terminal of the user associated with the first object T31.

[0203] The predetermined notification may be, for example, a call notification.

[0204] Next, a detailed description will be given of a flow for performing a video chat in an embodiment of the present disclosure.

[0205] As an example, users can conduct video chats from individual chat screens or group chat screens.

[0206] These chat screens can be transitioned from the chat list screen C10 (FIG. 18) that is opened by selecting the message button T21 on the top screen T10 (FIG. 5), for example.

[0207] 18, icons of users (character objects) or groups who have sent and / or received messages (chats) in the past are displayed together with their names or titles. Note that the group icons may include icons of users (character objects) who will participate in the group.

[0208] The user can then select a user or group on the chat list screen C10, open the personal chat screen C20 (FIG. 19) or group chat screen, and start a video chat by selecting the video chat button C21.

[0209] In addition, by selecting the chat creation button C12 or group creation button C13 (Figure 20), which is displayed by selecting the edit button C11 on the chat list screen C10, it is possible to create a chat screen for a user or group that is not displayed on the chat list screen C10.

[0210] Fig. 21 shows a user selection screen C30 that opens when the chat creation button C12 is selected, and a chat screen with the displayed recommended users or users searched for using the search field C31 is displayed / generated. The configuration of the generated chat screen is the same as the chat screen C20 shown in Fig. 19, and a video chat can be started by selecting the video chat button C21.

[0211] Similarly, Fig. 22 shows a group creation screen C40 that opens when the group creation button C13 is selected. The user can add users other than themselves as group members by selecting the user addition button C41. As an example, the number of group members that can be added is up to seven. The group name can also be set on this screen.

[0212] When a group is created, a group chat screen C50 is displayed (FIG. 23). On the group chat screen C50, a video chat can also be started by selecting a video chat button C51.

[0213] The chat screen C20 can also be transitioned to from a chat object T32 on the follow list screen T30 (FIG. 17).

[0214] Chat icons can also be placed on other users' profile screens, allowing users to move from various pages to the chat screen and start a video chat.

[0215] When a video chat is started, a notification is sent to the other party, and the other party can join the video chat by responding to the notification. The user can set whether or not to receive such notifications.

[0216] Alternatively, a configuration may be adopted in which only video chats can be conducted with users in a mutual follow relationship. In this case, an icon indicating that a mutual follow user is currently video chatting with another user may be displayed on the follow list screen, and a user may be able to participate in the ongoing video chat by selecting the icon.

[0217] The video chat in the present disclosure can be said to be a function that allows only specific users to view the above-mentioned collaborative distribution. The specific users here refer to users who are participating in the video chat.

[0218] Next, an image of the expansion of the virtual space in this disclosure will be described with reference to FIG.

[0219] As shown as an example in Fig. 24, the virtual space in this embodiment is arranged so that a disk-shaped island (world) is floating in the air. This island is an object that resembles a tower-shaped cake turned upside down, and various objects can be arranged on the disk-shaped ground. Note that this island and ground are shown as examples, and their display forms are not particularly limited.

[0220] The objects that can be displayed include at least a character object CO of the first user, a gift object G1 corresponding to a gift requested to be displayed by a second user, and an object S1 whose display position and display timing are controlled by the server device 400 (system side).

[0221] It is possible for a character object to move and jump within the world through user operations, and such a function can be provided as one of the above-mentioned games, for example. In this disclosure, this is specifically referred to as "world distribution", and the above-mentioned game distribution start and end procedures are applied.

[0222] Specifically, switching from normal streaming (avatar streaming) to world streaming can be performed by selecting the play button D33 (Figure 8) of the game displayed in the avatar streaming video, or by selecting the play button G11, G21 (Figures 9, 10) of a game selected from a list of games displayed on the screen transitioned to by selecting the play button D33.

[0223] Additionally, switching from world broadcast to avatar broadcast can be performed by selecting the end play button displayed on the world broadcast video.

[0224] Next, various functions that can be executed in the information processing system 3000 according to the embodiment of the present disclosure will be described with reference to the drawings.

[0225] One or more computer processors included in the information processing system 3000 according to the embodiment of the present disclosure include a receiving unit 410, a transmitting unit 420, an analyzing unit 430, and a display control unit 440, as shown in FIG.

[0226] The receiving unit 410 receives at least voice information relating to the voice of the first user, which is transmitted from the first user terminal 100 of the first user.

[0227] The above-mentioned audio information may include, as an example, audio corresponding to an utterance by the first user picked up by a microphone provided in the first user terminal 100 or connected to the first user terminal 100, and / or information regarding other audio other than the utterance by the first user.

[0228] Other sounds include, for example, environmental sounds and the voices of other users. It is possible to identify whether the voice is from the user or from another user by using a publicly known voice recognition technology. In addition, environmental sounds include television sounds, intercom sounds, telephone ringtones, animal cries, station announcements, train, car, motorcycle, etc., and the voices of multiple people.

[0229] The transmission unit 420 transmits information for displaying a video relating to a first user on the first user terminal 100 and / or the second user terminal 200 of a second user to the first user terminal 100 and / or the second user terminal 200 of a second user.

[0230] As an example, a video related to a first user may be a video in which a character object of the first user or an actual image of the first user is displayed, or a video in which neither the character object nor the actual image of the first user is displayed and which includes only the voice of the first user.

[0231] Furthermore, the video displayed on the first user terminal 100 and the video displayed on the second user terminal 200 may be at least partially different.

[0232] As described above, the information for displaying the moving image includes information for displaying the moving image already rendered in the server device 400 on a client terminal (the first user terminal 100 and / or the second user terminal 200) and / or information for rendering the moving image on the client terminal. Also, a part of the moving image may be rendered on the server device, and the other part of the moving image may be rendered on the client terminal.

[0233] The analysis unit 430 analyzes the voice information received by the receiving unit 410 to determine whether the voice includes a specific word.

[0234] The information on the specific word may be stored in advance in a predetermined storage device provided in the one or more computer processors, or in a predetermined storage device connectable to the information processing system 3000.

[0235] FIG. 26 shows an image of the data structure relating to a specific word stored in a given storage device.

[0236] As shown in FIG. 26, a specific word and display control information are stored in association with each other in a predetermined storage device.

[0237] As an example, the display control information includes information regarding an operation object (control target) for performing an operation required for an action corresponding to a specific word, and information regarding control information (control content) for the operation object, but is not limited to these and may include other information.

[0238] For example, a specific word "gacha" is associated with an operation object called a "gacha button" for performing the operations required to execute a gacha, and with the control content of "making the gacha button appear" or "highlighting it."

[0239] As an example, specific words include words related to actions requiring operation on the first user terminal 100, words related to actions requiring operation on the second user terminal 200, words related to requests, words related to specific items, words related to events in real space, words contained in specific text displayed in a video, and / or words set on the first user terminal 100, but are not limited to these example words.

[0240] The words related to the action requiring an operation on the first user terminal 100 may be words related to the action requiring an operation on the first user terminal 100 by the first user, such as participating in a lottery such as gacha or an event (for example, words indicating "gacha" or "event"). Details will be described later.

[0241] The words related to the behavior requiring an operation on the second user terminal 200 may be, for example, words related to the behavior requiring an operation on the second user terminal 200 by the second user, such as gifting or posting a comment (for example, words indicating "gift", "comment", etc.). Details will be described later.

[0242] The word related to the request may be, for example, a word expressing the request (desire) of the first user (for example, a word indicating "hungry" or "sleepy"). Details will be described later.

[0243] The words related to a particular item may be, for example, words indicating electronic items that can be associated with the first user terminal 100 (for example, words indicating "accessories", "clothes", etc.). Details will be described later.

[0244] Words related to events in the real world may be, for example, words that indicate the weather, location, or date and time (for example, words indicating "good weather," "Christmas," etc.). Details will be described later.

[0245] The words contained in the specific text displayed in the video may be, for example, words contained in comments posted from the first user terminal 100 or the second user terminal 200, or words contained in system comments posted by the system administrator. Details will be described later.

[0246] The word set in the first user terminal 100 may be, for example, a word selected or input in the first user terminal 100 (such as a password, a theme, a catchphrase, or an answer to a quiz). Details will be described later.

[0247] Then, the analysis unit 430 analyzes whether or not the above-mentioned specific words are included in the voice based on the voice information.

[0248] As an analysis method, known voice recognition technology or future voice recognition technology can be applied, but examples include a method of directly analyzing whether specific words are included in the voice information, and a method of converting the voice information into text information and then analyzing whether specific words are included.

[0249] Furthermore, instead of or in addition to analyzing whether the above-mentioned voice contains specific words, the analysis unit 430 may analyze the content of the voice based on the voice information and analyze whether the voice contains content corresponding to the above-mentioned specific words.

[0250] Even in this case, known voice recognition technology or future voice recognition technology can be applied to the analysis and interpretation method.

[0251] Then, the display control unit 440 controls the display of the video based on the display control information associated with a specific word included in the voice, in accordance with the result of the analysis by the analysis unit 430.

[0252] As described above, the display control information is stored in a predetermined storage device in association with a specific word.

[0253] Controlling the display of the moving image includes changing the display of at least a part of the moving image.

[0254] As an example, controlling the display of a video may include making a specified object appear in the video, highlighting a specified object displayed in the video, displaying another screen instead of or in addition to the screen displayed in the video, etc.

[0255] For example, as shown in FIG. 27, when a first user makes a statement such as "I think I'll try the gacha" in a video related to avatar distribution, the display is controlled so that a gacha button D12 displayed in the video lights up.

[0256] Alternatively, as shown in FIG. 28, when a first user makes a statement such as "I wonder if I should try the gacha" in a video related to avatar distribution, display control is performed so that a gacha object D44 for trying the gacha appears in the video.

[0257] For example, in a video related to avatar distribution, when a first user makes a statement such as "I want a duck," a gift list screen V30 is displayed on the screen of the second user terminal 200, as shown in FIG. 29, and the display is controlled so that the frame of the corresponding gift is displayed in a different manner from the other frames.

[0258] Similarly, as shown in FIG. 30, when the first user makes a statement such as "I'm hungry" in a video related to world distribution, display control is performed so that a shop object D45 appears in the video.

[0259] Alternatively, as shown in FIG. 31, when a first user makes a statement such as "I want to eat a hamburger" in a video related to world distribution, display control is performed so that an advertisement object D46 appears in the video.

[0260] The above specific examples of control of the video display are merely examples, and the present invention is not limited to these.

[0261] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

[0262] In particular, the above configuration can increase a first user's willingness to distribute videos, a second user's willingness to watch videos, and / or users' willingness to interact with each other.

[0263] Specifically, by controlling the display of the video appropriately based on the speech of the first user in the video, the quality of the video as content can be improved.

[0264] As the quality improves, the second user becomes more willing to watch the video, which in turn increases the first user's willingness to distribute the video.

[0265] In particular, control of the display based on speech in a video by a first user serves, for example, to support the operation of the first user and / or the operation of the second user, and to support interaction between users.

[0266] For example, conventionally, when a first user wants to execute a lottery such as gacha during the streaming of a video, the first user is typically required to tap an operation object such as a gacha button displayed on the screen, and then tap a lottery button on the lottery screen to which the user is redirected.

[0267] At this time, if the first user concentrates on finding and selecting a desired operation object from among various operation objects displayed on the screen, the first user's talk in the video may be neglected. The talk contributes greatly to the quality of the video and the interaction between users, and should not be neglected. In particular, the above problem is more pronounced because the screen of an information processing terminal such as a smartphone, which is assumed to be the first user terminal, tends to be small.

[0268] There have been technologies for operating a computer by voice for some time now. However, in this technical field where basically all voices input from a first user terminal are reproduced on a second user terminal, making the first user speak words for voice operation may degrade the quality of the content.

[0269] On the other hand, the invention disclosed herein automatically recognizes specific words from the natural talk of a first user, making it possible to support the operations of the first user and / or the operations of the second user, and to support interactions between users, without compromising the quality of the content.

[0270] Here, the video relating to the first user may be a video relating to avatar distribution or world distribution, as described above.

[0271] In world distribution, a video about a first user displays a character object of the first user and a virtual space (metaverse) that the character object can move in. In the case of a video related to world distribution, the first user and the second user may be users (distributor users) whose character objects are both in the world, and the second user may be a viewing user who simply watches the video.

[0272] In the case of a video related to avatar distribution, the first user is a distributor user and the second user is a viewing user.

[0273] Here, the video relating to the first user may display a character object of the first user that moves based on motion information relating to the motion of the first user transmitted from the first user terminal 100. At this time, the motion information (motion data) is assumed to be received by the receiving unit 410 described above.

[0274] Next, a case where the specific word is a word related to an action that requires an operation on the first user terminal 100 will be described.

[0275] As described above, words related to actions that require operation on the first user terminal 100 are words related to actions that require the first user to operate the first user terminal 100, such as participating in a lottery such as gacha or participating in an event (for example, words indicating "gacha" or "event").

[0276] The particular word may be a single word or a sentence.

[0277] In this case, the display control information can be information for making an operation object associated with the action appear on the video or the screen of the first user terminal 100, for highlighting an operation object associated with the action displayed on the video or the screen of the first user terminal 100, and / or for displaying an operation screen associated with the action.

[0278] Making an operation object associated with an action appear on the video or the screen of the first user terminal 100 means, as an example, making a gacha object or an event participation object appear on the video or the screen of the first user terminal 100.

[0279] Here, with regard to the appearance of an operation object, there is no difference between making an operation object appear in a video and in the first user terminal 100 in the sense that the operation object is displayed on the screen of the first user terminal 100, but making an operation object appear in the first user terminal 100 includes making the operation object appear by superimposing it on the video or in a position separate from the video.

[0280] Furthermore, when these are already displayed in the video or on the first user terminal 100, the operation object is displayed in an emphasized manner. "Displaying in an emphasized manner" means that a predetermined dramatic effect is generated for the operation object, for example, a sparkling effect is added, a blinking or rotating effect is added, or a mark or frame is added to serve as a landmark.

[0281] Furthermore, if there are multiple gacha categories, the banner of the corresponding gacha can be highlighted, for example by lighting it up.

[0282] And, displaying an operation screen corresponding to the action means, as an example, displaying a gacha lottery screen or displaying a pop-up image for transitioning to the gacha lottery screen.

[0283] Any of the display control information can be information for controlling the video in a manner that attracts the attention of the first user.

[0284] Next, a case where the specific word is a word related to an action that requires an operation on the second user terminal 200 will be described.

[0285] As described above, words related to actions requiring operations on the second user terminal 200 are words related to actions that require operations by the second user on the second user terminal 200, such as gifting or posting a comment (for example, words indicating "gift", "comment", etc.).

[0286] In this case, the display control information can be information for making an operation object associated with the action appear on the video or the screen of the second user terminal 200, for highlighting an operation object associated with the action displayed on the video or the screen of the second user terminal 200, and / or for displaying a screen associated with the action.

[0287] Making an operation object associated with an action appear on the video or the screen of the second user terminal 200 means, for example, making a gift button or a comment input field appear on the video or the screen of the second user terminal 200.

[0288] Also, a present button associated with the action of sending a real product to the first user may be made to appear. Note that, when the real product has already been given to the first user by another user, the present button displayed on the screen of the second user terminal 200 may be made to disappear / gray out.

[0289] Here, with regard to the appearance of an operation object, there is no difference between making an operation object appear in a video and in the second user terminal 200 in the sense that the operation object is displayed on the screen of the second user terminal 200, but the latter case includes making the operation object appear by superimposing it on the video or in a position separate from the video.

[0290] Furthermore, when these are already displayed in the video or on the second user terminal 200, the operation object is emphasized and displayed. "Emphasis-displayed" means that a predetermined dramatic effect is generated for the operation object, for example, a sparkling effect is added, a blinking or rotating effect is added, or a mark or frame is added to serve as a landmark.

[0291] Displaying an operation screen associated with an action means, for example, displaying a gift list screen or a pop-up image for transitioning to the gift list screen.

[0292] Any of the display control information can be information for controlling the video in a manner that attracts the attention of the second user.

[0293] In addition, if the specific word is a word related to an action that requires an operation on the first user terminal 100, the display control unit 440 can control the display of the video on the first user terminal 100 and the second user terminal 200.

[0294] The reason why the second user terminal 200 also controls the display of the moving image is that the reaction of the first user to the result of the control of the display of the moving image can also be provided to the second user as part of the content.

[0295] On the other hand, if the specific word is a word related to an action that requires an operation on the second user terminal 200, the display control unit 440 can control the display of the video only in the video displayed on the second user terminal 200.

[0296] This is to prevent the second user's reaction to the results of controlling the video display from becoming part of the content, and also to reduce the discomfort felt by the first user of requesting an operation from the second user.

[0297] Moreover, one or more computer processors in the present disclosure may further include an effect generation section 450, as shown in FIG.

[0298] The effect generation unit 450 generates a special effect for the first user terminal 100 and / or the second user terminal 200 when the above action is performed by selecting an operation object that appears or is displayed highlighted in the video or the first user terminal 100 / second user terminal 200.

[0299] In other words, the effect generating unit 450 does not generate the special effect if the action is executed via a route different from the above.

[0300] Examples of bonus effects include a discount on the fee (paid coins) paid when playing gacha or gifting, an increase in the number, size or value of items obtained through gacha, an increase in the number, size or value of objects displayed through gifting, the generation of special effects in videos, the awarding of points when participating in an event, etc.

[0301] Such a benefit is given as a reward to the first user for carrying out or promoting an action such as gacha, a gift, or an event in the video.

[0302] Next, a detailed description will be given of the case where the above-mentioned specific words are words related to a request.

[0303] The words related to the request may be, for example, words that indicate the first user's desire. The words related to the request may include words that directly indicate a request, such as "I want to eat XX," "I want to sleep," "I want it to be cool," "I want it to be warm," "I want it to be bright," and "I want it to be dark," as well as words that indirectly indicate a request, such as "I'm hungry," "I'm sleepy," "I'm hot," "I'm cold," "I'm dark," and "I'm too bright."

[0304] At this time, the display control information may be information for making an object associated with the request appear in the video and / or information for making an object displayed in the video be highlighted.

[0305] The object associated with the request may be, for example, a lottery object.

[0306] The lottery object may be a lottery object D47 as shown in Fig. 33. The lottery object may be the above-mentioned gacha button D12.

[0307] The lottery object D47 is for the first user to obtain a real product and / or a product object by lottery.

[0308] The lottery may be performed for a fee (using a paid ticket or paid coins) or for free (using a free ticket or free points). In the case where the lottery is performed for free, whether or not the lottery object is displayed may be determined by the lottery.

[0309] It should be noted that the real products and / or product objects to be the subject of the lottery are not necessarily limited to one type, and may be of multiple types.

[0310] For example, if the specific word is a word that indicates hunger, a lottery that does not limit the food as a product can be executed. For example, when a first user says "I'm hungry," a lottery is executed from among a number of products including pizza, hamburger, sushi, etc., and one of these products is determined to be a winner or loser.

[0311] On the other hand, if the specific word is a word that requests a specific dish, a lottery can be held that limits the food as a prize. For example, if a first user says, "I want to eat a hamburger," a lottery for a hamburger is held, and the winner or loser of the hamburger is determined.

[0312] Also, if the specific word is a word that refers to the cold, a lottery can be held that does not limit the products to food or cold weather goods. For example, when a first user says "It's cold," a lottery is held among a number of products including soup, hot drinks, gloves, scarves, and other cold weather gear, and one of these products is determined to be the winner or loser.

[0313] On the other hand, if the specific word is a word that requests a specific product, a lottery can be held that limits the food as the product. For example, if a first user says "I want gloves," a lottery for gloves is held and it is determined whether the user wins or loses the gloves.

[0314] The lottery object D47 may represent a lottery machine as shown in FIG. 33, may represent a product that is the subject of the lottery, or may represent a representative object related to the product that is the subject of the lottery.

[0315] In addition, when the lottery object D47 displayed on the screen is selected by the first user, the lottery result may be displayed on that screen, or the lottery result may be displayed on a transition destination lottery screen.

[0316] Depending on whether the lottery result is a win, a real product and / or a product object is awarded to the first user terminal 100.

[0317] The above-mentioned assignment may be performed automatically, or may be performed in response to an operation by the first user, as will be described later.

[0318] The provision of a real product means that the right to obtain the real product is granted to the first user, and the provision of a product object means that data relating to the product object is associated with the first user terminal 100.

[0319] A product object is an object representing a product, and can be an object that is attached to a character object associated with a first user, or a non-attachable object that is temporarily or permanently displayed in a virtual space (world, room, etc.) associated with the first user terminal 100.

[0320] Moreover, when the lottery object D47 is already displayed, the lottery object is highlighted. Highlighting the lottery object means that a predetermined presentation effect is applied to the lottery object, for example, a sparkling effect is added, a blinking or rotating effect is added, or a mark or frame is added to the object.

[0321] Also, displaying a screen associated with an action means, for example, displaying a lottery screen or a pop-up image for transitioning to the lottery screen.

[0322] Any of the display control information may be information for controlling the video in a manner that attracts the attention of the first user.

[0323] The object associated with the request may be, as an example, a shop object.

[0324] The shop object can be the shop object D45 shown in FIG.

[0325] The shop object D45 is an object that represents a shop where real products and / or product objects can be purchased.

[0326] The shop object D45 may be an operational object that transitions to a product selection and purchase screen when selected, or it may be placed in a virtual space displayed in a video, allowing a character object to enter and view, touch, and purchase products.

[0327] The object associated with the request may be, by way of example, an advertisement object.

[0328] The advertisement object may be advertisement object D46 shown in FIG.

[0329] The advertisement object D46 is an object that represents an advertisement for a real product and / or product object.

[0330] The advertisement object D46 can be displayed in the form of a flag, signage, billboard, or wrapping of a vehicle object such as a balloon, bus, or train displayed in the virtual space.

[0331] The advertising object D46 may be an operational object that transitions to an online sales site when selected, or it may be placed in a virtual space displayed in a video and move a character object to a virtual shop where the character object can enter and view, touch and purchase products.

[0332] The lottery object D47, the shop object D45, and the advertisement object D46 may be displayed for a predetermined time, or may be displayed until selected by the first user. Also, the display may be terminated in response to a voice of the first user.

[0333] In addition, when the video is from a first-person perspective in world distribution, the character object or the first user may be displayed as a pop-up on the edge of the screen, as if these objects were wearing AR glasses.

[0334] In addition, at least a part of the virtual space can be shared with the second user terminal 200.

[0335] Furthermore, when the second user terminal 200 is associated with the first user terminal 100, the effect of the control of the video display by the display control unit 440 can extend to both the first user terminal 100 and the second user terminal 200.

[0336] On the other hand, if the second user terminal 200 is not associated with the first user terminal 100, the effect of the control of the video display by the display control unit 440 can extend to only one of the first user terminal 100 and the second user terminal 200.

[0337] The cases where the second user terminal 200 is associated with the first user terminal 100 include cases where there is a mutual follow relationship and cases where the second user unilaterally follows the first user.

[0338] A case in which the second user terminal 200 is not associated with the first user terminal 100 includes a case in which there is no mutual follow relationship and a case in which the first user unilaterally follows the second user.

[0339] In the case where virtual spaces are provided by multiple servers, users who follow each other are likely to coexist and communicate in the virtual space of the same server, so that the display can be the same to avoid discrepancies in conversation. Similarly, the same space can be shared with a second user who is a follower of the first user.

[0340] On the other hand, the same space cannot be shared with a second user who exists in a virtual space on a different server.

[0341] According to the above configuration, the range in which the effect is shared is limited, thereby making it possible to reduce the load of drawing objects.

[0342] Additionally, the one or more computer processors in the present disclosure may further include an ordering unit 460, as shown in FIG.

[0343] When a win of a real product is determined by an operation on the lottery object D47 on the first user terminal 100, or when a real product is ordered on the first user terminal 100 via the shop object D45 and / or the advertisement object D46, the order unit 460 can transmit information regarding the win or information regarding the order, and at least the address information of the first user contained in the user information of the first user, to an information processing device of the physical store associated with the lottery object, the shop object and / or the advertisement object.

[0344] This allows the first user to register an address such as their home address in the information processing system of the present disclosure and have the physical product delivered to them without having to take the time to enter their address each time.

[0345] The real product may be a product that may satisfy the request. For example, when the request is related to hunger, food and drink such as hamburgers, pizza, and soup may be included, when the request is related to sleep, sleep goods such as pillows and bedding may be included, when the request is related to temperature such as hot or cold, food and drink and cooling / heating goods may be included, when the request is related to darkness or brightness, lighting equipment may be included, but the present invention is not limited to these, and any product that may satisfy even a part of the request may be included.

[0346] When a real product is ordered on the first user terminal 100 via the shop object D45 and / or the advertisement object D46, the display control unit 440 can display a product object corresponding to the real product in the video.

[0347] That is, in the present disclosure, a predetermined storage device stores product objects corresponding to real products that can be provided, which enhances the sense of connection between the first user and the character object, and also stimulates communication because the second user can see what the first user has ordered.

[0348] For example, when a first user says "I'm hungry," real food is delivered to the first user and a food object is also attached to the first user's character object.

[0349] The product object can be displayed at the time of ordering, after ordering and before the actual product arrives, or after the actual product arrives. In this case, the timing of the product arrival is obtained from the delivery side or input by the first user.

[0350] As mentioned above, for companies that provide real products, displaying product objects in a virtual space can be expected to have a promotional effect through product placement. It can also lead to increased brand awareness and the acquisition of new customers. This allows operators to earn advertising revenue, which can then be used to free up service fees for users and increase revenue for broadcasting users.

[0351] In addition, companies will be able to introduce new advertising methods not available in traditional advertising, such as targeting broadcasters (influencers) with a large number of viewers / followers and displaying advertisements to them.

[0352] Next, a case where the specific word is a word related to a specific item will be described.

[0353] In this case, one or more computer processors according to the present disclosure may further include a determination unit 470 as shown in FIG.

[0354] The determining unit 470 determines whether a particular item is associated with the first user terminal 100 .

[0355] The database to be judged may be stored in a storage device included in the server device 400, or may be stored in a storage device included in the first user terminal 100.

[0356] A word related to a particular item may be, for example, a word indicating an electronic item that can be associated with the first user terminal 100 (for example, a word indicating "accessories", "clothes", etc.).

[0357] When the determination unit 470 determines that a specific item is associated with the first user terminal 100, the display control unit controls the video based on display control information, which is information for making a specific object corresponding to the specific item appear in the video, information for highlighting a specific object displayed in the video, and / or information for displaying a list screen of items associated with the first user terminal, including the specific item.

[0358] An example of making a specific object corresponding to a specific item appear in a video is making a specific object appear in the video. If the specific object is an accessory or other wearable item, it is displayed in association with a specific part of the character object.

[0359] Also, if a specific object is already displayed in the video, the specific object is emphasized. "Emphasis" means that a specific effect is given to the specific object, for example, a sparkling effect is added, a blinking or rotating effect is added, or a mark or frame is added to serve as a landmark.

[0360] Displaying a list screen of items associated with the first user terminal, including a specific item, is, for example, displaying the closet screen described above.

[0361] If the determination unit 470 determines that a specific item is not associated with the first user terminal 100, the display control unit may control the display of the video based on display control information which is information for making a lottery object that can obtain a specific item by lottery, a shop object representing a shop where the specific item can be purchased, or an advertising object representing an advertisement related to the specific item appear in the video, and / or information for highlighting and displaying the lottery object, shop object and / or advertising object displayed in the video.

[0362] In other words, when the first user makes a comment about a specific item that the first user does not have, the display of the video is controlled based on information for allowing the first user to obtain the specific item. The details of the lottery object, the shop object, and the advertisement object are as described above.

[0363] In addition, when the determination unit 470 determines that a specific item is not associated with the first user terminal 100, the display control unit can control the display of the video based on display control information, which is information for making a line to a screen related to a user terminal of another user who has the specific item appear in the video.

[0364] A first user can exchange, transfer, or receive (hereinafter referred to as "exchange, etc.") items with other users. This can happen while the first user is streaming a video, or when the first user is not streaming a video.

[0365] Furthermore, appearing in the video a line leading to a screen related to the user terminal of another user who has a specific item includes appearing a screen for exchanging items with other users, or a pop-up image for transitioning to that screen.

[0366] The screen can be a profile screen of another user, a dedicated screen for exchanging, etc.

[0367] In addition, item exchanges with other users may be conducted by freely negotiating via messages (chat), or a function may be implemented that allows users to express their desire to transfer or receive items in advance.

[0368] Next, a case where the specific word is a word related to an event in the real space will be described.

[0369] Words related to events in the real world can be, for example, words that represent the weather, location, or date and time (for example, words that represent "good weather," "Christmas," etc.).

[0370] In this case, the display control information can be information for making a real object associated with an event in real space appear in the video.

[0371] An example of making a real object associated with an event in real space appear in a video is making a wallpaper object appear in the video. The wallpaper object is an object that is displayed behind a character object and functions as a background for the video.

[0372] For example, when the first user makes a statement such as "It's nice weather," a wallpaper object of fine weather appears in the video, and the display is controlled so that a sun object also appears.

[0373] Similarly, when the first user makes a statement such as "It's starting to rain!", the display is controlled so that a wallpaper object showing rain falling appears in the video.

[0374] Next, a case where the specific word is a word contained in a specific text displayed in a video will be described.

[0375] The words contained in the specific text displayed in the video may be, for example, words contained in a comment posted from the first user terminal 100 or the second user terminal 200, or a system comment posted by the system operator.

[0376] The system comment is a comment that is automatically displayed on the video, and is usually a textual display notifying the second user that he / she has entered or left the broadcast slot, or that a gift has been thrown.

[0377] In addition, the specific text is not limited to any particular text as long as it is displayed on the screen, and may include the above-mentioned comments, text shown in displayed objects (gift objects, whiteboard objects, notepad objects, etc.), etc.

[0378] At this time, the display control unit 440 can highlight specific text.

[0379] Highlighting a specific text means applying a specific dramatic effect to an object related to the specific text, such as adding a sparkling effect, a blinking or rotating effect, or adding a mark or frame to serve as a marker. The display color of the specific text may also be changed.

[0380] It should be noted that it is not necessary for the entire specific text to be read out to the first user, and text equivalent to a predetermined percentage of the specific text may be recognized as the specific word.

[0381] The highlighting may include displaying an object related to the character object of the user who posted the comment.

[0382] The related object may be a two-dimensional character object or a reduced-sized character object that does not move based on the broadcast user's movements.

[0383] Compared with the case of drawing a three-dimensional character object, which requires a large processing load, the above-described configuration makes it possible to reduce drawing costs.

[0384] The reduction in the size of a character object includes the change in the head-to-body ratio of the character object. For example, this includes a miniature character with the head and body parts in the same proportions. The miniature character may be in 2D or 3D.

[0385] When multiple people are collaborating, the receiving unit 410 receives multiple pieces of voice information related to the voices of multiple users transmitted from multiple user terminals including the first user terminal 100.

[0386] At this time, the analysis unit 430 analyzes whether the voice contains a specific word, and also identifies the number of specific words contained in the voice.

[0387] The display control unit 440 can control the display of the video based on the display control information associated with the specific word included in the audio and the number of audios including the specific word.

[0388] In this way, in the case of collaboration, the display of the video can be controlled differently depending on the number of people who utter a particular word. For example, if a particular word is uttered by one person and by multiple people, the display of the video can be controlled to be more colorful when the word is uttered by multiple people.

[0389] In addition, in the case of a video in which multiple people are playing a game, it is possible to cause special effects or activate skills within the game.

[0390] In addition, if the specific word is a password set by the first user who is the host, as described below, it will increase the sense of unity among participating users in the collaborative video and stimulate communication, thereby improving the quality of the video.

[0391] In addition, if only the host knows a certain word and the guest does not, it will be possible to provide quiz show-like content.

[0392] Next, a case where the specific word is a set word set by an operation on the first user terminal 100 will be described.

[0393] In this case, one or more computer processors in the present disclosure may further include a setting unit 480 as shown in FIG.

[0394] The setting unit 480 sets a specific word based on the operation of the first user accepted by the receiving unit 410 .

[0395] The first user may operate the above settings on the above-mentioned distribution setting screen D20, or may operate via a setting button D41 displayed during distribution of a video. In addition, the above settings may be operated on the first user's profile screen or the like, regardless of whether distribution is being performed or not.

[0396] The specific word may be set by selecting it from among candidate words presented, or by freely inputting text. The candidate words are assumed to be stored in advance in a predetermined storage device provided in or connectable to one or more computer processors of the present disclosure.

[0397] Then, the words set in the first user terminal are stored in a storage device in association with the display control information, as in the data table shown in Fig. 26. In the case of candidate words, this display control information is associated in advance, and in the case of words entered freely, the user can freely set the action, control target, and / or control content to be associated with a specific word.

[0398] Such setting words may be effective only in a single avatar distribution or world distribution by the first user terminal, or may be effective in a collaborative distribution or world distribution involving multiple users.

[0399] In other words, in the latter collaborative broadcasts and worlds, the set words function as a password between users and help to stimulate communication between multiple users.

[0400] In addition, when the specific word is set by the system, the specific word may be known to the user in advance, or may not be disclosed to the user. If the set specific word is not disclosed, it can be a secret keyword that creates fun in guessing the correct answer, or can create a sense of surprise when the answer is correct.

[0401] The setting section 480 may set whether or not to control the display of the moving image according to the result of the analysis by the analysis section 430.

[0402] The setting unit 480 performs the setting based on the operation of the first user accepted by the receiving unit 410, and the first user may perform the setting operation on the above-mentioned distribution setting screen D20, or may perform the operation via a setting button D41 displayed during distribution of a video. In addition, the setting operation may be performed on the profile screen of the first user, regardless of the presence or absence of distribution.

[0403] According to this configuration, the first user can choose at his / her own will whether or not to control the display of the moving image in accordance with the results of analysis by the analysis unit 430, and it becomes possible to prevent the display of the moving image from being controlled unintentionally by the first user.

[0404] In the above embodiment, an example has been described in which the display control unit 440 controls the display of the video based on the display control information associated with a specific word included in the audio in accordance with the result of analysis by the analysis unit 430. However, the analysis unit 430 may analyze whether a specific action is included in the action based on the action information received by the receiving unit 410.

[0405] At this time, the display control unit can control the display of the video based on the result of the analysis by the analysis unit 430 and on the display control information associated with a specific action included in the action.

[0406] The information regarding the specific operation may be stored in advance in a predetermined storage device included in the one or more computer processors, or in a predetermined storage device connectable to the information processing system 3000.

[0407] Furthermore, a specific action and display control information are stored in association with each other in the predetermined storage device.

[0408] The display control information may, as an example, include information regarding an operation object (control target) for performing an operation required for an action corresponding to a specific motion, and information regarding control information (control content) for the operation object, but may also include other information without being limited to these.

[0409] For example, the specific action "yawning" is associated with a control content in which the gift list screen V30 is displayed on the second user terminal 200 and the display is controlled so that the corresponding eye mask gift is illuminated.

[0410] In addition, the specific action "pat the belly" is associated with a control content in which the gift list screen V30 is displayed on the second user terminal 200 and the display is controlled so that the corresponding meat gift is illuminated.

[0411] The above-mentioned embodiments relating to specific words can also be applied in appropriate combination when the above-mentioned specific actions are adopted.

[0412] Next, an information processing method according to an embodiment of the present disclosure will be described.

[0413] The information processing method according to the embodiment of the present disclosure can be executed in an information processing system 3000 including one or more user terminals 100 and 200 and a server device 400.

[0414] As shown as an example in FIG. 34, the information processing method in the present disclosure can cause one or more computer processors included in an information processing system 3000 to execute a receiving step S410, a transmitting step S420, an analyzing step S430, and a display control step S440.

[0415] In a receiving step S410, voice information relating to at least the voice of the first user, which is transmitted from a first user terminal of the first user, is received.

[0416] Such a receiving step S410 can be performed by the receiving unit 410 described above.

[0417] The receiving step S410 may be executed on the server side (server device 400).

[0418] In a transmission step S420, information for displaying the video relating to the first user on the first user terminal and / or the second user terminal of the second user is transmitted to the first user terminal and / or the second user terminal.

[0419] Such a transmitting step S420 can be performed by the transmitting unit 420 described above.

[0420] The sending step S420 may be executed on the server side (server device 400).

[0421] In an analysis step S430, the voice information is used to analyze whether the voice includes specific words.

[0422] Such an analysis step S430 can be performed by the analysis unit 430 described above.

[0423] The analyzing step S430 may be executed on the server side (server device 400) or on the client side (first user terminal 100).

[0424] In the display control step S440, the display of the moving image is controlled based on the display control information associated with a specific word included in the voice, according to the result of the analysis in the analysis step S430.

[0425] Such a display control step S440 can be executed by the display control unit 440 described above.

[0426] The display control step S440 may be executed on the server side (server device 400) or on the client side (first user terminal 100 / second user terminal 200).

[0427] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

[0428] Next, a computer program according to an embodiment of the present disclosure will be described.

[0429] The computer program in the embodiment of the present disclosure can be executed in an information processing system 3000 including one or more user terminals 100 and 200 and a server device 400 .

[0430] The computer program in the present disclosure causes one or more computer processors included in the information processing system 3000 to realize a receiving function, a transmitting function, an analyzing function, and a display control function.

[0431] The receiving function receives voice information relating to at least the voice of the first user transmitted from a first user terminal of the first user.

[0432] The transmission function transmits information for displaying a video relating to the first user on the first user terminal and / or the second user terminal of the second user to the first user terminal and / or the second user terminal of the second user.

[0433] The analysis function analyzes whether the voice contains specific words based on the voice information.

[0434] The display control function controls the display of the video based on the display control information associated with specific words contained in the audio, in accordance with the results of the analysis performed by the analysis function.

[0435] The above functions can be realized by the receiving circuit 1410, the transmitting circuit 1420, the analyzing circuit 1430, and the display control circuit 1440 shown in Fig. 35. The receiving circuit 1410, the transmitting circuit 1420, the analyzing circuit 1430, and the display control circuit 1440 are realized by the above-mentioned receiving unit 410, the transmitting unit 420, the analyzing unit 430, and the display control unit 440, respectively. Details of each unit are as described above.

[0436] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

[0437] Next, an information processing device according to an embodiment of the present disclosure will be described. The information processing device corresponds to the first user terminal 100 in the information processing system 3000 described above.

[0438] The information processing device is an information processing device including one or more computer processors, and the one or more computer processors include a transmitting unit 110, a receiving unit 120, and a display control unit 130 as shown in FIG.

[0439] The transmitting unit 110 transmits voice information relating to at least the voice of the first user to the server device.

[0440] The receiving unit 120 receives information for displaying a video relating to a first user from a server device.

[0441] The display control unit 130 controls the display of the video based on the display control information associated with the specific word included in the audio, according to the result of analyzing whether the audio includes the specific word based on the audio information. The display control unit 130 can be configured similarly to the display control unit 440 described above.

[0442] The one or more computer processors may further include an analysis unit that analyzes whether the voice includes a specific word based on the voice information. In this case, the analysis unit may have a configuration similar to that of the analysis unit 430 described above.

[0443] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

[0444] Next, an example of an information processing method according to an embodiment of the present disclosure will be described. The information processing method is an information processing method executed in the above-mentioned information processing device (first user terminal 100).

[0445] The information processing method according to the present disclosure is characterized in that, as shown as an example in FIG. 37, one or more computer processors included in an information processing device execute a transmitting step S110, a receiving step S120, and a display control step S130.

[0446] The sending step S110 sends voice information related to at least the voice of the first user to the server device. The sending step S110 can be executed by the sending unit 110 described above.

[0447] In the receiving step S120, information for displaying a video related to the first user is received from the server device. The receiving step S120 can be executed by the receiving unit 120 described above.

[0448] In the display control step S130, the display of the video is controlled based on the display control information associated with the specific word included in the voice, according to the result of analyzing whether the voice includes the specific word based on the voice information. The display control step S130 can be executed by the display control unit 130 described above.

[0449] In addition, the information processing method according to the embodiment of the present disclosure may include causing the one or more computer processors to execute an analysis step of analyzing whether the voice includes a specific word based on the voice information. In this case, the analysis step may have a configuration similar to that of the above-mentioned analysis step S430.

[0450] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

[0451] Next, a computer program according to an embodiment of the present disclosure will be described. The computer program is executed in the information processing device (first user terminal 100) described above.

[0452] A computer program according to the present disclosure is characterized in that it causes one or more processors included in an information processing device to realize a transmission function, a reception function, and a display control function.

[0453] The transmission function transmits voice information relating to at least the voice of the first user to the server device.

[0454] The receiving function receives information for displaying a video relating to a first user from a server device.

[0455] The display control function controls the display of the video based on display control information associated with the specific word contained in the audio, depending on the results of an analysis of whether the audio contains a specific word based on the audio information.

[0456] The above functions can be realized by a transmission circuit 1110, a reception circuit 1120, and a display control circuit 1130 shown in Fig. 38. The transmission circuit 1110, the reception circuit 1120, and the display control circuit 1130 are realized by the above-mentioned transmission unit 110, reception unit 120, and display control unit 130, respectively. Details of each unit are as described above.

[0457] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

[0458] Next, an information processing device according to an embodiment of the present disclosure will be described. The information processing device corresponds to the second user terminal 200 in the information processing system 3000 described above.

[0459] The information processing device is an information processing device including one or more computer processors, and the one or more computer processors include a receiving unit 210 and a display control unit 220 as shown in FIG.

[0460] The receiving unit 210 receives information for displaying a video relating to a first user from a server device.

[0461] The display control unit 220 controls the display of the video based on the display control information associated with the specific word included in the audio, according to the result of analyzing whether the audio includes a specific word based on the audio information. The display control unit 220 can be configured similarly to the display control unit 440 described above.

[0462] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

[0463] Next, an example of an information processing method according to an embodiment of the present disclosure will be described. This information processing method is an information processing method executed in the above-mentioned information processing device (the second user terminal 200).

[0464] The information processing method according to the present disclosure is characterized in that, as shown as an example in FIG. 40, one or more computer processors included in an information processing device execute a receiving step S210 and a display control step S220.

[0465] In the receiving step S210, information for displaying a video related to the first user is received from the server device. The receiving step S210 can be executed by the receiving unit 210 described above.

[0466] The display control step S220 controls the display of the video based on display control information associated with the specific word included in the voice, depending on the result of analyzing whether the voice includes a specific word based on the voice information related to at least the voice of the first user. Such a display control step S220 can be executed by the above-mentioned display control unit 220.

[0467] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

[0468] Finally, a computer program according to an embodiment of the present disclosure will be described below. This computer program is executed in the above-mentioned information processing device (the second user terminal 200).

[0469] The computer program according to the present disclosure is characterized in that it causes one or more processors included in an information processing device to realize a receiving function and a display control function.

[0470] The receiving function receives information for displaying a video relating to a first user from a server device.

[0471] The display control function controls the display of the video based on display control information associated with specific words contained in the audio, depending on the results of an analysis of whether the audio contains specific words based on audio information regarding at least the first user's audio.

[0472] The above functions can be realized by the receiving circuit 1210 and the display control circuit 1220 shown in Fig. 41. The receiving circuit 1210 and the display control circuit 1220 are realized by the above-mentioned receiving unit 210 and the display control unit 220, respectively. Details of each unit are as described above.

[0473] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

[0474] In addition, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-described embodiment. Such an information processing device can be realized by storing a program describing the processing contents for realizing each function of the server device or terminal device according to the embodiment in a storage unit of the information processing device, and reading and executing the program by a CPU of the information processing device.

[0475] 42 is a block diagram of a processing circuit for performing computer-based operations according to the present disclosure. FIG 42 shows a processing circuit 600, which corresponds to the CPU of the terminal and device in the present disclosure.

[0476] The processing circuit 600 is used to control any computer-based and cloud-based control process, and the flowchart descriptions or blocks can be understood as representing modules, segments, or portions of code that include one or more executable instructions for implementing a particular logical function or step in a process, and alternative implementations are included within the scope of the exemplary embodiments of the present advancement in which the functions may be performed. The order from that shown or discussed includes substantially simultaneous or reverse order depending on the functionality involved, as will be understood by those skilled in the art. The functionality of the elements disclosed herein may be implemented using circuits or processing circuits that may include general purpose processors, special purpose processors, integrated circuits, ASICs ("application specific integrated circuits"), conventional circuits configured or programmed to perform the disclosed functions, and / or combinations thereof. A processor processes circuits or circuits to include transistors and other circuits therein. A processor may be a programmed processor that executes a program stored in a memory. In the present disclosure, a processing circuit, unit, or means is hardware that performs or is programmed to perform the recited functions. The hardware may be any hardware disclosed herein or any other known hardware that is programmed or configured to perform the recited functions.

[0477] In FIG. 42, the processing circuit 600 includes a CPU 601 that executes one or more control processes discussed in this disclosure. Process data and instructions may be stored in memory 602. These processes and instructions may also be stored on a storage medium disk 604, such as a hard drive (HDD) or a portable storage medium, or may be stored remotely. Furthermore, the claimed advancement is not limited by the form of the computer-readable medium on which the instructions of the processes of the invention are stored. For example, the instructions may be stored on a CD, DVD, flash memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk, or any other non-transitory computer-readable medium of an information processing device with which the processing circuit 600 communicates, such as a server or computer. The processes may also be stored in network-based storage, cloud-based storage, or other mobile-accessible storage and executable by the processing circuit 600.

[0478] Additionally, the claimed developments may be provided as a utility application, a background daemon, or an operating system component, or any combination thereof, and execute in conjunction with the CPU 601 and an operating system, such as Microsoft Windows, UNIX, Solaris, LINUX, Apple MAC-OS, Apple iOS, and other systems known to those skilled in the art.

[0479] The hardware elements for implementing the processing circuit 600 may be implemented by various circuit elements. Also, each function of the above-described embodiments may be implemented by a circuit including one or more processing circuits. The processing circuit includes a specifically programmed processor, for example, a processor (CPU) 601 as shown in FIG. 42. The processing circuit also includes devices such as application specific integrated circuits (ASICs) and conventional circuit components arranged to perform the enumerated functions.

[0480] Alternatively, or additionally, CPU 601 may be implemented on an FPGA, an ASIC, a PLD, or using discrete logic circuitry, as will be appreciated by those skilled in the art. CPU 601 may also be realized as multiple processors operating in parallel and in coordination to execute instructions of the inventive process described above.

[0481] The processing circuit 600 of FIG. 42 also includes a network controller 606, such as an Ethernet PRO network interface card, for interfacing with the network 700. As can be appreciated, the network 700 can be a public network, such as the Internet, or a private network, such as a local area network (LAN) or a wide area network (WAN), or any combination thereof, and can also include a public switched telephone network (PSTN) or an integrated services digital network (ISDN) sub-network. The network 700 can also be wired, such as an Ethernet network, a universal serial bus (USB) cable, or wireless, such as a cellular network, including EDGE, 3G and 4G wireless cellular systems. The wireless network can also be Wi-Fi, wireless LAN, Bluetooth, or any other form of wireless communication known. Additionally, the network controller 606 may be compliant with other direct communication standards, such as Bluetooth, near field communication (NFC), infrared, or other.

[0482] The processing circuit 600 further includes a display controller 608, such as a graphics card or graphics adapter, for interfacing with a display 609, such as a monitor. The I / O interface 612 interfaces with a keyboard and / or mouse 614, as well as a touch screen panel 616 on or separate from the display 609. The I / O interface 612 also connects to various peripheral devices 618.

[0483] A storage controller 624 connects the storage media disks 604 to a communication bus 626, which may be ISA, EISA, VESA, PCI, or the like, and interconnects all components of the processing circuit 600. A description of the display 609, keyboard and / or mouse 614, and the general features and functionality of the display controller 608, storage controller 624, network controller 606, and I / O interface 612 is omitted herein for the sake of brevity, as these features are known.

[0484] Example circuit elements described in the context of this disclosure may be substituted with other elements and may be structured differently than the examples provided herein. Furthermore, circuits configured to perform the functions described herein may be implemented in multiple circuit units (e.g., chips) or features may be combined in circuits on a single chipset.

[0485] The functions and features described herein may also be performed by various distributed components of the system. For example, one or more processors may perform these system functions, where the processors are distributed across multiple components that communicate within a network. The distributed components may include one or more client and server machines that may share processing, as well as various human interface and communication devices (e.g., display monitors, smartphones, tablets, personal digital assistants (PDAs)). The network may be a private network, such as a LAN or WAN, or a public network, such as the Internet. Input to the system may be received via direct user input, remotely in real time or as a batch process. Additionally, some implementations may be performed on modules or hardware that are not identical to those described. Thus, other implementations are within the scope that may be claimed.

[0486] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims.

[0487] The method described in the embodiment can be stored as a program that can be executed by a calculator (computer) on a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), or a semiconductor memory (ROM, RAM, flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium side also includes a setting program that configures software means (including not only execution programs but also tables and data structures) that the computer executes. The computer that realizes this device reads the program recorded on the recording medium, and in some cases, configures the software means by the setting program, and executes the above-mentioned processing by controlling the operation of the software means. The recording medium referred to in this specification is not limited to a storage medium for distribution, but also includes a storage medium such as a magnetic disk or semiconductor memory provided inside the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. [Additional Notes] The following is a summary of the claims as originally filed in the original application of this application. [1] An information processing system including one or more computer processors, the one or more computer processors: A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis unit that analyzes whether the voice includes a specific word based on the voice information; a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit; An information processing system comprising: [2] The specific word is a word related to an action requiring an operation on the first user terminal, The information processing system according to claim 1, characterized in that the display control information is information for causing an operation object corresponding to the action to appear on the video or the screen of the first user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the first user terminal, and / or for displaying an operation screen corresponding to the action. [3] The specific word is a word related to an action requiring an operation on the second user terminal, The information processing system according to claim 1, characterized in that the display control information is information for causing an operation object corresponding to the action to appear on the video or a screen of the second user terminal, for highlighting an operation object corresponding to the action displayed on the video or a screen of the second user terminal, and / or for displaying an operation screen corresponding to the action. [4] The display control unit is When the specific word is a word related to an action requiring an operation on the first user terminal, controlling the display of the video on the first user terminal and the second user terminal; The information processing system described in claim 1, characterized in that when the specific word is a word related to an action requiring an operation on the second user terminal, the display of the video is controlled only in the video displayed on the second user terminal. [5] The one or more computer processors further include: The information processing system according to claim 2 or 3, characterized in that it further comprises an effect generating unit that generates a specific effect in the first user terminal and / or the second user terminal when the action is performed by selecting the operation object that appears or is displayed highlighted in the video. [6] the particular word is a word associated with the request; The information processing system according to claim 1, characterized in that the display control information is information for making an object corresponding to the request appear in the video and / or information for displaying the object displayed in the video in an emphasized manner. [7] The information processing system of claim 6, characterized in that the object associated with the request is a lottery object that allows real products and / or product objects to be obtained by lottery, a shop object that represents a shop where the real products and / or product objects can be purchased, or an advertising object that represents an advertisement relating to the real products and / or product objects. [8] the one or more computer processors: The information processing system of claim 7 further comprising an order unit that, when a win for the real product is determined by an operation on the lottery object on the first user terminal, or when a real product is ordered on the first user terminal via the shop object and / or the advertising object, transmits information regarding the win or information regarding the order and at least the address information of the first user contained in the user information of the first user to an information processing device of a physical store associated with the lottery object, the shop object and / or the advertising object. [9] The information processing system according to claim 7 or 8, characterized in that the display control unit, when a real product is ordered via the shop object and / or the advertising object at the first user terminal, displays a product object corresponding to the real product in the video.

[10] the specific words being words associated with a specific item; The one or more computer processors further include: a determination unit that determines whether the particular item is associated with the first user terminal; When the determination unit determines that the specific item is associated with the first user terminal, The display control unit is Information for making a specific object corresponding to the specific item appear in the video; Information for highlighting the specific object displayed in the video, and / or Information for displaying a list screen of items associated with the first user terminal, including the specific item. 2. The information processing system according to claim 1, wherein the display of the video is controlled based on display control information that is

[11] When the determination unit determines that the specific item is not associated with the first user terminal, The display control unit is A lottery object that allows the specific item to be acquired by lottery, a shop object that represents a shop where the specific item can be purchased, or an advertisement object that represents an advertisement related to the specific item, information for making the advertisement appear in the video, and / or Information for emphasizing and displaying the lottery object, the shop object, and / or the advertisement object displayed in the video 11. The information processing system according to claim 10, wherein display control information controls display of the moving image based on the display control information.

[12] When the determination unit determines that the specific item is not associated with the first user terminal, The information processing system described in claim 10, characterized in that the display control unit controls the video based on display control information, which is information for making a line to a screen related to a user terminal of another user who has the specific item appear in the video.

[13] the specific word is a word related to an event in real space, The information processing system according to claim 1, wherein the display control information is information for making a real object associated with an event in the real space appear in the video.

[14] the specific word is a word contained in a specific text displayed in the video, 2. The information processing system according to claim 1, wherein the display control unit highlights the specific text.

[15] 15. The information processing system according to claim 14, wherein the specific text is a comment posted from the first user terminal or the second user terminal, or a system comment.

[16] 16. The information processing system according to claim 15, wherein the highlighting includes displaying an object related to a character object of the user who posted the comment.

[17] 2. The information processing system according to claim 1, wherein the video displays a character object of the first user and a virtual space in which the character object can move.

[18] If the second user terminal is associated with the first user terminal, At least a portion of the virtual space is shared with a second user terminal; 18. The information processing system according to claim 17, wherein an effect of the control of the display of the video by the display control unit extends to both the first user terminal and the second user terminal.

[19] if the second user terminal is not associated with the first user terminal, At least a portion of the virtual space is shared with a second user terminal, 20. The information processing system according to claim 18, wherein an effect of the control of the display of the video by the display control unit extends to only one of the first user terminal and the second user terminal.

[20] the one or more computer processors: The information processing system according to claim 1, further comprising a setting unit capable of setting whether or not to control the display of the video in accordance with the result of the analysis by the analysis unit. [twenty one] 2. The information processing system according to claim 1, wherein the first user is a broadcast user, and the second user is one or more viewing users. [twenty two] The receiving unit receives a plurality of pieces of voice information related to voices of a plurality of users transmitted from a plurality of user terminals including the first user terminal, The analysis unit analyzes whether each of the plurality of voices includes a specific word, The information processing system according to claim 1, characterized in that the display control unit controls the display of the video based on display control information associated with a specific word contained in the audio and a number of audio containing the specific word. [twenty three] 2. The information processing system according to claim 1, wherein the specific word is set based on an operation of the first user terminal. [twenty four] The receiving unit receives motion information regarding a motion of the first user transmitted from the first user terminal; 2. The information processing system according to claim 1, wherein the video includes a character object of the first user that moves based on the action information. [twenty five] one or more computer processors, a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; a transmitting step of transmitting information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis step of analyzing whether the voice includes a specific word based on the voice information; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step; An information processing method for executing the above.

[26] one or more computer processors, a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device; a receiving step of receiving information for displaying a video related to the first user from the server device; a display control step of controlling display of the video based on display control information associated with the specific word included in the audio in response to a result of analyzing whether the audio includes a specific word based on the audio information; An information processing method for executing the above.

[27] one or more computer processors, A transmission function of transmitting voice information related to at least the voice of the first user to the server device; a receiving function for receiving information for displaying a video related to the first user from the server device; a display control function that controls display of the video based on display control information associated with a specific word included in the audio in response to a result of an analysis of whether the audio includes a specific word based on the audio information; A computer program that achieves this.

[28] one or more computer processors, a receiving step of receiving information for displaying a moving image related to a first user from a server device; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; An information processing method for executing the above.

[29] one or more computer processors, A receiving function of receiving information for displaying a video related to a first user from a server device; a display control function that controls display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; A computer program that achieves this. [Explanation of symbols]

[0488] 100 First user terminal 200 Second user terminal 300 Network 400 Server device 410 Receiving unit 420 Transmitter 430 Analysis Department 440 Display control unit

Claims

1. An information processing system including one or more computer processors, the one or more computer processors: A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis unit that analyzes whether the voice includes a specific word based on the voice information; a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit; Equipped with The specific word is a word related to an action requiring an operation on the first user terminal, The display control information is information for causing an operation object corresponding to the action to appear on the video or the screen of the first user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the first user terminal, and / or for displaying an operation screen corresponding to the action, in an information processing system.

2. An information processing system including one or more computer processors, the one or more computer processors: A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis unit that analyzes whether the voice includes a specific word based on the voice information; a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit; Equipped with The specific word is a word related to an action requiring an operation on the second user terminal, The display control information is information for causing an operation object corresponding to the action to appear on the video or the screen of the second user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the second user terminal, and / or for displaying an operation screen corresponding to the action, in an information processing system.

3. The one or more computer processors further include: The information processing system according to claim 2, further comprising an effect generating unit that generates a specific effect in the first user terminal and / or the second user terminal when the action is performed by selecting the operation object that appears or is displayed highlighted in the video.

4. An information processing system including one or more computer processors, the one or more computer processors: A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis unit that analyzes whether the voice includes a specific word based on the voice information; a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit; Equipped with The display control unit is When the specific word is a word related to an action requiring an operation on the first user terminal, controlling the display of the video on the first user terminal and the second user terminal; An information processing system that controls the display of the video only in the case where the specific word is a word related to an action requiring an operation on the second user terminal, in which case the display of the video is controlled in the second user terminal.

5. An information processing system including one or more computer processors, the one or more computer processors: A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis unit that analyzes whether the voice includes a specific word based on the voice information; a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit; Equipped with the particular word is a word associated with the request; the display control information is information for making an object associated with the request appear in the video and / or information for highlighting the object displayed in the video, An information processing system in which the object associated with the request is a lottery object that allows real products and / or product objects to be obtained by lottery, a shop object that represents a shop where the real products and / or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and / or product objects.

6. the one or more computer processors: The information processing system described in claim 5 is characterized in that it further comprises an order unit that, when a win for the real product is determined by an operation on the lottery object on the first user terminal, or when a real product is ordered on the first user terminal via the shop object and / or the advertising object, transmits information regarding the win or information regarding the order and at least the address information of the first user contained in the user information of the first user to an information processing device of a physical store associated with the lottery object, the shop object and / or the advertising object.

7. The information processing system described in claim 5 or 6, characterized in that the display control unit displays a product object corresponding to a real product in the video when a real product is ordered via the shop object and / or the advertising object on the first user terminal.

8. An information processing system including one or more computer processors, the one or more computer processors: A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis unit that analyzes whether the voice includes a specific word related to a specific item based on the voice information; a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit; a determination unit for determining whether the particular item is associated with the first user terminal; Equipped with When the determination unit determines that the specific item is associated with the first user terminal, The display control unit is Information for making a specific object corresponding to the specific item appear in the video; Information for highlighting the specific object displayed in the video, and / or Information for displaying a list screen of items associated with the first user terminal, including the specific item. The information processing system controls the display of the moving image based on the display control information.

9. the one or more computer processors: a determination unit that determines whether the particular item is associated with the first user terminal; When the determination unit determines that the specific item is not associated with the first user terminal, The display control unit is Information for making a lottery object that allows the specific item to be acquired by lottery, a shop object that represents a shop where the specific item can be purchased, or an advertisement object that represents an advertisement related to the specific item appear in the video, and / or Information for emphasizing and displaying the lottery object, the shop object, and / or the advertisement object displayed in the video 9. The information processing system according to claim 8, wherein the display of the moving image is controlled based on the display control information which is:

10. the one or more computer processors: a determination unit that determines whether the particular item is associated with the first user terminal; When the determination unit determines that the specific item is not associated with the first user terminal, The information processing system described in claim 8, characterized in that the display control unit controls the video based on display control information, which is information for making a line to a screen related to a user terminal of another user who has the specific item appear in the video.

11. An information processing system including one or more computer processors, the one or more computer processors: A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis unit that analyzes whether the voice includes a specific word based on the voice information; a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit; Equipped with the specific word is a word contained in a specific text displayed in the video, The display control unit highlights the specific text, The specific text is a comment posted from the first user terminal or the second user terminal, or a system comment; An information processing system in which the highlighting includes displaying an object related to the character object of the user who posted the comment.

12. 12. An information processing system according to claim 1, 2, 4, 5, 8 or 11, wherein the video displays a character object of the first user and a virtual space in which the character object can move.

13. If the second user terminal is associated with the first user terminal, At least a portion of the virtual space is shared with a second user terminal; The information processing system according to claim 12 , wherein the effect of the control of the display of the video by the display control unit extends to both the first user terminal and the second user terminal.

14. if the second user terminal is not associated with the first user terminal, At least a portion of the virtual space is shared with a second user terminal, The information processing system according to claim 13 , wherein the effect of the control of the display of the video by the display control unit extends to only one of the first user terminal and the second user terminal.

15. the one or more computer processors: The information processing system according to claim 1 , further comprising a setting unit capable of setting whether or not to control the display of the moving image in accordance with the result of the analysis by the analysis unit.

16. 12. The information processing system according to claim 1, 2, 4, 5, 8 or 11, wherein the first user is a distribution user, and the second user is one or more viewing users.

17. 12. The information processing system according to claim 1, 2, 4, 5, 8 or 11, wherein the specific word is set based on an operation of the first user terminal.

18. The receiving unit receives motion information regarding a motion of the first user transmitted from the first user terminal; 12. The information processing system according to claim 1, wherein the video includes a character object of the first user that moves based on the motion information.

19. one or more computer processors, a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis step of analyzing whether the voice includes a specific word based on the voice information; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step; Run the command, The specific word is a word related to an action requiring an operation on the first user terminal, An information processing method in which the display control information is information for making an operation object corresponding to the action appear on the video or the screen of the first user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the first user terminal, and / or for displaying an operation screen corresponding to the action.

20. one or more computer processors, a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device; a receiving step of receiving information for displaying a video related to the first user from the server device; a display control step of controlling display of the video based on display control information associated with the specific word included in the audio in response to a result of analyzing whether the audio includes a specific word based on the audio information; Run the command, the specific word is a word related to an action requiring an operation by the first user; An information processing method in which the display control information is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and / or for displaying an operation screen corresponding to the action.

21. one or more computer processors, A transmission function of transmitting voice information related to at least the voice of the first user to the server device; a receiving function for receiving information for displaying a video related to the first user from the server device; a display control function that controls display of the video based on display control information associated with a specific word included in the audio in response to a result of an analysis of whether the audio includes a specific word based on the audio information; Realize this, the specific word is a word related to an action requiring an operation by the first user; The display control information is a computer program that is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and / or for displaying an operation screen corresponding to the action.

22. one or more computer processors, a receiving step of receiving information for displaying a moving image related to a first user from a server device; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Run the command, the specific word is a word related to an action requiring an operation by the first user; An information processing method in which the display control information is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and / or for displaying an operation screen corresponding to the action.

23. one or more computer processors, A receiving function of receiving information for displaying a video related to a first user from a server device; a display control function that controls display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Realize this, the specific word is a word related to an action requiring an operation by the first user; The display control information is a computer program that is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and / or for displaying an operation screen corresponding to the action.

24. one or more computer processors, a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis step of analyzing whether the voice includes a specific word based on the voice information; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step; Run the command, The specific word is a word related to an action requiring an operation on the second user terminal, An information processing method in which the display control information is information for making an operation object corresponding to the action appear on the video or the screen of the second user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the second user terminal, and / or for displaying an operation screen corresponding to the action.

25. one or more computer processors, a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device; a receiving step of receiving information for displaying a video related to the first user from the server device; a display control step of controlling display of the video based on display control information associated with the specific word included in the audio in response to a result of analyzing whether the audio includes a specific word based on the audio information; Run the command, The specific word is a word related to an action requiring an operation of a second user on a second user terminal of a second user, An information processing method in which the display control information is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and / or for displaying an operation screen corresponding to the action.

26. one or more computer processors, A transmission function of transmitting voice information related to at least the voice of the first user to the server device; a receiving function for receiving information for displaying a video related to the first user from the server device; a display control function that controls display of the video based on display control information associated with a specific word included in the audio in response to a result of an analysis of whether the audio includes a specific word based on the audio information; Realize this, The specific word is a word related to an action requiring an operation of a second user on a second user terminal of a second user, The display control information is a computer program that is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and / or for displaying an operation screen corresponding to the action.

27. one or more computer processors, a receiving step of receiving information for displaying a moving image related to a first user from a server device; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Run the command, The specific word is a word related to an action requiring an operation of a second user on a second user terminal of a second user, An information processing method in which the display control information is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and / or for displaying an operation screen corresponding to the action.

28. one or more computer processors, A receiving function of receiving information for displaying a video related to a first user from a server device; a display control function that controls display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Realize this, The specific word is a word related to an action requiring an operation of a second user on a second user terminal of a second user, The display control information is a computer program that is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and / or for displaying an operation screen corresponding to the action.

29. one or more computer processors, a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis step of analyzing whether the voice includes a specific word based on the voice information; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step; Run the command, In the display control step, When the specific word is a word related to an action requiring an operation on the first user terminal, controlling the display of the video on the first user terminal and the second user terminal; An information processing method in which, when the specific word is a word related to an action requiring an operation on the second user terminal, the display of the video is controlled only in the video displayed on the second user terminal.

30. one or more computer processors, a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device; a receiving step of receiving information for displaying a video related to the first user from the server device; a display control step of controlling display of the video based on display control information associated with the specific word included in the audio in response to a result of analyzing whether the audio includes a specific word based on the audio information; Run the command, In the display control step, When the specific word is a word related to an action requiring an operation on a first user terminal of a first user, controlling display of the video on the first user terminal and the second user terminal of a second user; An information processing method in which, when the specific word is a word related to an action requiring an operation on the second user terminal, the display of the video is controlled only in the video displayed on the second user terminal.

31. one or more computer processors, A transmission function of transmitting voice information related to at least the voice of the first user to the server device; a receiving function for receiving information for displaying a video related to the first user from the server device; a display control function that controls display of the video based on display control information associated with a specific word included in the audio in response to a result of an analysis of whether the audio includes a specific word based on the audio information; Realize this, The display control function includes: When the specific word is a word related to an action requiring an operation on a first user terminal of a first user, controlling display of the video on the first user terminal and the second user terminal of a second user; A computer program that controls the display of the video only in the video displayed on the second user terminal when the specific word is a word related to an action requiring an operation on the second user terminal.

32. one or more computer processors, a receiving step of receiving information for displaying a moving image related to a first user from a server device; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Run the command, In the display control step, When the specific word is a word related to an action requiring an operation on a first user terminal of a first user, controlling display of the video on the first user terminal and the second user terminal of a second user; An information processing method in which, when the specific word is a word related to an action requiring an operation on the second user terminal, the display of the video is controlled only in the video displayed on the second user terminal.

33. one or more computer processors, A receiving function of receiving information for displaying a video related to a first user from a server device; a display control function that controls display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Realize this, The display control function includes: When the specific word is a word related to an action requiring an operation on a first user terminal of a first user, controlling display of the video on the first user terminal and the second user terminal of a second user; A computer program that controls the display of the video only in the video displayed on the second user terminal when the specific word is a word related to an action requiring an operation on the second user terminal.

34. one or more computer processors, a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis step of analyzing whether the voice includes a specific word based on the voice information; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step; Run the command, the particular word is a word associated with the request; the display control information is information for making an object associated with the request appear in the video and / or information for highlighting the object displayed in the video, An information processing method in which the object associated with the request is a lottery object that allows real products and / or product objects to be obtained by lottery, a shop object that represents a shop where the real products and / or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and / or product objects.

35. one or more computer processors, a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device; a receiving step of receiving information for displaying a video related to the first user from the server device; a display control step of controlling display of the video based on display control information associated with the specific word included in the audio in response to a result of analyzing whether the audio includes a specific word based on the audio information; Run the command, the particular word is a word associated with the request; the display control information is information for making an object associated with the request appear in the video and / or information for highlighting the object displayed in the video, An information processing method in which the object associated with the request is a lottery object that allows real products and / or product objects to be obtained by lottery, a shop object that represents a shop where the real products and / or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and / or product objects.

36. one or more computer processors, A transmission function of transmitting voice information related to at least the voice of the first user to the server device; a receiving function for receiving information for displaying a video related to the first user from the server device; a display control function that controls display of the video based on display control information associated with a specific word included in the audio in response to a result of an analysis of whether the audio includes a specific word based on the audio information; Realize this, the particular word is a word associated with the request; the display control information is information for making an object associated with the request appear in the video and / or information for highlighting the object displayed in the video, A computer program in which the object associated with the request is a lottery object that allows real products and / or product objects to be obtained by lottery, a shop object that represents a shop where the real products and / or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and / or product objects.

37. one or more computer processors, a receiving step of receiving information for displaying a moving image related to a first user from a server device; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Run the command, the particular word is a word associated with the request; the display control information is information for making an object associated with the request appear in the video and / or information for highlighting the object displayed in the video, An information processing method in which the object associated with the request is a lottery object that allows real products and / or product objects to be obtained by lottery, a shop object that represents a shop where the real products and / or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and / or product objects.

38. one or more computer processors, A receiving function of receiving information for displaying a video related to a first user from a server device; a display control function that controls display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Realize this, the particular word is a word associated with the request; the display control information is information for making an object associated with the request appear in the video and / or information for highlighting the object displayed in the video, A computer program in which the object associated with the request is a lottery object that allows real products and / or product objects to be obtained by lottery, a shop object that represents a shop where the real products and / or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and / or product objects.

39. one or more computer processors, a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis step of analyzing whether the voice includes a specific word associated with a specific item based on the voice information; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step; determining whether the particular item is associated with the first user terminal; Run the command, When it is determined in the determining step that the specific item is associated with the first user terminal, In the display control step, Information for making a specific object corresponding to the specific item appear in the video; Information for highlighting the specific object displayed in the video, and / or Information for displaying a list screen of items associated with the first user terminal, including the specific item. The information processing method controls the display of the moving image based on the display control information.

40. one or more computer processors, a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device; a receiving step of receiving information for displaying a video related to the first user from the server device; a display control step of controlling display of the video based on display control information associated with a specific word included in the audio, according to a result of analyzing whether the audio includes a specific word related to a specific item based on the audio information; determining whether the particular item is associated with a first user terminal of the first user; Run the command, When it is determined in the determining step that the specific item is associated with the first user terminal, In the display control step, Information for making a specific object corresponding to the specific item appear in the video; Information for highlighting the specific object displayed in the video, and / or Information for displaying a list screen of items associated with the first user terminal, including the specific item. The information processing method controls the display of the moving image based on the display control information.

41. one or more computer processors, A transmission function of transmitting voice information related to at least the voice of the first user to the server device; a receiving function for receiving information for displaying a video related to the first user from the server device; a display control function that controls display of the video based on display control information associated with a specific word included in the audio, according to a result of analyzing whether the audio includes a specific word related to a specific item based on the audio information; a determining function for determining whether the particular item is associated with a first user terminal of the first user; Realize this, When the determining function determines that the particular item is associated with the first user terminal, The display control function includes: Information for making a specific object corresponding to the specific item appear in the video; Information for highlighting the specific object displayed in the video, and / or Information for displaying a list screen of items associated with the first user terminal, including the specific item. A computer program that controls display of the video based on display control information.

42. one or more computer processors, a receiving step of receiving information for displaying a moving image related to a first user from a server device; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word related to a specific item based on voice information related to at least the voice of the first user; determining whether the particular item is associated with a first user terminal of the first user; Run the command, When it is determined in the determining step that the specific item is associated with the first user terminal, In the display control step, Information for making a specific object corresponding to the specific item appear in the video; Information for highlighting the specific object displayed in the video, and / or Information for displaying a list screen of items associated with the first user terminal, including the specific item. The information processing method controls the display of the moving image based on the display control information.

43. one or more computer processors, A receiving function of receiving information for displaying a video related to a first user from a server device; a display control function that controls display of the video based on display control information associated with a specific word related to a specific item included in the voice, in response to a result of analyzing whether the voice includes a specific word based on voice information related to at least the voice of the first user; a determining function for determining whether the particular item is associated with a first user terminal of the first user; Realize this, When the determining function determines that the particular item is associated with the first user terminal, The display control function includes: Information for making a specific object corresponding to a specific item appear in the video; Information for highlighting the specific object displayed in the video, and / or Information for displaying a list screen of items associated with the first user terminal, including the specific item. A computer program that controls display of the video based on display control information.

44. one or more computer processors, a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user; A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and / or a second user terminal of a second user to the first user terminal and / or the second user terminal; an analysis step of analyzing whether the voice includes a specific word based on the voice information; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step; Run the command, the specific word is a word contained in a specific text displayed in the video, In the display control step, the specific text is highlighted, The specific text is a comment posted from the first user terminal or the second user terminal, or a system comment; The information processing method, wherein the highlighting includes displaying an object related to a character object of the user who posted the comment.

45. one or more computer processors, a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device; a receiving step of receiving information for displaying a video related to the first user from the server device; a display control step of controlling display of the video based on display control information associated with the specific word included in the audio in response to a result of analyzing whether the audio includes a specific word based on the audio information; Run the command, the specific word is a word contained in a specific text displayed in the video, In the display control step, the specific text is highlighted, The specific text is a comment posted from a first user terminal of the first user or a second user terminal of a second user, or a system comment; The information processing method, wherein the highlighting includes displaying an object related to a character object of the user who posted the comment.

46. one or more computer processors, A transmission function of transmitting voice information related to at least the voice of the first user to the server device; a receiving function for receiving information for displaying a video related to the first user from the server device; a display control function that controls display of the video based on display control information associated with a specific word included in the audio in response to a result of an analysis of whether the audio includes a specific word based on the audio information; Realize this, the specific word is a word contained in a specific text displayed in the video, The display control function highlights the particular text; The specific text is a comment posted from a first user terminal of the first user or a second user terminal of a second user, or a system comment; The highlighting includes displaying an object related to the character object of the user who posted the comment.

47. one or more computer processors, a receiving step of receiving information for displaying a moving image related to a first user from a server device; a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Run the command, the specific word is a word contained in a specific text displayed in the video, In the display control step, the specific text is highlighted, The specific text is a comment posted from a first user terminal of the first user or a second user terminal of a second user, or a system comment; The information processing method, wherein the highlighting includes displaying an object related to a character object of the user who posted the comment.

48. one or more computer processors, A receiving function of receiving information for displaying a video related to a first user from a server device; a display control function that controls display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user; Realize this, the specific word is a word contained in a specific text displayed in the video, The display control function highlights the particular text; The specific text is a comment posted from a first user terminal of the first user or a second user terminal of a second user, or a system comment; The highlighting includes displaying an object related to the character object of the user who posted the comment.

Images