Information processing system, information processing method and computer program

Abstract

To provide an information processing system, an information processing method and a program, which improve visibility of information displayed on a screen of a user terminal.SOLUTION: In an information processing system in which a user terminal is connected with a server device via a network, a server device 400 includes: an object display unit that can display an operation object for receiving an operation to a first display screen by a first user on a display screen so as to be superimposed on a moving image; an information column display unit that can display an information column displaying information related to a reaction to the moving image by a first user and / or a second user different from the first user on the display screen so as to be superimposed on the moving image; and a determination unit that determines a first condition. When the determination unit determines that the first condition is satisfied, the object display unit changes a display mode of the operation object from a first display mode to a second display mode, and the information column display unit changes a display mode of the information column from a third display mode to a fourth display mode.SELECTED DRAWING: Figure 26

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a computer program. [Background technology]

[0002] BACKGROUND ART There is known an information processing system that generates animation of a character object based on the movement of a user and distributes a moving image including the animation of the character object (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-184689 Summary of the Invention [Problem to be solved by the invention]

[0004] Various UI objects are placed on the screen of a user's information processing device to allow the user to perform processes while a video is being distributed, but when distributing videos using an information processing device such as a smartphone that has a relatively small screen, there is a risk that the visibility of the screen will be reduced.

[0005] Therefore, it is an object of the present disclosure to provide technical improvements that solve or alleviate at least some of the problems of the prior art mentioned above.

[0006] Furthermore, one of the more specific objects of the present disclosure is to improve the visibility of information displayed on the screen of a user's information processing device. [Means for solving the problem]

[0007] The information processing system of the present disclosure is an information processing system including one or more computer processors, wherein the one or more computer processors include: a display control unit that controls the display of a video on a first display screen of a first information processing device of the first user, the video displaying a predetermined virtual space and a first character object of a first user that can move within the virtual space; an object display unit that enables an operation object for accepting operations by the first user on the first display screen to be displayed on the display screen superimposed on the video; an information column display unit that enables an information column for displaying information regarding reactions to the video by the first user and / or a second user different from the first user to be displayed on the display screen superimposed on the video; a reception unit that accepts predetermined operations and / or voice by the first user; and a determination unit that determines whether a first condition related to the first user and / or the first character object is satisfied, wherein when the determination unit determines that the first condition is satisfied, the object display unit changes the display mode of the operation object from a first display mode to a second display mode, and the information column display unit changes the display mode of the information column from a third display mode to a fourth display mode.

[0008] The first condition is that the relationship between the placement position of a specific object and the placement position of a first character object in a predetermined virtual space is a specific relationship, or that the specific object can be selected by the first user.

[0009] The specific object is an object used when a first user communicates with a second user, and may be a first object that is associated with a first character object or displayed as a background or rug for the first character object.

[0010] The specific object may be an object used when a first user communicates with a second user, and may be a second object for displaying the first object in association with the first character object or displayed as a background or rug for the first character object.

[0011] The specific relationship can be defined as the first character object and the specific object being associated with each other, or the distance between the first character object and the specific object being equal to or less than a predetermined value.

[0012] The first condition may be that the accepting unit accepts an operation by the first user on a switching object displayed on the display screen.

[0013] The first condition may be that the voice received by the receiving unit satisfies a predetermined condition.

[0014] The first condition may be that the receiving unit does not receive a movement operation for the first character object for a predetermined period of time.

[0015] The display control unit can further control the display of the video on the second display screen of the second information processing device of the second user.

[0016] When the determination unit determines that the first condition is satisfied, the display control unit can further perform control so that the video can be displayed on the second display screen of the second information processing device of the second user.

[0017] If the display control unit further controls the video to be displayable on the second display screen of the second information processing device of the second user in accordance with instructions from the first user, the judgment unit can judge that the first condition is satisfied.

[0018] When the judgment unit judges that the first condition is satisfied, the video may further display a start object indicating that communication by the first user to the second user has begun.

[0019] The one or more computer processors further include a virtual camera control unit that controls the operation of a virtual camera that can be operated by the first user, and when the determination unit determines that the first condition is satisfied, the virtual camera control unit can change the operation of the virtual camera from a first operating mode to a second operating mode.

[0020] The first operation mode can be an operation mode based on an operation by the first user, and the second operation mode can be an operation mode not based on an operation by the first user.

[0021] The determination unit further determines whether a second condition is satisfied, and if the determination unit determines that the second condition is satisfied, the object display unit changes the display mode of the operation object from the second display mode to the first display mode, and the information column display unit changes the display mode of the information column from the fourth display mode to the third display mode.

[0022] The second condition may be that the reception unit has received a pinch-in operation on the display screen by the first user.

[0023] The second condition may be that the voice received by the receiving unit satisfies a predetermined condition.

[0024] The video further displays a third character object of a third user that can move within the virtual space, the display control unit further controls the display of the video on a third display screen of the third user's third information processing device, and the determination unit can further determine whether a third condition regarding the third user and / or the third character object is satisfied.

[0025] The virtual space is a space associated with each user, and can be a first virtual space in which at least furniture objects can be placed by the operation of the first user.

[0026] The one or more computer processors include a selection receiving unit that receives a selection by a first user of either a first virtual space or a second virtual space that is different from the first virtual space and in which furniture objects cannot be placed, and when the selection receiving unit receives a selection of the first virtual space, the display control unit displays the first virtual space and a first character object that can move within the first virtual space in the video, and the object display unit displays an operation object on the display screen superimposed on the video, and when the selection receiving unit receives a selection of the second virtual space, the display control unit displays the second virtual space and the first character object that cannot move within the second virtual space in the video, and the object display unit does not display the operation object on the display screen superimposed on the video.

[0027] The information processing method according to the present disclosure includes, in one or more computer processors, a display control step of controlling display of a video displaying a predetermined virtual space and a first character object of a first user movable within the virtual space on a first display screen of a first information processing device of the first user; an object display step of enabling an operation object for receiving an operation on the first display screen by the first user to be displayed on the display screen superimposed on the video; an information column display step of enabling an information column for displaying information regarding a reaction to the video by the first user and / or a second user different from the first user to be displayed on the display screen superimposed on the video; a reception step of receiving a predetermined operation and / or voice by the first user; a determination step of determining whether a first condition related to the first user and / or the first character object is satisfied; and a display mode change step of changing the display mode of the operation object from the first display mode to a second display mode and changing the display mode of the information column from a third display mode to a fourth display mode when it is determined in the determination step that the first condition is satisfied. The present invention is characterized in that the following is executed.

[0028] The information processing method of the present disclosure includes, in one or more computer processors, a display control step of controlling the display of a video on a first display screen, the video displaying a predetermined virtual space and a first character object of a first user movable within the virtual space; an object display step of enabling an operation object for receiving an operation on the first display screen by the first user to be displayed on the display screen superimposed on the video; an information column display step of enabling an information column for displaying information regarding a reaction to the video by the first user and / or a second user different from the first user to be displayed on the display screen superimposed on the video; a reception step of receiving a predetermined operation and / or voice by the first user; a determination step of determining whether a first condition related to the first user and / or the first character object is satisfied; and a display mode change step of changing the display mode of the operation object from the first display mode to a second display mode and changing the display mode of the information column from a third display mode to a fourth display mode when it is determined in the determination step that the first condition is satisfied. The present invention is characterized in that the following is executed.

[0029] The computer program of the present disclosure is characterized in that it causes one or more computer processors to realize the following: a display control function for controlling the display on a first display screen of a video displaying a predetermined virtual space and a first character object of a first user that can move within the virtual space; an object display function for enabling an operation object for accepting operations by the first user on the first display screen to be superimposed on the video and displayed on the display screen; an information column display function for enabling an information column for displaying information regarding reactions to the video by the first user and / or a second user different from the first user to be superimposed on the video and displayed on the display screen; a reception function for accepting predetermined operations and / or voices by the first user; a determination function for determining whether a first condition regarding the first user and / or the first character object has been satisfied; and a display mode change function for, if the determination function determines that the first condition has been satisfied, changing the display mode of the operation object from the first display mode to a second display mode and changing the display mode of the information column from a third display mode to a fourth display mode. [Effects of the Invention]

[0030] According to the present disclosure, it is possible to provide technical improvements that solve or alleviate at least some of the problems of the conventional techniques described above. Specifically, according to the present disclosure, it is possible to provide an information processing system, an information processing method, and a computer program that improve the visibility of information displayed on the screen of a user's information processing device. [Brief explanation of the drawings]

[0031] [Figure 1] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 2] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 3] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 4]FIG. 2 is a configuration diagram illustrating an example of a hardware configuration of a server device, a first user terminal, and a second user terminal according to the present disclosure. [Figure 5] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 6] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 7] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 8] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 9] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 10] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 11] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 12] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 13] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 14] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 15] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 16] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 17] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 18] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 19] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 20] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 21] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 22] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 23] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 24] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 25] FIG. 1 is a conceptual diagram illustrating an image of a virtual space described in the present disclosure. [Figure 26] FIG. 2 is a configuration diagram illustrating an example of a functional configuration of a server device according to the present disclosure. [Figure 27] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 28] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 29] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 30] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 31] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 32] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 33] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 34] FIG. 10 is a configuration diagram illustrating another example of the functional configuration of the server device according to the present disclosure. [Figure 35] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 36] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 37] FIG. 1 is a flow diagram illustrating an example of the flow of an information processing method according to the present disclosure. [Figure 38] FIG. 1 is a circuit configuration diagram showing an example of a circuit configuration for realizing a computer program according to the present disclosure. [Figure 39] FIG. 2 is a configuration diagram illustrating an example of a functional configuration of a user terminal according to the present disclosure. [Figure 40] FIG. 10 is a flow diagram showing an example of the flow of an information processing method in a user terminal according to the present disclosure. [Figure 41] FIG. 2 is a circuit configuration diagram showing an example of a circuit configuration for realizing a computer program executed on a user terminal in the present disclosure. [Figure 42] FIG. 1 is a block diagram of processing circuitry for performing computer-based operations in the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0032] First, an overview of an information processing system according to an embodiment of the present disclosure will be described with reference to the drawings.

[0033] The information processing system in the present disclosure is an information processing system including one or more client devices and a server device, and includes one or more computer processors.

[0034] The video displayed on each client device will be described as including animation of 3D or 2D character objects generated based on the broadcaster's movements, but is not limited to this and may include animation of character objects generated in response to the broadcaster's operations, or may include an image of the broadcaster himself / herself.Furthermore, these character objects and the broadcaster may not be displayed, and only the broadcaster's voice may be included.

[0035] Here, a broadcasting user refers to a user who transmits information about video and / or audio. For example, a broadcasting user may be a user who hosts or organizes a solo video broadcast (solo broadcast), a collaborative broadcast in which multiple people can participate, a video chat or voice chat in which multiple people can participate and / or watch, or an event (such as a party) in a virtual space in which multiple people can participate and / or watch, that is, a user who mainly carries out these activities. Therefore, a broadcasting user in this disclosure may also be referred to as a user, host user, organizer user, or organizer user.

[0036] On the other hand, a viewing user refers to a user who receives information about video and / or audio. However, a viewing user can be a user who not only receives the information but also reacts to it. For example, a viewing user may be a user who watches video streaming or collaborative streaming, or a user who participates in and / or watches video chats, voice chats, or events. Therefore, viewing users in the present disclosure can also be referred to as users, guest users, participating users, listeners, spectator users, support users, etc.

[0037] Furthermore, the information processing system in an embodiment of the present disclosure can be used to provide a next-generation internet space (metaverse) in which many people can participate simultaneously in a digital world where they can interact, work, play, and engage in other activities freely through character objects (avatars) at a level similar to that of the real world, transcending the gap between reality and virtuality and enabling social activities.

[0038] In such a space, users' avatars can freely move around within the virtual world and communicate with each other.

[0039] One of the avatars in the virtual space may be configured to broadcast a video as a character object of the broadcasting user. In other words, one-to-many video broadcasting may be possible in a many-to-many metaverse virtual space.

[0040] In such a space, there is no particular distinction between broadcast users and viewing users.

[0041] The space depicted in the video may be a virtual space, a real space, or an augmented reality space that combines these. The video may be something like a karaoke video or a game commentary video that plays back at least a predetermined image and the broadcast user's voice, or may be a display in which a character object or an actual image of the broadcast user is superimposed on these.

[0042] Furthermore, if the broadcasting user is included in the real space, a character object generated based on the broadcasting user's movements may be superimposed on an actual image of the broadcasting user. Also, an animation of a gift object or the like may be superimposed on a captured image of the real space.

[0043] <System configuration> As shown as an example in FIG. 1, the information processing system 1000 according to the present disclosure may include one or more viewing user terminals 1100 and an information processing device (support computer) 1300 located in a video distribution studio or the like, which is connected to these viewing user terminals 1100 via a network 1200.

[0044] Furthermore, the information processing device 1300 may be connected to a predetermined server device via the Internet, and some or all of the processing that should be performed by the information processing device 1300 may be performed by the server device. Note that such a server device may be the information processing device 2400 shown in FIG. 2.

[0045] In this specification, such distribution by the information processing system 1000 is referred to as studio distribution.

[0046] In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.

[0047] Furthermore, the information processing system 1000 of the present invention can cooperate with another information processing system 2000 shown as an example in Fig. 2. The information processing system 2000 shown in Fig. 2 can include a broadcaster user terminal 2100, one or more viewer user terminals 2200, and an information processing device (server device) 2400 connected to the broadcaster user terminal 2100 and the viewer user terminal 2200 via a network 2300.

[0048] In the above example, the broadcaster user terminal 2100 can be an information processing terminal such as a smartphone. In this specification, broadcasting by such information processing system 2000 is referred to as mobile broadcasting.

[0049] In mobile distribution, the broadcaster user's facial movements are captured by a camera on the broadcaster user terminal 2100, and are reflected on the character's face in real time using known face tracking technology.

[0050] In mobile distribution, there is no particular distinction between distributor users and viewing users; viewing users can perform mobile distribution at any time, and distributor users can become viewing users when viewing videos of other distributor users.

[0051] The moving images generated by the information processing system 1000 and the information processing system 2000 can be distributed to viewing users from one moving image distribution platform, for example.

[0052] In addition, in any distribution, the process of generating animation by reflecting motion on a character and the process of displaying gifts, which will be described later, may be shared and performed by the distribution user terminal, the viewing user terminal, the information processing device, and other devices.

[0053] In other words, "distribution" here refers to sending information that enables the video to be viewed on the viewing user's terminal, and the rendering of the video may be performed on the information processing device 1300, 2400 side, or on the distribution user terminal 2100 or viewing user terminal 1100, 2200 side.

[0054] Specifically, facial motion data and voice data of the broadcasting user are transmitted from the broadcasting user terminal or information processing device to a terminal or device that generates (renders) animation of the character object. Body motion may also be transmitted in addition to facial motion.

[0055] In the present disclosure, the process of generating animation will be described as being performed by each of the broadcasting user terminal and the viewing user terminal, but this is not limited to this.

[0056] The information processing system according to the present disclosure can be applied to either of the examples shown in Fig. 1 and Fig. 2. Therefore, an information processing system 3000 according to an embodiment of the present disclosure will be described as including a first user terminal 100, a second user terminal 200, and a server device 400 connectable to the first user terminal 100 and the second user terminal 200 via a network 300, as shown in Fig. 3.

[0057] The first user terminal 100 and the second user terminal 200 are connected to the server device 400 via, for example, a base station, a mobile communication network, a gateway, and the Internet. Communication between the first user terminal 100, the second user terminal 200, and the server device 400 is performed based on a communication protocol such as Hypertext Transfer Protocol (HTTP). Alternatively, a connection may be established between the first user terminal 100, the second user terminal 200, and the server device 400 initially via HTTP communication, and thereafter communication may be performed based on WebSocket, which provides bidirectional communication with lower costs (lower communication loads and processing loads) than HTTP communication. Note that the communication method between the first user terminal 100, the second user terminal 200, and the server device 400 is not limited to the above-described method, and any communication method technology may be used as long as it can realize this embodiment.

[0058] The first user terminal 100 functions at least as the above-mentioned information processing device 1300, viewing user terminal 1100, broadcasting user terminal 2100 or viewing user terminal 2200, the second user terminal 200 functions at least as the above-mentioned information processing device 1300, viewing user terminal 1100, broadcasting user terminal 2100 or viewing user terminal 2200, and the server device 400 functions at least as the above-mentioned specified server device or information processing device 2400.

[0059] In the present disclosure, the first user terminal 100 and the second user terminal 200 may be a smartphone (multifunction phone terminal), a tablet terminal, a personal computer, a console game machine, a head-mounted display (HMD), a wearable computer such as an eyeglass-type wearable terminal (AR glasses, etc.), or an information processing device other than these devices that can play videos. Furthermore, these terminals may be standalone devices that operate independently, or may be composed of multiple devices connected to each other so that various data can be transmitted and received.

[0060] <Hardware configuration> 4, the hardware configuration of the first user terminal 100 will be described. The first user terminal 100 includes a processor 101, a memory 102, a storage 103, an input / output interface (input / output I / F) 104, and a communication interface (communication I / F) 105. The components are connected to each other via a bus B.

[0061] The first user terminal 100 can realize the functions and methods described in this embodiment through cooperation between the processor 101, memory 102, storage 103, input / output I / F 104, and communication I / F 105.

[0062] The processor 101 executes functions and / or methods implemented by codes or instructions included in a program stored in the storage 103. The processor 101 may include, for example, a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may implement each process disclosed in each embodiment using a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large-scale integration (LSI)), etc. Furthermore, these circuits may be implemented using one or more integrated circuits, and multiple processes described in each embodiment may be implemented using a single integrated circuit. Furthermore, an LSI may also be referred to as a VLSI, a super LSI, an ultra LSI, etc. depending on the degree of integration.

[0063] The memory 102 temporarily stores programs loaded from the storage 103 and provides a working area for the processor 101. The memory 102 also temporarily stores various data generated while the processor 101 is executing the programs. The memory 102 includes, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.

[0064] The storage 103 stores programs and includes, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, and the like.

[0065] The communication I / F 105 is implemented as hardware such as a network adapter, communication software, or a combination thereof, and transmits and receives various data via the network 300. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication is possible. The communication I / F 105 communicates with other information processing devices via the network 300. The communication I / F 105 transmits various data to other information processing devices in accordance with instructions from the processor 101. The communication I / F 105 also receives various data transmitted from other information processing devices and transmits the data to the processor 101.

[0066] The input / output I / F 104 includes an input device for inputting various operations to the first user terminal 100, and an output device for outputting processing results processed by the first user terminal 100. The input / output I / F 104 may be an integrated input device and output device, or may be separate input device and output device.

[0067] The input device is realized by any one or combination of all types of devices that can receive input from a user and transmit information related to the input to the processor 101. Examples of the input device include hardware keys such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (for inputting operations via images), and a microphone (for inputting operations via voice).

[0068] The input device may include a sensor unit. The sensor unit includes one or more sensors that detect facial motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body relative to the sensor unit. Facial motions include blinking, opening and closing of the mouth, and other movements. A known sensor unit may be used. One example of the sensor unit includes a ToF sensor that measures the time of flight (TOF) of light irradiated toward the user and reflected from the user's face, a camera that captures the user's face, and an image processing unit that processes the data captured by the camera. The sensor unit may also include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. The RGB camera and the near-infrared camera may be, for example, the True Depth sensor in the iPhone X (registered trademark), the LiDAR sensor in the iPad Pro (registered trademark), or other ToF sensors installed in smartphones. Specifically, this camera uses a dot projector to project tens of thousands of invisible dots onto the user's face, etc. The sensor unit then detects and analyzes the reflected light from the dot pattern to form a depth map of the face, and captures an infrared image of the face, etc., thereby capturing accurate facial data. The sensor unit's processing unit generates various information based on the depth map and the infrared image, and compares this information with registered reference data to calculate the depth of each point on the face (the distance between each point and the near-infrared camera) and positional deviations other than depth.

[0069] The sensor unit may also have a function of tracking not only the user's face but also their hands (hand tracking). The sensor unit may further include sensors other than the above-mentioned sensors, such as an acceleration sensor or a gyro sensor. The sensor unit may have a spatial mapping function of recognizing objects in the real space where the user exists based on the detection results of the above-mentioned ToF sensor or other known sensors, and mapping the recognized objects on a spatial map. Hereinafter, when face motion detection data and body motion detection data are described without any particular distinction, they will simply be referred to as "tracking data." The image processing unit of the sensor unit may be included in a control unit that can be included in the information processing system of the present invention.

[0070] The operation unit serving as an input device can be one that corresponds to the type of user terminal. Examples of the operation unit include a touch panel integrated with a display, operation buttons provided on the housing of the user terminal, a keyboard, a mouse, and a controller operated by the user's hand. The controller may incorporate various known sensors, such as an acceleration sensor, a gyroscope, or an inertial measurement unit (IMU). Another example of the operation unit may be a tracking device that identifies the user's hand movements, eye movements, head movements, and gaze direction. In this embodiment, for example, the user's instructions can be determined based on the user's hand movements, and various operations can be performed, such as starting or ending video distribution, rating a message or video, or requesting the display of a predetermined object (e.g., a gift, as described below). Note that if the sensor unit also has an input interface function, such as a hand truck function, the operation unit can be omitted.

[0071] The output device outputs the processing results obtained by the processor 101. The output device includes, for example, a touch panel, a speaker, and the like.

[0072] It should be noted that the functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. A processor may also be a programmed processor that executes a program stored in a memory.

[0073] In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions.

[0074] If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.

[0075] Furthermore, the second user terminal 200 and the server device 400 in the present disclosure can also be configured with the same hardware configuration as in FIG. 4, except where otherwise noted.

[0076] Next, various functions that can be executed on a user terminal that has launched an application realized by the information processing system according to an embodiment of the present disclosure, and transitions of displayed screens will be described with reference to the drawings.

[0077] FIG. 5 shows the top screen T10 that is displayed on the user terminal (it is not yet specified here whether the user will be viewing / distributing) when a video distribution / viewing application is launched.

[0078] As shown in Figure 5, a user can watch a video being played on a distribution channel by selecting one of the thumbnail images of one or more distribution channels T12 (also called a distribution slot, distribution program, distribution video, etc.) from among the thumbnail images of one or more distribution channels T12 proposed within the pages that can be switched using each tab T11, T14-17 on the top screen T10.

[0079] Alternatively, a user can view a video played on a specific distribution channel by accessing a fixed link for the specific distribution channel. Such a fixed link can be obtained through a notification from a first user who the user is following, a share notification sent by another user, or the like.

[0080] Here, the user who watches the video is the viewing user, and the terminal that watches the video is the second user terminal 200.

[0081] 5, the top screen T10 may display a display field T13 for announcements such as campaigns and events. This announcement display field T13 can be switched to display other announcements by sliding the display field.

[0082] The top screen T10 displays a recommendation tab T11, a follow tab T14, a game tab T15 for displaying game categories, a collaboration waiting tab T16 for displaying distribution channels waiting for collaboration, and a beginner tab T17 for displaying distribution channels for beginners. By selecting these (by switching tabs), the top screen T10 transitions to each of the different screens.

[0083] The service name display T18 and search button T19 in the upper frame of the top screen T10 may remain fixed and displayed on the transition destination screen.

[0084] Similarly, the home button T20, chat button T21, distribution preparation button T22, gacha / shop button T23, and profile button T24 on the bottom frame of the top screen T10 may also be fixed and remain displayed on the destination screen.

[0085] On the top screen T10 shown in Figure 5, for example, a user who selects a displayed thumbnail image T12 can become a viewing user (second user) who watches the video as described above, and a user who selects the distribution preparation button T22 can become a distribution user (first user) who distributes the video.

[0086] As an example, when the distribution preparation button T22 is selected on the top screen T10 shown in Fig. 5, the screen transitions to the avatar setting screen D10 shown in Fig. 6. Then, when the distribution button D11 is selected on the avatar setting screen D10, the screen transitions to the distribution setting screen D20 shown in Fig. 7. Then, when the distribution start button D21 is selected on the distribution setting screen D20, the screen transitions to the avatar distribution screen D30 shown in Fig. 8.

[0087] Next, we will explain the details of the flow up to the start of video distribution.

[0088] The one or more computer processors in the present disclosure may include a distribution start request receiving unit, a distribution setting unit, and a distribution start unit.

[0089] The distribution start request receiving unit receives a request to start distribution of a first moving image including animation of a character object from a first user terminal of a first user.

[0090] Here, the first moving image refers to a moving image including animation of a character object. In this specification, a character object may also be called an "avatar."

[0091] The distribution start request can be transmitted from the user terminal (later to become the first user terminal) to the server device 400 by selecting a distribution button D11 located on an avatar setting screen D10 or the like, which is transitioned from the top screen described above, displayed on the user terminal that has launched a dedicated application (video distribution / viewing application) for accessing the video distribution platform.

[0092] 6 shows an example of an avatar setting screen D10. The avatar setting screen D10 can display a character object CO, a distribution button D11, a room button D12, a change of clothes button D13, a photo button D14, and the like.

[0093] When the user selects the change clothes button D13, a closet screen appears for selecting various avatar parts such as eyes, nose, mouth, hair, accessories, clothes, and background for the character object CO. The closet screen also displays a button for transitioning to a lottery screen for obtaining avatar parts.

[0094] When the user selects the room button D12, a screen of the user's room (a first virtual space, which will be described later) is displayed. Details of the room screen will be described later.

[0095] When the user selects the photo button D14, a photography screen for taking a still image of the character object appears.

[0096] When the user selects the distribution button D11, a distribution start request is sent to the server device 400.

[0097] The distribution setting unit sets distribution settings for the first moving image based on instructions from the first user terminal 100 in response to the distribution start request for the first moving image received by the distribution start request receiving unit.

[0098] As an example, when the distribution button D11 is selected, the screen displayed on the first user terminal 100 transitions from the avatar setting screen D10 shown in FIG. 6 to the distribution setting screen D20 shown in FIG.

[0099] The distribution settings can include at least one of settings related to the distribution location, settings related to collaboration, settings related to the distribution topic, settings related to the public range, and settings related to the title.

[0100] These distribution settings can be set in the distribution location setting button D22, collaboration setting button D23, distribution topic setting button D24, disclosure range setting button D25, and title setting field D26 in FIG. 7, respectively.

[0101] When the distribution location setting button D22 is selected, a distribution location setting screen D29 is displayed, which displays a booth distribution object D27 for selecting a booth distribution and a room distribution object D28 for selecting a room distribution, as shown in Fig. 9, and the user can select a booth or a room as the distribution location. Details of the booth and room will be described later.

[0102] The title of the first moving image that can be set in the title setting field D26 can be freely determined by the distributor user within the range of the maximum number of characters allowed.

[0103] The first user can freely decide whether or not other users can appear in the first video, which can be set by selecting the collaboration setting button D23. If yes, other users can make an appearance request to the distribution user, and if no, other users cannot make an appearance request to the distribution user. The state in which other users appear in the first user's video is sometimes referred to as "collaboration" in this specification. Details of collaboration will be described later.

[0104] The number of people who can appear in the first video can only be set if other users are allowed to appear in the first video as described above, and can be freely determined by the distribution user within the range of the maximum number of people allowed.

[0105] The password can be set arbitrarily only if other users are allowed to appear in the first video, and the distributor can freely set a number with a specified number of digits. When other users request to appear in the first video, they are required to enter the password. Note that the password setting field may be configured to be active only when the collaboration setting for anyone is OFF.

[0106] The distribution starting unit distributes information about the first moving image to the second user terminal 200 of the viewing user based on the conditions set by the distribution setting unit.

[0107] Such a distribution start instruction is sent by selecting the distribution start button D21 shown in Fig. 7. The distribution start button D21 may be configured to become active only when the title of the video has been set.

[0108] As an example, the distribution starting unit distributes information about a moving image (first moving image) including animation of a character object of the first user to the second user terminal 200 of the second user (avatar distribution).

[0109] The information about the first video includes, for example, motion information indicating the movement of the character object, voice information of the first user, gift object information indicating gifts sent by other viewing users, etc. The gift object information includes at least gift object identification information that identifies the type of gift object and position information that indicates the position where the gift object is displayed.

[0110] The distribution starting unit can then live-distribute the video via the video distribution platform described above.

[0111] FIG. 8 shows an avatar distribution screen D30 displayed on the first user terminal 100.

[0112] The avatar distribution screen D30 displays a character object CO, as well as a comment input button D31 for the distribution user to enter a comment, a photo button D32 for saving a still image of the screen, a start play button D33 for playing the game described below, an external service linkage button D34 for watching videos provided by an external service, and a gacha button D62 for obtaining avatar parts.

[0113] Also, at the top of the avatar distribution screen D30, a cumulative viewer count display D35, a cumulative like count display D36, a collaborator count display D37, a share button D38 for external SNS, a guest details button D39, a ranking display button D40, a settings button D41, and an audio switch button D42 for switching audio on / off can be displayed. An end button D43 for ending the distribution is also displayed.

[0114] Detailed description of these displays and buttons will be omitted, but by selecting the setting button D41, it is possible to change the distribution settings made on the distribution setting screen D20.

[0115] 8 shows an example in which distribution has been started on distribution setting screen D20 with other users allowed to appear in the first video and the maximum number of people who can appear in the first video set to three, so character object CO is displayed in a position shifted to the bottom left. Up to three character objects of other users can appear in the empty space.

[0116] This concludes the description of the screen transitions when delivering an avatar according to the invention of the present disclosure.

[0117] Next, the screen transitions that occur when a broadcaster user plays a game during broadcasting will be described.

[0118] The one or more computer processors in the present disclosure may include a game request receiving unit, a game video distribution unit, and a game display processing unit.

[0119] During avatar distribution as shown in FIG. 8, the broadcasting user can request to start playing the game by selecting the start play button D33.

[0120] Note that the game displayed upon selection of the start play button D33 is a dedicated game implemented in an application realized by the information processing system of the present disclosure, and may be different from general-purpose games provided by external services. Therefore, game distribution in the present disclosure may be distinguished from distribution of gameplay videos of general-purpose games provided by external services along with commentary by the distributor user.

[0121] Alternatively, the request to start playing can be sent from the first user terminal 100 to the server device 400 by selecting a start play button located on a specified screen displayed on the first user terminal 100 of the first user.

[0122] Fig. 10 shows an example of a screen G10 on which a play start button G11 is arranged as the predetermined screen. The screen G10 shown in Fig. 10 is a screen transitioned to by selecting a game tab T15 from a top screen T10 (Fig. 5) displayed on a user terminal that has started an application realized by the information processing system of the present disclosure.

[0123] The screen G10 displays at least a play start button G11 that can send a request to start playing a predetermined game.

[0124] Then, when the game request receiving unit receives a request to start playing a predetermined game, the game moving image distribution unit distributes information about the second moving image to the second user terminal 200.

[0125] Here, the second video is a video of a game being played. In this specification, the delivery of such a video so that it is displayed on the screen of the second user terminal 200 is referred to as "game delivery."

[0126] Furthermore, after launching the application realized by the invention of the present disclosure, the user can, as the first user, send a request to start distribution of the second video to the information processing device 2400 by selecting a play start object placed on the game list screen and the game details screen.

[0127] The game list screen or game details screen is the first screen, which will be described in detail next.

[0128] That is, the game display processing unit performs display processing of a first screen including a distribution start object capable of sending a distribution start request, a play start object capable of sending a request to start playing a specified game, and a thumbnail image of a video of a gameplay video of a specified game currently being distributed.

[0129] 10 corresponds to the game list screen of the first screen. The first screen, which is the game list screen, is a screen transitioned to by selecting the game tab T15 from the top screen T10.

[0130] The first screen includes a distribution preparation button T22 as a distribution start object, a play start button G11 as a play start object, and thumbnail images indicating distribution channels for the video.

[0131] The first screen displays, for each of the multiple playable games, a start play button G11, a game icon G12, the game name G13, the total number of viewers of the game's distribution channel G14, and a distribution list G15 including thumbnail images of the distribution channels currently distributing the game.

[0132] The order of thumbnail images displayed in the distribution list G15 can be different for each viewing user. As an example, the order is arranged in descending order of priority, such as the number of views by the viewing user who follows the images, the cumulative number of viewers, or the oldest distribution start date. The display range of the thumbnail images in this distribution list G15 can be changed by scrolling horizontally.

[0133] The games displayed on this game list screen are the top 10 titles with the following priorities: For example, the priorities are determined by the most recent date the viewing user last played within 48 hours of the game distribution start date and time within the last 30 days, the highest priority period ID, and the lowest priority period ID.

[0134] This distribution list G15 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.

[0135] 11 corresponds to the game details screen of the first screen. The first screen, which is the game details screen, is G20, which is the screen transitioned to by selecting the game icon G12 or game name G13 displayed on the game list screen shown in FIG.

[0136] The first screen includes a distribution preparation button T22 which is a distribution start object, a play start button G21 which is a play start object, and thumbnail images which indicate distribution channels for moving images.

[0137] The first screen also displays a game icon G22, a game name G23, the total number of viewers of the game's distribution channel G24, and a distribution list G25 including thumbnail images of distribution channels currently distributing the game.

[0138] The order of thumbnail images displayed in the distribution list G25 can be different for each viewing user. For example, the order is arranged in descending order of priority, such as the number of views by the viewing user who follows the images, the number of cumulative viewers, or the oldest distribution start date. The display range of the thumbnail images in this distribution list G25 can be changed by vertical scrolling.

[0139] This distribution list G25 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.

[0140] As described above, a user who selects the distribution start object (distribution preparation button T22) or the play start object (play start button G11, G21) becomes the first user who makes a distribution start request or a play start request.

[0141] Furthermore, the user who selects the thumbnail image becomes the second user who views the second moving image.

[0142] The first screen also includes a first area where scrolling is not possible and a second area where scrolling is possible.

[0143] The first screen here refers to the first screen shown in Fig. 11. The first screen includes a first area R1 and a second area R2. Specifically, the first area R1 displays the game title, and the second area R2 displays the above-mentioned start play button G21, game icon G22, game name G23, viewer count G24, and distribution list G25.

[0144] The first area R1 is a fixed area on the display screen that cannot be scrolled, while the second area R2 is an area that can be scrolled by the user. By scrolling the second area R2, the user can view thumbnail images that are hidden off-screen.

[0145] However, since there is a risk that the play start button G21 will be hidden off the screen when the second area is scrolled, the display processing unit in the present disclosure can display the play start object (play start button G21) in the first area R1 depending on the display state of the play start object (play start button G21) displayed in the second area R2.

[0146] As an example, the play start button G21 is displayed in the second area R2 in Fig. 11, but is displayed in the first area R1 in Fig. 12. In other words, when part or all of the play start button G21 is no longer displayed in the second area R2, the play start button G21 appears in the first area.

[0147] The game display processing unit may also display the play start object in the first area R1 in stages according to the display state of the play start object displayed in the second area R2.

[0148] Such an expression can be realized by changing the transparency of the play start object in accordance with the amount of scrolling of the second region R2.

[0149] As an example, the scroll amount (unit: pixels) 0 to 50 corresponds to the button transparency from 0.0 (completely transparent) to 1.0 (completely opaque). In this case, the object is completely transparent in the initial display state and is therefore invisible, but when scrolled 50 pixels or more, the object becomes completely visible. It is preferable to change the object's transparency linearly in this range (0 to 50). Note that the unit of the scroll amount is logical pixels, which may differ from the actual pixels on the display.

[0150] Furthermore, the game request receiving unit is capable of receiving a request to end play of a predetermined game from the first user terminal 100 after the game video distribution unit has distributed information about the second video.

[0151] A request to end play can be sent by selecting the end button located on the game screen.

[0152] Then, when the game request receiving unit receives a request to end play of a predetermined game, the distribution starting unit can end the distribution of information about the second moving image and distribute information about the first moving image.

[0153] In other words, what is distributed here is not just a portion of the information about the first moving image, but the entire information about the first moving image.

[0154] Then, when the distribution starting unit finishes distributing information about the second moving image and distributes information about the first moving image, it is assumed that the first moving image is displayed on the second user terminal 200.

[0155] Next, the flow for starting to watch a video will be explained.

[0156] The one or more computer processors in the present disclosure may further include a viewing acceptance unit.

[0157] The viewing acceptance unit accepts a request to view a video from a user.

[0158] In response to a viewing request, the distribution starting unit distributes information relating to video and audio as moving image information to the information processing terminal of the user.

[0159] FIG. 13 shows an example of a viewing screen V10 of an avatar video displayed on the second user terminal 200.

[0160] A viewing user can post a comment by entering text in a comment input field V11 and pressing a send button V12.

[0161] Furthermore, by pressing the gift button V13, a list of gifts (screen V30 in FIG. 14) is displayed to the viewing user, and a display request for a specified gift can be sent by selection.

[0162] In this case, one or more computer processors in the present disclosure may include a determination unit that determines whether or not a gift display request has been made from the second user terminal 200.

[0163] The display request may include gift object information, which includes at least gift object identification information that identifies the type of the gift object and location information that indicates the location where the gift object is to be displayed.

[0164] As shown in FIG. 15, gifts can be displayed by classification (free (paid) gifts, accessories, support goods, appeals, variety, etc.).

[0165] Here, a paid gift is a gift (coin gift) that can be purchased by consuming coins purchased by the viewing user, and a free gift is a gift (point gift) that can be obtained by consuming points obtained for free or without consuming them.

[0166] It should be noted that the term "gift" used in this application has the same concept as the term "token." Therefore, the technology described in this application can be understood by replacing the term "gift" with the term "token."

[0167] Furthermore, the viewing user can post a favorable evaluation by pressing the like button V14. Note that in addition to / instead of the like button V14, it is also possible to display a button for posting a negative evaluation or other emotions.

[0168] Note that an object may be displayed on the video in response to such a rating post. For example, when a positive rating is posted, an object such as a heart mark or a thumbs-up mark may be displayed.

[0169] In addition, if the first user has set the permission for other users to appear in the video in the distribution settings, the first user can send a request to appear in the video by selecting the collaboration request button V15.

[0170] Additionally, a follow button V16 is displayed on the screen of a video distributed by a first user who is not yet followed by a second user, allowing the second user to follow the distributor. This follow button functions as an unfollow button on the screen of a video distributed by a first user who is already being followed by the second user.

[0171] This "following" may be from a second user to another second user, from a first user to a second user, or from a first user to another first user. However, following is managed as a one-way association, and associations in the reverse direction are managed separately as followers.

[0172] A photo button V25 for saving a still image of the screen may also be displayed.

[0173] Additionally, the viewing screen V10 also displays a support ranking display button V17, a share button V18, and a ranking display button V19.

[0174] The support ranking displays the ranking of second users who are supporting the first user, and the ranking can be calculated according to the amount of the gift (points / coins), etc.

[0175] Regarding sharing the video, the second user can press the share button V18 to check the list of SNS (social networking services) on which the video can be shared, and by selecting it, send a fixed link to a specified location on the specified SNS.

[0176] In addition, by pressing the collaboration request button V15, a collaboration broadcast can be requested from the first user. Collaborative broadcasting refers to having a character object of the second user appear in the video broadcast by the first user.

[0177] At the top of the viewing screen V10, a broadcasting user icon V21, a broadcasting user name (character object name) V22, a cumulative viewer count display V23, and a cumulative like count display V24 can be displayed.

[0178] Furthermore, when the viewing end button V20 is selected, a screen for ending viewing appears, allowing a viewing end request to be sent.

[0179] The screen for ending such viewing will be explained in detail below. This screen is called "small window audio distribution" and is used for viewing in a mode where only the audio is played back without displaying the video image.

[0180] Selection of the above-mentioned viewing end button V20 is accepted by the viewing acceptance unit as a request to end viewing of the video.

[0181] At this time, the distribution starting unit ends the distribution of information relating to the video in response to the viewing end request, but does not end the distribution of information relating to the audio.

[0182] When information about video and audio is distributed to the user terminal, the video is displayed on the main screen of the user terminal, and when information about audio only is distributed, the video is not displayed on the user terminal but a sub-screen indicating that a video is being viewed is displayed.

[0183] FIG. 15 shows an image of the screen V50 on which the sub-screen V51 is displayed.

[0184] When this sub-screen V51 is displayed, the main screen displayed in the background transitions to the screen before watching the video. For example, if you move from the recommendation tab to the viewing frame, it will return to the recommendation tab display, and if you move from the follow tab to the viewing frame, it will transition to the follow tab.

[0185] When this sub-screen V51 is displayed, operations on the main screen are possible, and transitions to other screens are possible.

[0186] The sub-screen V51 displays a profile picture, name, title, and an audio icon that visually indicates that audio is being played.

[0187] Then, by selecting the end icon V52 displayed on the sub-screen V51, the viewing can be completely ended.

[0188] Regarding the termination of the video display, the server device may transmit information but not display it on the terminal side, or the server device may stop transmitting information altogether.

[0189] With this configuration, it becomes possible to search for other broadcasts and enjoy chatting with other users while listening to only the audio.

[0190] Next, we will explain "collaboration," in which another user appears in a video of a first user.

[0191] As described above, the second user can transmit a request to participate in the video via the collaboration distribution participation request confirmation screen that is displayed by pressing the collaboration request button V15 shown in FIG.

[0192] In accordance with the received participation request, the collaboration avatar display unit included in one or more computer processors in the present disclosure displays, in a video, a character object generated based on the movement of the viewing user who has made the participation request.

[0193] 16 shows an example of a viewing or distribution screen in which a second avatar CO4, a character object of a guest user, is participating in a video in which a first avatar CO3, a character object of a host user, is displayed. Note that in FIG. 15, the display of objects other than the avatars is omitted.

[0194] Furthermore, as shown in Fig. 17, a third avatar CO1, which is a character object generated based on the movements of another viewing user, may also participate in the video. Note that in Fig. 17, the third avatar CO1 is placed behind the avatar A2 of the first avatars CO3 and CO4, but the three may also be placed in a horizontal line. The placement position of the avatar may also be specified by the distribution user.

[0195] Fig. 18 shows a list screen T30 of users who have mutual follow relationships, which is displayed by selecting the follow tab T14 on the top screen shown in Fig. 5. Mutual follow refers to a relationship in which two users follow each other.

[0196] This list screen T30 displays the profile images and names of users with whom a user has a mutual follow relationship.

[0197] 18, the list screen T30 displays a first object T31 for each user who has a mutual follow relationship. A chat object T32 may also be displayed together with the first object T31. By selecting this chat object, the user can transition to an individual chat screen with the second user.

[0198] The first object T31 transmits a predetermined notification to the terminal of the user associated with the first object T31.

[0199] The predetermined notification may be, for example, a call notification.

[0200] Next, a detailed description will be given of a flow for performing a video chat according to an embodiment of the present disclosure.

[0201] As an example, users can conduct video chats from individual chat screens or group chat screens.

[0202] These chat screens can be transitioned to from the chat list screen C10 (FIG. 19) that is expanded by selecting the message button T21 on the top screen T10 (FIG. 5), for example.

[0203] 19, icons of users (character objects) or groups who have sent and / or received messages (chats) in the past are displayed together with their names or titles. Note that the group icons may include icons of users (character objects) who will join the group.

[0204] The user can then select a user or group on the chat list screen C10, open the personal chat screen C20 (FIG. 20) or the group chat screen, and start a video chat by selecting the video chat button C21.

[0205] In addition, by selecting the chat creation button C12 or group creation button C13 (Figure 21), which are displayed by selecting the edit button C11 on the chat list screen C10, it is possible to create a chat screen for a user or group that is not displayed on the chat list screen C10.

[0206] 22 shows the user selection screen C30 that appears when the chat creation button C12 is selected, and displays / generates a chat screen with the displayed recommended users or users searched for using the search field C31. The configuration of the generated chat screen is the same as the chat screen C20 shown in FIG. 20, and a video chat can be started by selecting the video chat button C21.

[0207] Similarly, Figure 23 shows the group creation screen C40 that opens when the group creation button C13 is selected. The user can add other users as group members by selecting the user addition button C41. As an example, the number of group members that can be added is up to seven. The group name can also be set on this screen.

[0208] Once a group is created, a group chat screen C50 is displayed (FIG. 24). On the group chat screen C50, a video chat can also be started by selecting the video chat button C51.

[0209] The chat screen C20 can also be transitioned to from the chat object T32 on the follow list screen T30 (FIG. 18).

[0210] Chat icons can also be placed on other users' profile pages, allowing users to transition from various pages to the chat screen and start a video chat.

[0211] When a video chat is started, a notification is sent to the other party, who can join the video chat by responding to the notification. Users can set whether or not to receive such notifications.

[0212] Alternatively, a configuration may be adopted in which only video chats can be conducted with users in a mutual follow relationship. In this case, an icon indicating that a user in a mutual follow relationship is currently video chatting with another user may be displayed on the follow list screen, and a user may be able to participate in the ongoing video chat by selecting the icon.

[0213] The video chat in the present disclosure can be said to be a function that allows only specific users to view the above-mentioned collaborative distribution. The specific users here refer to users who are participating in the video chat.

[0214] Next, an image of the expansion of the virtual space in this disclosure will be described with reference to FIG.

[0215] As shown as an example in Figure 25, the virtual space in this embodiment is arranged with a disk-shaped island (world) floating in the air. This island is an object that resembles an upside-down tower-shaped cake, and various objects can be arranged on the disk-shaped ground. Note that this island and ground are shown as examples, and their display modes are not particularly limited.

[0216] The objects that can be displayed include at least the first user's character object CO, a gift object G1 corresponding to a gift requested for display by the second user, and an object S1 whose display position and display timing are controlled by the server device 400 (system side).

[0217] A user can operate a character object to move, jump, and so on within the world, and such a function can be provided as one of the games described above, for example. In this disclosure, this is specifically referred to as "world distribution," and the above-described game distribution start and end procedures apply.

[0218] Specifically, switching from normal streaming (avatar streaming) to world streaming can be done by selecting the play button D33 (Figure 8) of the game displayed in the avatar streaming video, or by selecting the play button G11, G21 (Figures 10, 11) of one of the games selected from the list of games displayed on the screen to which you are transitioned by selecting the play button D33.

[0219] Additionally, switching from world streaming to avatar streaming can be done by selecting the end play button displayed on the world streaming video.

[0220] Next, various functions that can be executed in the information processing system 3000 according to the embodiment of the present disclosure will be described with reference to the drawings.

[0221] An information processing system 3000 according to an embodiment of the present disclosure is, for example, an information processing system that provides a virtual space in which a user's character object can be displayed.

[0222] Such a virtual space is not particularly limited in its form as long as it is capable of displaying the user's character object.

[0223] The information processing system 3000 according to the embodiment of the present disclosure includes a first user terminal 100 (first information processing device 100) of a first user and a server device 400.

[0224] The one or more computer processors included in the information processing system 3000 include a display control unit 410, an object display unit 420, an information column display unit 430, a reception unit 440, and a determination unit 450, as shown as an example in FIG.

[0225] The display control unit 410 controls the display of a video showing a predetermined virtual space and a first character object of the first user that can move within the predetermined virtual space on the first display screen of the first information processing device 100 of the first user.

[0226] The display control unit 410 can be included in one or more computer processors included in the server device 400 or the first information processing device 100.

[0227] Here, the virtual space in which the first character object is movable may be a first virtual space associated with the first user.

[0228] This first virtual space is a space in which objects such as furniture and ornaments (hereinafter referred to as "furniture objects") can be placed, and can be a virtual space that imitates indoor spaces (for example, rooms, houses, shops, facilities, etc.) or outdoor spaces (for example, gardens, cities, the sky, underwater, and space, etc.).

[0229] The furniture objects are not particularly limited in shape or function, as long as they can be placed in the first virtual space by the first user's selection or by the system (operator), but can be objects that resemble, for example, shelves, desks, tables, chairs, sofas, beds, wallpaper, background screens, flooring, rugs, windows, plants, posters, clocks, musical instruments, food and drink, electrical appliances, clothing, vehicles, etc.

[0230] The first user can obtain these furniture objects as prizes in a lottery, purchases from a shop, transfers from other users, and as rewards for fulfilling certain conditions related to the video.

[0231] In this specification, the first virtual space is referred to as a "room."

[0232] When the first user selects "room" as the distribution location on the distribution location setting screen D29 shown in Figure 9 (when the room distribution object D28 is selected), the first character object CO is displayed movably in the first virtual space as shown in Figure 27, and video distribution begins.

[0233] In this specification, the distribution of video in the first virtual space is referred to as "room distribution."

[0234] On the other hand, the first user is also associated with a second virtual space as a virtual space in which the first character object cannot move.

[0235] This second virtual space can be a space in which only furniture objects such as wallpaper and floor paper can be placed (selected), or a space made up of objects such as wallpaper and floor paper.

[0236] In this specification, the second virtual space is referred to as a "booth."

[0237] When the first user selects "booth" as the distribution location on the distribution location setting screen D29 shown in Figure 9 (when the booth distribution object D27 is selected), the first character object is displayed immovably in the second virtual space as shown in Figure 28, and video distribution begins.

[0238] In this specification, the distribution of video in the second virtual space is referred to as "booth distribution."

[0239] The first virtual space and the second virtual space may be separate virtual spaces, or the second virtual space may be provided as part of the first virtual space.

[0240] FIG. 29 shows an example in which a background screen and floor paper (rug) objects are placed in the first virtual space to form a second virtual space.

[0241] By placing the first character object CO in front of and / or above these objects and adjusting the angle of view of the virtual camera, it is possible to shoot a video in which the first character object CO is performing a "booth broadcast" even during a "room broadcast."

[0242] Also, when the first user selects the room button D12 on the avatar setting screen D10 shown in FIG. 6, the first character object CO is displayed movable in the first virtual space as shown in FIG. 27, but no video is distributed.

[0243] In this way, the first virtual space in which the first character object CO is displayed is assumed to have a non-distribution state and a distribution state.

[0244] The first user may be able to rearrange (rearrange) the furniture objects in the first virtual space in any state.

[0245] While the room broadcast and booth broadcast are being performed, the first display screen displays a video and various pieces of information superimposed on the video.

[0246] As examples of information that may be displayed on the first display screen D50 while room streaming and booth streaming are being performed, Figures 27 and 28 show a comment input button D51, an audio switching button D52, a photo button D53, a switching button (switching object) D54, and a menu button D55.

[0247] Similarly, as examples of information displayed on the first display screen D50 while room streaming and booth streaming are taking place, Figures 27 and 28 show the profile icon D56, name D57, cumulative viewer count display D58, and cumulative like count display D59 of the first character object.

[0248] The comment input button D51, audio switch button D52, and photo button D53 correspond to the comment input button D31, audio switch button D42, and photo button D32 shown in Figure 8, which is an example of the first display screen during booth distribution, and provide similar functions.

[0249] Furthermore, when the user selects the menu button D55 on the screen in Fig. 27 during room distribution, a menu screen D60 such as that shown in Fig. 30 is displayed. On the menu screen D60, for example, an event button D61, a gacha button D62, a coordinate button D63, a rearrange button D64, a world button D65, a booth switch button D66, a distribution board button D67, a share button D68, and a settings button D69 are displayed.

[0250] The event button D61 is a button for displaying a screen that displays various events.

[0251] The gacha button D62 is a button for displaying a lottery screen for obtaining avatar parts and furniture objects.

[0252] The outfit button D63 is a button for displaying a closet screen.

[0253] The rearrange button D64 is a button for displaying a screen that allows rearrangement of the first virtual space.

[0254] The world button D65 is a button for moving the first character object to various virtual spaces (worlds) different from the first virtual space and the second virtual space, or for displaying a screen (such as Figure 10-12) for the user to play the game.

[0255] The booth switching button D66 is a button for switching from room distribution to booth distribution.

[0256] The distribution board button D67 is a button for displaying an information display board called a distribution board on the video.

[0257] The share button D68 is a button for sharing the video on social media or the like.

[0258] The setting button D69 is a button for making the above-mentioned distribution settings (FIG. 7, etc.).

[0259] Furthermore, when the user selects the menu button D55 on the booth broadcast screen in Fig. 28, a room switching button is displayed instead of the booth switching button D66 shown in Fig. 30. This room switching button is a button for switching from booth broadcast to room broadcast.

[0260] Here, the movement of the first character object in the first virtual space is performed in response to an operation by the first user.

[0261] Furthermore, the facial and head movements of at least the first character object may reflect the movements of the first user, for example, when the first user tilts their head, the first character object's head is displayed to tilt in the same manner, and when the first user winks, the first character object is displayed to wink in the same manner.

[0262] Furthermore, the movement of the entire body of the first character object, including the face and head, may be performed in response to a command selected by the first user.

[0263] Commands include, for example, commands that apply predetermined facial expressions, poses, and movements (these predetermined facial expressions, poses, and movements are called "emotes") to the first character object, and commands that apply movements (such as sitting in a chair, lying down on a bed, holding a cup, etc.) that cause the first character object to be displayed in association with furniture objects.

[0264] The commands may be displayed as selectable upon user request or when the commands are available for input.

[0265] Furthermore, the movement of the entire body of the first character object, including the face and head, may be performed automatically, without depending on the first user's movement and command selection operation.

[0266] The object display section 420 is capable of displaying an operation object for receiving an operation on the first display screen by the first user, superimposed on the video.

[0267] The object display unit 420 can be included in one or more computer processors included in the first user terminal 100.

[0268] FIG. 31 shows an example in which a control object 71 is displayed on the first display screen D50 during room distribution shown in FIG.

[0269] As an example, as shown in FIG. 31, the first control object 71 can be configured to include a first control object 71A and / or a second control object 71B.

[0270] The first control object 71A is for accepting movement operations to make the first character object walk or run horizontally in the virtual space, and the second control object 71B is for accepting movement operations to make the first character object jump vertically in the virtual space.

[0271] Assuming that the user holds the first information processing device 100 with both hands, the first operation object 71A can be arranged within a predetermined range from the lower left corner of the first display screen, and the second operation object 71B can be displayed within a predetermined range from the lower right corner of the first display screen. For example, the first operation object 71A can be arranged at a position on the first display screen that can be touched with the thumb of the left hand, and the second operation object 71B can be displayed at a position on the first display screen that can be touched with the thumb of the right hand, but this is not limiting.

[0272] As an example, as shown in FIG. 31, a first operation object 71 can be displayed at the bottom of the first display screen, superimposed on a moving image.

[0273] The operation object 71 may be any object that accepts an operation on the first display screen by the first user, and is not limited to the configuration that accepts the above-described movement operation.

[0274] As an example, the operation performed by the first user on the first display screen may be an emote selection operation for changing the facial expression and / or movement of the first character object, or an operation for rearranging the room.

[0275] The information column display unit 430 is capable of displaying an information column for displaying information relating to reactions to the video by the first user and / or a second user different from the first user, superimposed on the video.

[0276] A reaction to a video can be, for example, a comment posted by the first user and / or the second user on the video, and / or a gift or a positive rating (like) posted by the second user, etc. The second user is not particularly limited as long as it is a user different from the first user, but can be, for example, a user watching the video.

[0277] The information about the comment posting is, for example, the content of the comment posted on the video.

[0278] The information about the posting of a gift or a favorable review is, for example, a notification informing the user that a gift or a favorable review has been posted. This information is included in the system comment automatically sent by the management (system), and the system comment also includes information such as the first user starting a broadcast (entering a room) and the broadcast time having passed a predetermined time.

[0279] As an example, as shown in FIG. 31, an information column 72 can be displayed at the top of the first display screen, superimposed on the moving image.

[0280] The receiving unit 440 receives a predetermined operation and / or voice from the first user.

[0281] The specified operation by the first user is not particularly limited as long as it is an operation by the first user, but it is intended to include not only operations on the operation object 71 described above, but also operations on other buttons and objects displayed on the first display screen.

[0282] The voice of the first user may be the user's spoken voice acquired by a voice acquisition unit of the first information processing device 100. Acquisition of such voice can be switched ON / OFF by selecting the above-mentioned voice switching button D52.

[0283] The determination unit 450 determines whether a first condition regarding the first user and / or the first character object is satisfied.

[0284] For example, the first condition may be a condition related to an operation by the first user and / or a movement of the first character object.

[0285] More specifically, the first condition may be a condition regarding an operation by the first user and / or an action of the first character object that suggests that communication between the first user and the second user will be initiated.

[0286] For example, the first condition may be that the first user has not performed a movement operation on the first character object.

[0287] Alternatively, the first condition may be that a selection operation on the switching object D54 displayed on the first display screen has been received.

[0288] Alternatively, the first condition may be that the voice received by the receiving unit 440 contains a specific word.

[0289] Alternatively, the first condition may be that the relationship between the first character object and a specific object placed in the virtual space is a specific relationship, or that the specific object is selected by the first user.

[0290] Specific examples of these first conditions will be described in detail later.

[0291] The invention in the present disclosure is characterized in that, when the determination unit 450 determines that the first condition is satisfied, the object display unit 420 changes the display mode of the operation object from the first display mode to the second display mode, and the information column display unit 430 changes the display mode of the information column from the third display mode to the fourth display mode.

[0292] As an example, the display mode of the operation object 71 and the information column 72 shown in FIG. 31 changes to the display mode shown in FIG.

[0293] It should be noted that a change in the content of the information displayed in the information column 72 is not included in the change in the display mode.

[0294] When a user performs room broadcasting, they tend to broadcast with a stationary character object rather than broadcasting while moving the character object. As an example of a UI layout that matches the broadcasting style, the display style shown in Fig. 31 is a UI layout that prioritizes the first user operating the first character object, and the display style shown in Fig. 32 is a UI layout that prioritizes the first user communicating with the second user.

[0295] The area in Figure 31 where the operation object 71 is displayed, i.e., the area in Figure 32 where the information column 72 is displayed (the lower area of ​​the first display screen), can be called a specific information display area where information regarding actions that the first user should perform as a priority is displayed.

[0296] The first, second, third and fourth display modes will be described in detail later.

[0297] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0298] Specifically, with the above configuration, it is possible to improve the visibility of information displayed on the first display screen.

[0299] More specifically, according to the above configuration, the information displayed in the specific information display area is changed before and after the first condition is met, thereby enabling the visibility of the information that the first user needs to check to be improved with priority.

[0300] For example, by displaying comments in the specific information display area, the visibility of the comments is improved, and it is possible to prevent comments from being overlooked.

[0301] Furthermore, for example, by displaying the operation object in the specific information display area, the visibility of the operation object is improved, and erroneous operations can be prevented.

[0302] Next, a specific example of the first condition will be described in detail.

[0303] When a first condition relating to a first user and / or a first character object is satisfied, it may be, for example, when it is suggested that communication between the first user and a second user is to be initiated.

[0304] As an example, the first condition may be that the relationship between the specific object and the first character object is a specific relationship.

[0305] Alternatively, the first condition may be that a particular object is selected by the first user.

[0306] The specific object may be a part of the furniture object described above, or may be a separate object, but is an object that is managed so as to be distinguishable from normal furniture objects.

[0307] Furthermore, the specific object may be a first object used when a first user communicates with a second user.

[0308] The object used when a first user communicates with a second user may be, for example, an object that keeps the first character object stationary so that the first user can communicate with the second user.

[0309] As an example, the first object may be an object that resembles furniture that may be placed in a distribution studio, such as a background screen, floor paper, a microphone, a gaming chair, or a volume meter.

[0310] Furthermore, as an example, the first object can be displayed in association with the first character object, or as a background or rug for the first character object.

[0311] For example, the first object can be an object such as a chair or sofa on which the first character object sits.

[0312] Alternatively, the first object may be an object such as a microphone or a headset that represents the first character object speaking.

[0313] These are examples of what is displayed in association with the first character object.

[0314] Alternatively, the first object may be an object used as a background for the first character object, such as a background screen or poster.

[0315] Alternatively, the first object may be an object used as floor covering under the feet of the first character object, such as a rug.

[0316] These are examples of what may be displayed as a background or rug for the first character object.

[0317] As described above, specific objects are managed so as to be distinguishable from normal furniture objects, so that, for example, there may be a specific object such as a chair for delivery and a normal furniture object such as a chair for normal use. These specific objects and normal furniture objects may be displayed in the first virtual space in a manner that allows the first user to distinguish them.

[0318] In this way, by setting the first condition as suggesting the start of communication between the first user and the second user, it becomes possible to appropriately determine the information for which visibility should be prioritized.

[0319] The specific relationship may be an association between the first character object and the specific object, or a distance between the placement position of the first character object and the placement position of the specific object in the virtual space that is less than a predetermined value.

[0320] The placement position of the first character object and the placement position of the specific object may be specified by coordinates defined in the virtual space.

[0321] For example, the determination unit 450 can determine that a specific relationship is established and the first condition is satisfied when the first character object sits on (is associated with) the sofa, or when the first character object approaches the background screen (when the distance becomes less than a predetermined value).

[0322] In addition, the association between the first character object and a specific object can be performed when the first user selects the specific object, or when the first user selects an association button that is displayed near the specific object when the first character object approaches the specific object.

[0323] Furthermore, the specific object can be a second object for displaying the first object.

[0324] As an example, the second object may be an object that resembles a push button, but the shape thereof is not particularly limited.

[0325] For example, when the first user selects the second object or the first character object approaches the second button object, a background screen and a carpet object are made to appear in the first virtual space.

[0326] As described above, the space formed by the background screen and carpet objects in the first virtual space can also be defined as the second virtual space described above.

[0327] According to the above configuration, the first object can be displayed in the first virtual space only when necessary, thereby further improving the visibility of information displayed on the first display screen.

[0328] Furthermore, the first condition may be that the accepting unit 440 has accepted an operation by the first user on a switching object displayed on the first display screen.

[0329] For example, when the reception unit 440 receives an operation by the first user on the switching object D54 displayed on the first display screen on which the operation object 71 is displayed in the first display mode, as shown in FIG. 31, the display screen is switched to one on which the information column 72 is displayed in the fourth display mode, as shown in FIG. 32.

[0330] Furthermore, when the reception unit receives an operation by the first user on the switching object D54 displayed on the first display screen in which the information column 72 is displayed in the fourth display mode as shown in FIG. 32, the display screen switches to one in which the operation object 71 is displayed in the first display mode and the information column 72 is displayed in the third display mode as shown in FIG. 31.

[0331] According to the above configuration, the first condition can be satisfied by a direct operation of selecting the first user's switching object.

[0332] The first condition may be that the voice received by the receiving unit 440 satisfies a predetermined condition.

[0333] The received voice satisfies a predetermined condition when, for example, the volume of the received voice exceeds a predetermined value or when the received voice contains a specific word.

[0334] The predetermined value is, for example, 0 dB.

[0335] In addition, the voice received by the reception unit 440 is based on the user's spoken voice acquired by the voice acquisition unit of the first information processing device 100, and the voice analysis unit provided in the first information processing device 100 can analyze whether the spoken voice contains specific words.

[0336] The specific word may be, for example, a word related to greetings such as "hello" or "good evening."

[0337] According to the above configuration, the first condition can be satisfied by the first user speaking, which is a simple and natural action that suggests communication with the second user.

[0338] Furthermore, the first condition can be that the receiving unit 440 does not receive a movement operation of the first character object for a predetermined period of time.

[0339] The first condition may be that a touch operation on a touch panel serving as the first display screen is not detected.

[0340] According to the above configuration, the first condition can be satisfied by the first user not moving the first character object, a natural action that suggests communication with the second user.

[0341] The first condition may be that the second user has reacted to the video.

[0342] As an example, this reaction to the video by the second user may be the first reaction since the first user started distributing the video.

[0343] Alternatively, the second user's reaction to the video may be the first reaction after the operation object 71 is displayed in the first display mode.

[0344] The reaction to the video by the second user is accepted by the second information processing device of the second user, and is notified to or displayed on the first information processing device 100 via the server device 400.

[0345] Information about the second user's reaction to the video is displayed in the information column 72.

[0346] According to the above configuration, the first condition is determined to be satisfied at the time when the information column 72 is updated to display information regarding the second user's reaction to the video, i.e., at the time when the first user should start communicating with the second user.

[0347] For example, when there is no reaction from the second user (viewing user) after the start of distribution, or when the second user is not present, the first user can perform a movement operation on the first character object or a room rearrangement operation, and when the second user begins watching and makes a reaction, the first user can start talking.

[0348] The display control unit 410 can further control the display of the video on the second display screen of the second information processing device of the second user.

[0349] As described above, the first virtual space has a non-distribution state and a distribution state, but the state in which the display control unit 410 controls the display of the video on the second display screen of the second information processing device of the second user means that the first virtual space is in a "distribution state."

[0350] Furthermore, in a state where the display control unit 410 is not controlling the display of the video on the second display screen of the second information processing device of the second user, i.e., when the first virtual space is in a "non-distribution state," if the judgment unit 450 judges that the first condition is satisfied, the display control unit 410 can further control the video so that it can be displayed on the second display screen of the second information processing device of the second user.

[0351] According to the above configuration, satisfaction of the first condition can be used as a trigger for automatically switching the first virtual space from the "non-distribution state" to the "distribution state."

[0352] Furthermore, in a state where the display control unit 410 is not controlling the display of the video on the second display screen of the second information processing device of the second user, i.e., when the first virtual space is in a "non-distribution state," if the display control unit 410 further controls the video to be displayable on the second display screen of the second information processing device of the second user in accordance with an instruction from the first user, the judgment unit 450 can judge that the first condition is satisfied.

[0353] The instruction by the first user can be given by selecting a distribution start button that can be displayed on the first display screen.

[0354] According to the above configuration, the first condition can be satisfied by switching the first virtual space from a "non-broadcast state" to a "broadcast state," a natural action that suggests communication with the second user.

[0355] If the determination unit 450 determines that the first condition is satisfied, the video may further display a start object indicating that communication by the first user with the second user has begun.

[0356] FIG. 33 shows an example in which an object resembling an on-air sign lamp is displayed as the starting object 73 in a moving image.

[0357] The start object 73 may be displayed superimposed on the moving image rather than being displayed in the moving image. In this case, the start object 73 may be displayed only on the first display screen, or may be displayed on both the first and second display screens.

[0358] According to the above configuration, the first user, or both the first user and the second user, can see that the first user and the second user are in a state where they can communicate, which leads to more active communication.

[0359] The one or more computer processors of the present disclosure may further include a virtual camera control unit 460, as shown in FIG.

[0360] The virtual camera control unit 460 controls the operation of a virtual camera that can be operated by the first user.

[0361] If the determination unit 450 determines that the first condition is satisfied, the virtual camera control unit 460 can change the operation of the virtual camera from the first operation mode to the second operation mode.

[0362] Here, the first operation mode can be an operation mode based on an operation by the first user, and the second operation mode can be an operation mode not based on an operation by the first user.

[0363] According to the first operation mode, the virtual camera operates based on an operation by the first user.

[0364] The first user can change the angle or zoom in / out of the virtual camera by performing a swipe operation or a pinch in / out operation in an area on the first display screen where the operation object 71 is not displayed.

[0365] On the other hand, according to the second operation mode, the virtual camera operates without being based on the operation of the first user, that is, automatically.

[0366] For example, the second operation mode is a mode in which the face of the first character object is photographed from the front. In this case, only the zoom-in / zoom-out operation on the virtual camera may be based on the operation of the first user.

[0367] According to the above configuration, satisfaction of the first condition serves as a trigger to automatically switch the virtual camera to a mode suitable for communication between the first user and the second user.

[0368] It should be noted that if the determination unit 450 determines that the first condition is no longer satisfied, the virtual camera control unit 460 can change the operation of the virtual camera from the second operation mode to the first operation mode.

[0369] Furthermore, virtual camera control unit 460 can once change the operation of the virtual camera from the first operation mode to the second operation mode, and then change it back to the first operation mode after a predetermined time has elapsed.

[0370] The determination unit 450 can further determine whether a second condition is met.

[0371] For example, the second condition may be a condition related to an operation by the first user and / or a movement of the first character object.

[0372] More specifically, the second condition may be a condition related to an operation by the first user and / or a movement of the first character object that suggests that the first user wants to move the first character object.

[0373] Then, if the judgment unit 450 judges that the second condition is satisfied, the object display unit 420 changes the display mode of the operation object 71 from the second display mode to the first display mode, and the information column display unit 430 changes the display mode of the information column 72 from the fourth display mode to the third display mode.

[0374] The second condition can be that the receiving unit 440 has received a pinch-in operation on the first display screen by the first user.

[0375] A pinch-in operation on the first display screen is a zoom-out operation on the virtual camera. Such a zoom-out operation is determined to satisfy the second condition, which indicates that the first user intends to move the first character object.

[0376] Alternatively, the second condition may be that the voice received by the receiving unit 440 satisfies a predetermined condition.

[0377] The received voice satisfies a predetermined condition when, for example, the volume of the received voice is equal to or less than a predetermined value, or when the received voice contains a specific word.

[0378] The predetermined value is, for example, 0 dB.

[0379] In addition, the voice received by the reception unit 440 is based on the user's spoken voice acquired by the voice acquisition unit of the first information processing device 100, and the voice analysis unit provided in the first information processing device 100 can analyze whether the spoken voice contains specific words.

[0380] The specific words are, for example, words related to parting greetings such as "goodbye" and "see you later," or words related to the room such as "redecorate" and "move."

[0381] Next, an example in which the above configuration is applied to collaborative distribution will be described.

[0382] In this embodiment, the video may further display a third character object of a third user that is movable within the virtual space.

[0383] As an example, the third user is a collaborating user who is participating in the video of the first user.

[0384] At this time, the display control unit 410 further controls the display of the video on the third display screen of the third information processing device of the third user.

[0385] Then, the determination unit 450 further determines whether a third condition regarding the third user and / or the third character object is satisfied.

[0386] The third condition can be rephrased as a first condition relating to a third user and / or a third character object.

[0387] For example, the third condition may be a condition related to an operation by a third user and / or an action of a third character object.

[0388] More specifically, the third condition may be a condition regarding an operation by the third user and / or an action of the third character object that suggests that communication between the third user and the first or second user will be initiated.

[0389] For example, the third condition may be that the third user has not performed a movement operation on the third character object.

[0390] Alternatively, the third condition may be that a selection operation on the switching object D54 displayed on the third display screen has been accepted.

[0391] Alternatively, the third condition may be that the voice received by the receiving unit 440 included in the third information processing device contains a specific word.

[0392] Alternatively, the third condition may be that the relationship between the third character object and a specific object placed in the virtual space is a specific relationship, or that the specific object is selected by the third user.

[0393] The virtual space is a space associated with each user, and can be a first virtual space in which at least furniture objects can be placed by user operations.

[0394] The details of the first virtual space are as described above.

[0395] Furthermore, one or more computer processors in the present disclosure may further include a selection receiving unit 470, as shown in FIG.

[0396] The selection receiving unit 470 receives a selection by the first user of either the first virtual space or a second virtual space that is a virtual space different from the first virtual space and in which furniture objects cannot be placed.

[0397] For example, the selection receiving unit 470 is deemed to have received a selection for the first virtual space when the user selects "room" as the distribution location on the distribution location setting screen D29 shown in FIG. 9 (when the room distribution object D28 is selected), or when the user selects the room button D12 on the avatar setting screen D10 shown in FIG. 6.

[0398] When the selection receiving unit 470 receives the selection of the first virtual space, the display control unit 410 displays the first virtual space and a first character object that can move within the first virtual space in the video, and the object display unit 420 displays the operation object on the display screen, superimposed on the video.

[0399] Alternatively, the selection receiving unit 470 is deemed to have received a selection for the second virtual space when the user selects "booth" as the distribution location on the distribution location setting screen D29 shown in FIG. 9 (when the user selects the booth distribution object D27).

[0400] When the selection receiving unit 470 receives the selection of the second virtual space, the display control unit 410 displays the second virtual space and the first character object in the video so that it cannot move within the second virtual space, and the object display unit 420 can superimpose the operation object on the video so that it is not displayed on the display screen.

[0401] Here, the first, second, third and fourth display modes will be described in detail.

[0402] The first display mode of the operation object 71 is a mode in which the operation object 71 is displayed at the bottom of the first display screen, as shown as an example in FIG.

[0403] The lower part of the display screen refers to the part below the center in the vertical direction of the first display screen.

[0404] More specifically, the first display mode of the operation object can be a mode in which the operation object is displayed in a position that can be touched with the thumb when the user holds a vertically long information processing device vertically with both hands.

[0405] Also, as mentioned above, the area at the bottom of the first display screen can also be called a specific information display area where information related to the actions that the first user should prioritize (operating the first character object / checking comments) is displayed.

[0406] At this time, the third display mode of the information column 72 is a mode in which the information column 72 is not displayed, as shown as an example in FIG.

[0407] Alternatively, a third display mode of the information column is a mode in which the information column is displayed at the top of the first display screen, as shown as an example in FIG.

[0408] The upper part of the first display screen refers to the part above the center in the vertical direction of the first display screen.

[0409] The upper part of the first display screen is a suitable place for the first user to display the face of the first character object when communicating with the second user, but when the determination unit 450 has not determined that the first condition is met, it is highly likely that the first user is not communicating with the second user, so an information column 72 is displayed in this area.

[0410] When the information column hide button 74 of the information column 72 shown in Figure 31 is selected, the information column 72 is hidden as shown in Figure 35, and when the information column display button 75 is selected in Figure 35, the information column 72 is displayed at the top of the screen as shown in Figure 31.

[0411] In this way, the two third display modes described above can be switched by an operation by the first user.

[0412] The second display mode of the control object 71 is a mode in which the control object 71 is not displayed, as shown in FIG. 32 as an example.

[0413] At this time, the fourth display mode of the information column 72 is a mode in which the information column 72 is displayed at the bottom of the first display screen, as shown as an example in FIG.

[0414] The lower part of the first display screen refers to the part below the center of the display screen in the vertical direction.

[0415] When the determination unit 450 determines that the first condition is satisfied, the face of the first character object is often displayed at the top of the first display screen, and therefore the information column 72 is displayed at the bottom of the first display screen.

[0416] Fig. 32 shows an example of a display screen when it is determined that the first condition is satisfied by determination unit 450. In Fig. 32, the operation object is not displayed, and information column 72 is displayed at the bottom of the first display screen.

[0417] In this way, in place of the operation object 71 that was displayed at the bottom of the first display screen, the information column 72 is displayed at the bottom of the first display screen.

[0418] In addition, the second display mode of the operation object 71 can be a mode in which the size of the operation object 71 is smaller than that of the first display mode, and / or a mode in which the transparency of the operation object 71 is higher than that of the first display mode.

[0419] Alternatively, the second display mode of the control object 71 can be a mode in which the control object 71 is placed in a position (for example, at the top of the first display screen) different from the position in the first display mode.

[0420] Alternatively, the second display mode of the control object 71 can be a mode in which the control object in the first display mode is changed to another control object.

[0421] For example, as shown in FIG. 31, if the operation object 71 in the first display mode is an object for accepting a movement operation, another operation object in the second display mode can be an association object 76 for accepting an instruction to associate the first character object CO with a specific object, as shown in FIG. 36.

[0422] The associated object 76 is normally displayed when the first character object CO approaches a specific object within a predetermined distance, but if a first condition is met, the associated object 76 will be displayed even if the first character object CO does not approach within the predetermined distance.

[0423] When the associated object 76 is selected by the user, an animation of the first character object CO sitting on a sofa may be applied.

[0424] In addition, the fourth display mode of the information column 72 can be a mode in which the size of the information column 72 is larger than that of the third display mode, and / or a mode in which the transmittance of the information column 72 is smaller than that of the third display mode.

[0425] Although the first, second, third and fourth display modes have been described in detail above, they are not limited to the above examples.

[0426] Next, an example of an information processing method according to an embodiment of the present disclosure will be described.

[0427] The information processing method according to the embodiment of the present disclosure is an information processing method in the information processing system 3000 shown in Fig. 3. The information processing system 3000 includes at least a user terminal 100 and a server device 400.

[0428] The information processing method of the present disclosure is characterized in that, as shown as an example in FIG. 37, one or more computer processors provided in the information processing system 3000 execute a display control step S410, an object display step S420, an information column display step S430, a reception step S440, a determination step S450, and a display mode change step S460.

[0429] The display control step S410 controls the display of a predetermined virtual space and a moving image displaying a first character object of the first user movable within the virtual space on the first display screen of the first information processing device of the first user. The display control step S410 can be executed by the display control unit 410 described above.

[0430] Moreover, the display control step S410 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0431] In the object display step S420, an operation object for receiving an operation on the first display screen by the first user can be displayed on the first display screen superimposed on the video. Such an object display step S420 can be executed by the object display unit 420 described above.

[0432] Moreover, the object display step S420 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0433] The information column display step S430 allows an information column for displaying information about reactions to the video by the first user and / or a second user different from the first user to be superimposed on the video and displayed on the first display screen. Such information column display step S430 can be executed by the information column display unit 430 described above.

[0434] Furthermore, the information column display step S430 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0435] The receiving step S440 receives a predetermined operation and / or voice from the first user. The receiving step S440 can be executed by the receiving unit 440 described above.

[0436] Furthermore, the receiving step S440 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0437] The determining step S450 determines whether a first condition related to the first user and / or the first character object is satisfied. Such determining step S450 can be executed by the determining unit 450 described above.

[0438] Furthermore, the determination step S450 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0439] If it is determined in the determination step S450 that the first condition is satisfied, the display mode change step S460 changes the display mode of the operation object from the first display mode to the second display mode and changes the display mode of the information column from the third display mode to the fourth display mode. Such display mode change step S460 can be executed by the object display unit 420 and the information column display unit 430 described above.

[0440] Furthermore, the display mode changing step S460 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0441] Of the above-described steps S410 to S460, the order of processing S420 to S430 in particular is not particularly limited, and they may be performed simultaneously.

[0442] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0443] Next, a computer program according to an embodiment of the present disclosure will be described.

[0444] The computer program according to the embodiment of the present disclosure is a computer program executed in the information processing system 3000 shown in Fig. 3. The information processing system 3000 includes at least a user terminal 100 and a server device 400.

[0445] The computer program in the present disclosure is characterized by causing one or more computer processors provided in the information processing system 3000 to realize a display control function, an object display function, an information column display function, a reception function, a determination function, and a display mode change function.

[0446] The display control function controls the display of a video showing a predetermined virtual space and a first character object of the first user that can move within the virtual space on a first display screen of the first information processing device of the first user.

[0447] The object display function enables an operation object for receiving an operation on the first display screen by the first user to be displayed on the display screen superimposed on the moving image.

[0448] The information column display function enables an information column for displaying information regarding reactions to a video by a first user and / or a second user different from the first user to be displayed on the first display screen superimposed on the video.

[0449] The reception function receives a predetermined operation and / or voice from the first user.

[0450] The determining function determines whether a first condition is satisfied with respect to the first user and / or the first character object.

[0451] When the determination function determines that the first condition is satisfied, the display mode change function changes the display mode of the operation object from a first display mode to a second display mode, and changes the display mode of the information column from a third display mode to a fourth display mode.

[0452] The above functions can be realized by circuits 1410 to 1460 shown in Fig. 38. The display control circuit 1410, object display circuit 1420, information column display circuit 1430, receiving circuit 1440, determination circuit 1450, and display mode change circuit 1460 are realized by the above-mentioned display control unit 410, object display unit 420, information column display unit 430, receiving unit 440, and determination unit 450, respectively. Details of each unit are as described above.

[0453] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0454] Next, an information processing device according to an embodiment of the present disclosure will be described. The information processing device corresponds to the user terminal 100 in the information processing system 3000 described above.

[0455] As shown in FIG. 39, the information processing device includes a display control unit 110, an object display unit 120, an information column display unit 130, a reception unit 140, a determination unit 150, and a display mode change unit 160.

[0456] The display control unit 110 controls the display on the first display screen of a video that displays a predetermined virtual space and a first character object of the first user that can move within the virtual space. The display control unit 110 can have a configuration similar to that of the display control unit 410 described above.

[0457] The object display unit 120 can display an operation object for receiving an operation on the first display screen by the first user superimposed on a moving image on the first display screen. The object display unit 120 can have the same configuration as the object display unit 420 described above.

[0458] The information column display unit 130 can display an information column on the first display screen superimposed on the video, for displaying information about reactions to the video by the first user and / or a second user different from the first user. The information column display unit 130 can have the same configuration as the information column display unit 430 described above.

[0459] The receiving unit 140 receives a predetermined operation and / or a voice from the first user. The receiving unit 140 can have the same configuration as the receiving unit 440 described above.

[0460] The determination unit 150 determines whether a first condition regarding the first user and / or the first character object is satisfied. The determination unit 150 may have the same configuration as the determination unit 450 described above.

[0461] When the determination unit 150 determines that the first condition is satisfied, the display mode change unit 160 changes the display mode of the operation object from the first display mode to the second display mode, and changes the display mode of the information column from the third display mode to the fourth display mode. The display mode change unit 160 can be configured in the same manner as the object display unit 420 and the information column display unit 430 described above.

[0462] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0463] Next, an example of an information processing method according to an embodiment of the present disclosure will be described. This information processing method is an information processing method executed in the information processing device (user terminal 100) described above.

[0464] The information processing method of the present disclosure is characterized in that, as shown as an example in FIG. 40, an information processing device executes a display control step S110, an object display step S120, an information column display step S130, a reception step S140, a determination step S150, and a display mode change step S160.

[0465] The display control step S110 controls the display of a predetermined virtual space and a moving image displaying a first character object of the first user movable within the virtual space on the first display screen of the first information processing device of the first user. The display control step S110 can be executed by the display control unit 110 described above.

[0466] In the object display step S120, an operation object for receiving an operation on the first display screen by the first user can be displayed on the first display screen superimposed on the video. Such an object display step S120 can be executed by the object display unit 120 described above.

[0467] The information column display step S130 allows an information column for displaying information about reactions to the video by the first user and / or a second user different from the first user to be superimposed on the video on the display screen. The information column display step S130 can be executed by the information column display unit 130 described above.

[0468] The receiving step S140 receives a predetermined operation and / or voice from the first user. The receiving step S140 can be executed by the receiving unit 140 described above.

[0469] The determining step S150 determines whether a first condition regarding the first user and / or the first character object is satisfied. The determining step S150 can be executed by the determining unit 150 described above.

[0470] If it is determined in the determination step S150 that the first condition is satisfied, the display mode change step S160 changes the display mode of the operation object from the first display mode to the second display mode and the display mode of the information column from the third display mode to the fourth display mode. The display mode change step S160 can be executed by the display mode change unit 160 described above.

[0471] Of the above-described steps S110 to S160, the order of steps S120 to S130 is not particularly limited, and they may be performed simultaneously.

[0472] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0473] Finally, a computer program according to an embodiment of the present disclosure will be described, which is executed by the information processing device (user terminal 100) described above.

[0474] The computer program according to the embodiment of the present disclosure is a computer program executed in the user terminal 100 of the information processing system 3000 shown in FIG.

[0475] The computer program in the present disclosure is characterized by causing one or more computer processors included in the user terminal 100 to realize a display control function, an object display function, an information column display function, a reception function, a determination function, and a display mode change function.

[0476] The display control function controls the display of a video showing a predetermined virtual space and a first character object of the first user that can move within the virtual space on a first display screen of the first information processing device of the first user.

[0477] The object display function enables an operation object for receiving an operation on the first display screen by the first user to be displayed on the display screen superimposed on the moving image.

[0478] The information column display function enables an information column for displaying information regarding reactions to a video by a first user and / or a second user different from the first user to be displayed on the first display screen superimposed on the video.

[0479] The reception function receives a predetermined operation and / or voice from the first user.

[0480] The determining function determines whether a first condition is satisfied with respect to the first user and / or the first character object.

[0481] When the determination function determines that the first condition is satisfied, the display mode change function changes the display mode of the operation object from a first display mode to a second display mode, and changes the display mode of the information column from a third display mode to a fourth display mode.

[0482] The above functions can be realized by circuits 1110 to 1160 shown in Fig. 41. The display control circuit 1110, object display circuit 1120, information column display circuit 1130, reception circuit 1140, determination circuit 1150, and display mode change circuit 1160 are realized by the above-mentioned display control unit 110, object display unit 120, information column display unit 130, reception unit 140, and determination unit 150, respectively. Details of each unit are as described above.

[0483] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

[0484] Furthermore, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-described embodiments. Such an information processing device can be realized by storing a program describing the processing content for realizing each function of the server device or terminal device according to the embodiments in a storage unit of the information processing device, and reading and executing the program by a CPU of the information processing device.

[0485] 42 is a block diagram of a processing circuit for performing computer-based operations in accordance with the present disclosure. FIG. 42 shows a processing circuit 600, which corresponds to the CPU of the terminals and devices of the present disclosure.

[0486] The processing circuit 600 can be used to control any computer-based or cloud-based control process. Flowchart descriptions or blocks can be understood as representing modules, segments, or portions of code containing one or more executable instructions for implementing specific logical functions or steps within a process. Alternative implementations are within the scope of the exemplary embodiments of this advancement in which functions may be performed. The order from that shown or discussed includes substantially simultaneous or reverse order, depending on the functionality involved, as will be understood by those skilled in the art. The functionality of the elements disclosed herein can be implemented using circuits or processing circuits that may include general-purpose processors, special-purpose processors, integrated circuits, ASICs ("application-specific integrated circuits"), conventional circuits configured or programmed to perform the disclosed functions, and / or combinations thereof. A processor processes circuits or circuits, such as transistors and other circuits therein. A processor may also be a programmed processor that executes a program stored in memory. In this disclosure, a processing circuit, unit, or means is hardware that performs or is programmed to perform the recited functions. The hardware can be any hardware disclosed herein or any otherwise known hardware that is programmed or configured to perform the recited functions.

[0487] In FIG. 42, processing circuit 600 includes CPU 601, which executes one or more control processes discussed in this disclosure. Process data and instructions may be stored in memory 602. These process and instructions may also be stored on a storage medium disk 604, such as a hard drive (HDD) or portable storage medium, or may be stored remotely. Furthermore, the claimed advancement is not limited by the form of computer-readable medium on which the instructions for the processes of the present invention are stored. For example, the instructions may be stored on a CD, DVD, flash memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk, or any other non-transitory computer-readable medium of an information processing device with which processing circuit 600 communicates, such as a server or computer. The processes may also be stored in network-based storage, cloud-based storage, or other mobile-accessible storage and executable by processing circuit 600.

[0488] Additionally, the claimed developments may be provided as a utility application, a background daemon, or an operating system component, or a combination thereof, and execute in conjunction with CPU 601 and an operating system such as Microsoft Windows, UNIX, Solaris, LINUX, Apple MAC-OS, Apple iOS, and other systems known to those skilled in the art.

[0489] The hardware elements for implementing the processing circuit 600 may be realized by various circuit elements. Furthermore, each function of the above-described embodiments may be realized by a circuit including one or more processing circuits. The processing circuit includes a specially programmed processor, for example, a processor (CPU) 601 as shown in FIG. 42. The processing circuit also includes devices such as application-specific integrated circuits (ASICs) and conventional circuit components arranged to perform the enumerated functions.

[0490] Alternatively, or additionally, CPU 601 may be implemented on an FPGA, an ASIC, a PLD, or using discrete logic circuitry, as will be appreciated by those skilled in the art. CPU 601 may also be realized as multiple processors operating in parallel and in coordination to execute instructions for the inventive process described above.

[0491] The processing circuit 600 of FIG. 42 also includes a network controller 606, such as an Ethernet PRO network interface card, for interfacing with a network 700. As can be appreciated, the network 700 can be a public network, such as the Internet, or a private network, such as a local area network (LAN) or wide area network (WAN), or any combination thereof, and can also include a public switched telephone network (PSTN) or an integrated services digital network (ISDN) subnetwork. The network 700 can also be wired, such as an Ethernet network, a universal serial bus (USB) cable, or wireless, such as a cellular network, including EDGE, 3G, and 4G wireless cellular systems. The wireless network can also be Wi-Fi, wireless LAN, Bluetooth, or any other known form of wireless communication. Additionally, the network controller 606 may be compliant with other direct communication standards, such as Bluetooth, near field communication (NFC), infrared, or others.

[0492] The processing circuit 600 further includes a display controller 608, such as a graphics card or graphics adapter, for interfacing with a display 609, such as a monitor. The I / O interface 612 interfaces with a keyboard and / or mouse 614, and a touchscreen panel 616 on or separate from the display 609. The I / O interface 612 also connects to various peripheral devices 618.

[0493] Storage controller 624 connects storage media disks 604 to a communication bus 626, which may be ISA, EISA, VESA, PCI, or the like, and interconnects all components of processing circuit 600. A description of the display 609, keyboard and / or mouse 614, and the general features and functionality of display controller 608, storage controller 624, network controller 606, and I / O interface 612 will be omitted herein for the sake of brevity, as these features are well known.

[0494] Example circuit elements described in the context of this disclosure may be substituted with other elements or may be structured differently from the examples provided herein. Furthermore, circuits configured to perform the functions described herein may be implemented in multiple circuit units (e.g., chips), or features may be combined in circuits on a single chipset.

[0495] The functions and features described herein may also be performed by various distributed components of a system. For example, one or more processors may perform these system functions, where the processors are distributed across multiple components communicating within a network. The distributed components may include one or more client and server machines that may share processing, as well as various human interface and communication devices (e.g., display monitors, smartphones, tablets, personal digital assistants (PDAs)). The network may be a private network such as a LAN or WAN, or a public network such as the Internet. Input to the system may be received via direct user input, remotely in real time, or as a batch process. Furthermore, some implementations may be performed on modules or hardware that are not identical to those described. Accordingly, other implementations are within the scope that may be claimed.

[0496] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims.

[0497] Furthermore, the methods described in the embodiments can be stored as a program executable by a computer on a recording medium such as a magnetic disk (e.g., a floppy disk, a hard disk, etc.), an optical disk (e.g., a CD-ROM, a DVD, an MO, etc.), or a semiconductor memory (e.g., a ROM, a RAM, a flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium also includes a configuration program for configuring software means (including not only execution programs but also tables and data structures) within the computer to be executed by the computer. The computer implementing this device reads the program stored on the recording medium and, in some cases, configures the software means using the configuration program, and executes the above-described processing by controlling the operation of this software means. The term "recording medium" as used herein is not limited to a storage medium for distribution, but also includes storage media such as a magnetic disk or semiconductor memory installed within the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. [Explanation of symbols]

[0498] 100 user terminals 400 Server device 410 Display control unit 420 Object Display 430 Information column display section 440 Reception Department 450 Judgment section

Claims

1. 1. An information processing system comprising one or more computer processors, the one or more computer processors: a display control unit that controls display of a predetermined virtual space and a video that displays a first character object of a first user that is movable within the virtual space on a first display screen of a first information processing device of the first user; an object display unit that displays an operation object for receiving an operation on the first display screen by the first user on the first display screen by superimposing the operation object on the video; an information column display unit that can display an information column for displaying information about the moving image on the first display screen so as to be superimposed on the moving image; a reception unit that receives a predetermined operation and / or voice from the first user; a determination unit that determines whether a first condition regarding the first user and / or the first character object is satisfied; Equipped with If the determination unit determines that the first condition is satisfied, the object display unit changes a display mode of the operation object from a first display mode to a second display mode; the information column display unit changes the display mode of the information column from a third display mode to a fourth display mode, The first condition is: a specific relationship is established between the first character object and a specific object arranged in the virtual space, or the specific object is selected by the first user; The voice received by the receiving unit satisfies a predetermined condition, or the receiving unit does not receive a movement operation of the first character object for a predetermined period of time; An information processing system.

2. 2. The information processing system according to claim 1, wherein the information about the video includes notification information for the first user.

3. The information processing system according to claim 1 , wherein the information about the video includes information about a reaction to the video by the first user and / or a second user different from the first user.

4. The information processing system described in claim 1, characterized in that the specific object is an object used when the first user communicates with a second user different from the first user, and is a first object displayed in association with the first character object or as a background or rug for the first character object.

5. The information processing system described in claim 1, characterized in that the specific object is a second object used when the first user communicates with a second user different from the first user, and is used to display a first object associated with the first character object or displayed as a background or rug for the first character object.

6. The information processing system of claim 1, wherein the specific relationship is that the first character object and the specific object are associated with each other, or that the distance between the placement position of the first character object and the placement position of the specific object in the virtual space is less than a predetermined value.

7. The information processing system according to claim 1, characterized in that the display control unit further controls the display of the video on a second display screen of a second information processing device of a second user different from the first user.

8. If the determination unit determines that the first condition is satisfied, The information processing system according to claim 1, characterized in that the display control unit further controls the video so that it can be displayed on a second display screen of a second information processing device of a second user who is different from the first user.

9. If the determination unit determines that the first condition is satisfied, The information processing system of claim 1, further characterized in that the video further displays a start object indicating that communication by the first user to a second user different from the first user has begun.

10. The one or more computer processors further: a virtual camera control unit that controls an operation of a virtual camera operable by the first user; If the determination unit determines that the first condition is satisfied, 2. The information processing system according to claim 1, wherein the virtual camera control unit changes the operation of the virtual camera from a first operation mode to a second operation mode.

11. the first operation mode is an operation mode based on an operation of the first user, 11. The information processing system according to claim 10, wherein the second operation mode is an operation mode that is not based on an operation of the first user.

12. The determination unit further determines whether a second condition is satisfied; If the determination unit determines that the second condition is satisfied, the object display unit changes the display mode of the operation object from the second display mode to the first display mode; 2. The information processing system according to claim 1, wherein the information column display unit changes the display mode of the information column from the fourth display mode to the third display mode.

13. The information processing system according to claim 12 , wherein the second condition is that the accepting unit has accepted a pinch-in operation on the first display screen by the first user.

14. The information processing system according to claim 12 , wherein the second condition is that the voice received by the receiving unit satisfies a predetermined condition.

15. the video further displays a third character object of a third user that is movable within the virtual space; the display control unit further controls display of the video on a third display screen of a third information processing device of the third user; The information processing system according to claim 1 , wherein the determination unit further determines whether a third condition regarding the third user and / or the third character object is satisfied.

16. The virtual space is a space associated with each user, 2. The information processing system according to claim 1, wherein the first virtual space is a first virtual space in which at least furniture objects can be placed by the user's operation.

17. the one or more computer processors: a selection receiving unit that receives a selection by the first user of either the first virtual space or a second virtual space that is different from the first virtual space and in which the furniture object cannot be placed; When the selection receiving unit receives a selection of a first virtual space, the display control unit causes the video to display the first virtual space and the first character object movable within the first virtual space; the object display unit displays the operation object on the first display screen in a manner superimposed on the video; When the selection receiving unit receives a selection of a second virtual space, the display control unit displays the second virtual space and the first character object in the video so as to be immovable within the second virtual space; 17. The information processing system according to claim 16, wherein the object display unit does not display the operation object on the first display screen superimposed on the video.

18. one or more computer processors, a display control step of controlling display of a video image displaying a predetermined virtual space and a first character object of a first user movable within the virtual space on a first display screen of a first information processing device of the first user; an object display step of displaying an operation object for receiving an operation on the first display screen by the first user on the first display screen by superimposing the operation object on the video; an information column display step of displaying information about the moving image on the first display screen in a manner superimposed on the moving image; a receiving step of receiving a predetermined operation and / or voice from the first user; a determining step of determining whether a first condition is satisfied with respect to the first user and / or the first character object; a display mode changing step of changing a display mode of the operation object from a first display mode to a second display mode and changing a display mode of the information column from a third display mode to a fourth display mode when it is determined in the determining step that the first condition is satisfied; Execute The first condition is: a specific relationship is established between the first character object and a specific object arranged in the virtual space, or the specific object is selected by the first user; The voice received in the receiving step satisfies a predetermined condition, or in the receiving step, not receiving a movement operation of the first character object for a predetermined period of time; An information processing method.

19. one or more computer processors, a display control step of controlling display on a first display screen of a moving image displaying a predetermined virtual space and a first character object of a first user movable within the virtual space; an object display step of displaying an operation object for receiving an operation on the first display screen by a first user on the first display screen by superimposing the operation object on the video; an information column display step of displaying information about the moving image on the first display screen in a manner superimposed on the moving image; a receiving step of receiving a predetermined operation and / or voice from the first user; a determining step of determining whether a first condition is satisfied with respect to the first user and / or the first character object; a display mode changing step of changing a display mode of the operation object from a first display mode to a second display mode and changing a display mode of the information column from a third display mode to a fourth display mode when it is determined in the determining step that the first condition is satisfied; Execute The first condition is: a specific relationship is established between the first character object and a specific object arranged in the virtual space, or the specific object is selected by the first user; The voice received in the receiving step satisfies a predetermined condition, or in the receiving step, not receiving a movement operation of the first character object for a predetermined period of time; An information processing method.

20. one or more computer processors, a display control function that controls the display on the first display screen of a video that displays a predetermined virtual space and a first character object of the first user that is movable within the virtual space; an object display function that enables an operation object for receiving an operation on the first display screen by a first user to be displayed on the first display screen by superimposing the operation object on the video; an information column display function that enables an information column for displaying information about the video to be displayed on the first display screen in a manner superimposed on the video; a reception function for receiving a predetermined operation and / or voice from the first user; a determination function that determines whether a first condition related to the first user and / or the first character object is satisfied; a display mode change function that, when it is determined by the determination function that the first condition is satisfied, changes the display mode of the operation object from a first display mode to a second display mode and changes the display mode of the information column from a third display mode to a fourth display mode; Realize this, The first condition is: a specific relationship is established between the first character object and a specific object arranged in the virtual space, or the specific object is selected by the first user; The voice received by the reception function satisfies a predetermined condition, or the reception function does not receive a movement operation of the first character object for a predetermined period of time; A computer program that is

Images