Information processing system, information processing method, and computer program

Abstract

To provide an information processing system configured to increase distribution motivation of a distribution user, viewing motivation of a viewing user and / or communication motivation of the users, an information processing method, and a computer program.SOLUTION: An information processing system is configured to: apply first moving action to a character object of a first user in accordance with a predetermined operation on a first operation UI; apply second moving action to the character object in accordance with a predetermined operation on a second operation UI displayed on a first user terminal; switch a viewing point of a virtual camera to a first-person viewing point or a third-person viewing point in accordance with a predetermined operation on a third operation UI displayed on the first user terminal; and apply moving, rotating and / or zooming operation of the virtual camera in accordance with a predetermined operation on a region where the first operation UI, the second operation UI, and the third operation UI are not displayed, on the first user terminal.SELECTED DRAWING: Figure 47

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a computer program. [Background technology]

[0002] BACKGROUND ART There is known an information processing system that generates animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-184689 Summary of the Invention [Problem to be solved by the invention]

[0004] In this technical field, how to increase distribution users' willingness to distribute, viewing users' willingness to view, and / or users' willingness to interact with each other is an important issue.

[0005] Therefore, an object of the present disclosure is to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. A more specific object of the present disclosure is to provide an information processing system, an information processing method, and a computer program that can increase distribution users' motivation to distribute, viewing users' motivation to watch, and / or users' motivation to interact with each other. [Means for solving the problem]

[0006] The information processing system of the present disclosure is characterized in that one or more computer processors include a transmitting unit that transmits information regarding a video including a character object of a first user to a second user terminal of a second user, a movement operation receiving unit that receives movement operations of the character object of the first user within a virtual space, a virtual camera control unit that receives camera operations of a virtual camera that captures images within the virtual space, and a video generation unit that generates information to enable the character object of the first user to move within the virtual space based on the movement operations and camera operations, and applies a first movement operation to the character object of the first user in accordance with a predetermined operation on a first operation UI displayed on the first user terminal of the first user, applies a second movement operation to the character object of the first user in accordance with a predetermined operation on a second operation UI displayed on the first user terminal, switches the viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in accordance with a predetermined operation on a third operation UI displayed on the first user terminal, and applies movement, rotation and / or zoom operations of the virtual camera in accordance with a predetermined operation on an area on the first user terminal where the first operation UI, second operation UI and third operation UI are not displayed.

[0007] The one or more computer processors can switch between displaying and not displaying comments on a video displayed on the first user terminal in response to a predetermined operation on the first user terminal.

[0008] When switching whether or not to display comments on a video, one or more computer processors can change the display position of the first operation UI and the second operation UI, or hide the first operation UI, the second operation UI, and the third operation UI.

[0009] The first movement motion may be a horizontal movement and the second movement motion may be a vertical movement.

[0010] The one or more computer processors can apply a rotation operation to the virtual camera in response to a one-finger swipe operation on the area, a movement operation to the virtual camera in response to a two-finger swipe operation on the area, and a zoom operation to the virtual camera in response to a two-finger pinch-in / pinch-out operation on the area.

[0011] The virtual camera control unit can accept camera operations from the first user or a user authorized by the first user.

[0012] The facial movement of the first user's character object is generated based on the facial movement of the first user captured by the in-camera of the first user terminal, and the video generation unit can generate the facial movement of the first user's character object in an inverted or non-inverted state depending on the positional relationship between the first user's character object and the virtual camera.

[0013] When the character object of the first user moves beyond the movable area, the video generation unit can make the character object reappear at another position within the virtual space.

[0014] The information processing method of the present disclosure has one or more computer processors execute a transmission step of transmitting information regarding a video including a character object of a first user to a second user terminal of a second user, a movement operation receiving step of receiving a movement operation of the character object of the first user within a virtual space, a virtual camera control step of receiving a camera operation of a virtual camera that captures images within the virtual space, and a video generation step of generating information to enable the character object of the first user to move within the virtual space based on the movement operation and the camera operation, wherein the video generation step applies a first movement operation to the character object of the first user in accordance with a predetermined operation on a first operation UI displayed on the first user terminal of the first user, applies a second movement operation to the character object of the first user in accordance with a predetermined operation on a second operation UI displayed on the first user terminal, switches the viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in accordance with a predetermined operation on a third operation UI displayed on the first user terminal, and applies movement, rotation and / or zoom operations of the virtual camera in accordance with a predetermined operation on an area on the first user terminal where the first operation UI, the second operation UI and the third operation UI are not displayed.

[0015] The information processing method of the present disclosure has one or more computer processors execute a transmission step of transmitting information regarding a video including a first user's character object to a server device, a movement operation receiving step of receiving a movement operation of the first user's character object within a virtual space, a virtual camera control step of receiving a camera operation of a virtual camera that captures images within the virtual space, and a video generation step of generating information to enable the first user's character object to move within the virtual space based on the movement operation and the camera operation, wherein the video generation step applies a first movement operation to the first user's character object in accordance with a predetermined operation on a first operation UI displayed on the first user terminal of the first user, applies a second movement operation to the first user's character object in accordance with a predetermined operation on a second operation UI displayed on the first user terminal, switches the viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in accordance with a predetermined operation on a third operation UI displayed on the first user terminal, and applies movement, rotation and / or zoom operations of the virtual camera in accordance with a predetermined operation on an area on the first user terminal where the first operation UI, second operation UI and third operation UI are not displayed.

[0016] The computer program of the present disclosure enables one or more computer processors to realize a transmission function that transmits information regarding a video including a first user's character object to a server device, a movement operation reception function that receives movement operations of the first user's character object within a virtual space, a virtual camera control function that receives camera operations of a virtual camera that captures images within the virtual space, and a video generation function that generates information to enable the first user's character object to move within the virtual space based on the movement operations and camera operations, and is characterized in that the video generation function applies a first movement operation to the first user's character object in accordance with a predetermined operation on a first operation UI displayed on the first user terminal of the first user, applies a second movement operation to the first user's character object in accordance with a predetermined operation on a second operation UI displayed on the first user terminal, switches the viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in accordance with a predetermined operation on a third operation UI displayed on the first user terminal, and applies movement, rotation and / or zoom operations of the virtual camera in accordance with a predetermined operation on an area on the first user terminal where the first operation UI, second operation UI and third operation UI are not displayed.

[0017] The information processing method of the present disclosure includes causing one or more computer processors to execute a receiving step of receiving information regarding a video including a character object of a first user and a character object of a second user from a server device, a movement operation receiving step of receiving a movement operation of the character object of the second user within a virtual space, a virtual camera control step of receiving a camera operation of a virtual camera that captures images within the virtual space, a transmission step of transmitting information regarding the movement operation and the camera operation to the server device, and a display step of displaying the character object of the first user and the character object of the second user movably within the virtual space, wherein a first movement operation is applied to the character object of the second user in accordance with a predetermined operation of the second user on a first operation UI displayed on the second user terminal, a second movement operation is applied to the character object of the first user in accordance with a predetermined operation of the second operation UI displayed on the second user terminal, the viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in accordance with a predetermined operation on a third operation UI displayed on the second user terminal, and movement, rotation and / or zoom operations of the virtual camera are applied in accordance with a predetermined operation on an area of ​​the second user terminal where the first operation UI, the second operation UI and the third operation UI are not displayed.

[0018] The computer program of the present disclosure causes one or more computer processors to realize a receiving function for receiving information regarding a video including a character object of a first user and a character object of a second user from a server device, a movement operation receiving function for receiving movement operations of the character object of the second user within a virtual space, a virtual camera control function for receiving camera operations of a virtual camera that captures images within the virtual space, a transmission function for transmitting information regarding the movement operations and camera operations to the server device, and a display function for displaying the character object of the first user and the character object of the second user movably within the virtual space, and is characterized in that a first movement operation is applied to the character object of the second user in accordance with a predetermined operation of the second user on a first operation UI displayed on the second user terminal, a second movement operation is applied to the character object of the first user in accordance with a predetermined operation on the second operation UI displayed on the second user terminal, the viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in accordance with a predetermined operation on a third operation UI displayed on the second user terminal, and movement, rotation and / or zoom operations of the virtual camera are applied in accordance with a predetermined operation on an area of ​​the second user terminal where the first operation UI, the second operation UI and the third operation UI are not displayed. [Effects of the Invention]

[0019] According to the present disclosure, it is possible to provide technical improvements that solve or alleviate at least some of the problems of the conventional techniques described above. Specifically, according to the present disclosure, it is possible to improve distribution users' motivation to distribute, viewing users' motivation to watch, and / or users' motivation to interact with each other. [Brief explanation of the drawings]

[0020] [Figure 1] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 2] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 3]1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 4] FIG. 2 is a configuration diagram illustrating an example of a hardware configuration of a server device, a first user terminal, and a second user terminal according to the present disclosure. [Figure 5] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 6] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 7] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 8] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 9] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 10] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 11] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 12] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 13] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 14] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 15] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 16] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 17] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 18] FIG. 2 is a configuration diagram illustrating an example of a functional configuration of a server device according to the first embodiment of the present disclosure. [Figure 19] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 20]FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 21] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 22] FIG. 1 is a conceptual diagram illustrating an image of a virtual space in the present disclosure. [Figure 23] FIG. 1 is a conceptual diagram illustrating an image of a virtual space in the present disclosure. [Figure 24] FIG. 1 is a conceptual diagram illustrating an image of a virtual space in the present disclosure. [Figure 25] FIG. 1 is a conceptual diagram illustrating an image of a virtual space in the present disclosure. [Figure 26] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 27] FIG. 1 is a conceptual diagram illustrating an image of a virtual space in the present disclosure. [Figure 28] FIG. 10 is a configuration diagram showing another example of the functional configuration of the server device according to the first embodiment of the present disclosure. [Figure 29] FIG. 10 is a configuration diagram illustrating an example of a functional configuration of a server device according to a second embodiment of the present disclosure. [Figure 30] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 31] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 32] FIG. 10 is a configuration diagram showing another example of the functional configuration of the server device according to the second embodiment of the present disclosure. [Figure 33] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 34] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 35] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 36] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 37]FIG. 10 is a configuration diagram illustrating an example of a functional configuration of a server device according to a third embodiment of the present disclosure. [Figure 38] FIG. 1 is a conceptual diagram illustrating an image of a virtual space in the present disclosure. [Figure 39] FIG. 10 is a conceptual diagram showing an image of a third object and a fourth object in the present disclosure. [Figure 40] FIG. 1 is a conceptual diagram showing an image of a loading image in the present disclosure. [Figure 41] FIG. 11 is a configuration diagram showing another example of the functional configuration of the server device according to the third embodiment of the present disclosure. [Figure 42] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 43] FIG. 1 is a flow diagram illustrating an example of a processing flow in the present disclosure. [Figure 44] FIG. 1 is a flow diagram illustrating an example of a processing flow in the present disclosure. [Figure 45] FIG. 10 is a conceptual diagram showing an image of a fifth object in the present disclosure. [Figure 46] FIG. 10 is a configuration diagram illustrating an example of a functional configuration of a first user terminal according to a fourth embodiment of the present disclosure. [Figure 47] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 48] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 49] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 50] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 51] FIG. 13 is a configuration diagram showing an example of a functional configuration of a first user terminal according to a fifth embodiment of the present disclosure. [Figure 52] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 53] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 54]FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 55] FIG. 13 is a configuration diagram showing another example of the functional configuration of the first user terminal in the fifth embodiment of the present disclosure. [Figure 56] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 57] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 58] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 59] FIG. 1 is a flow diagram illustrating an example of the flow of an information processing method according to the present disclosure. [Figure 60] FIG. 1 is a circuit configuration diagram showing an example of a circuit configuration for realizing a computer program according to the present disclosure. [Figure 61] FIG. 10 is a flow diagram showing an example of the flow of an information processing method in a first user terminal in the present disclosure. [Figure 62] FIG. 2 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a first user terminal in the present disclosure. [Figure 63] FIG. 10 is a configuration diagram illustrating an example of a functional configuration of a second user terminal in the present disclosure. [Figure 64] FIG. 10 is a flow diagram showing an example of the flow of an information processing method in a second user terminal in the present disclosure. [Figure 65] FIG. 10 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a second user terminal in the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0021] First, an overview of an information processing system according to an embodiment of the present disclosure will be described with reference to the drawings.

[0022] The information processing system according to the present disclosure is an information processing system including one or more information processing devices and a server device, and includes one or more computer processors.

[0023] The video displayed on each device will be described as including animation of a character object generated based on the broadcaster's movements, but is not limited to this and may include animation of a character object generated in response to the broadcaster's operations, or may include an image of the broadcaster himself / herself.Furthermore, these character objects and the broadcaster may not be displayed, and only the broadcaster's voice may be included.

[0024] The space displayed in the video may be a virtual space, a real space, or an augmented reality space that combines these. The video may be something like a karaoke video or a game commentary video that plays back at least a predetermined image and the broadcaster's voice, or may be a display in which a character object or an actual image of the broadcaster is superimposed on these.

[0025] Furthermore, if the broadcasting user is included in the real space, a character object generated based on the broadcasting user's movements may be superimposed on an actual image of the broadcasting user. Also, an animation of a gift object or the like may be superimposed on a captured image of the real space.

[0026] The information processing system in an embodiment of the present disclosure is a digital world in which many people can participate simultaneously and freely engage in activities such as interacting, working, and playing through character objects (avatars) at a level similar to that of the real world, and can be used to provide a next-generation Internet space (metaverse) in which social activities can take place beyond the gap between reality and virtuality.

[0027] In this embodiment, as one element of the metaverse, it can be used to realize a "world function" that allows users' avatars (character objects) to walk around freely in a virtual space and communicate with each other.

[0028] <System configuration> As shown as an example in FIG. 1, the information processing system 1000 according to the present disclosure may include one or more viewing user terminals 1100 and an information processing device (support computer) 1300 located in a video distribution studio or the like, which is connected to these viewing user terminals 1100 via a network 1200.

[0029] Furthermore, the information processing device 1300 may be connected to a server device via the Internet, and the server device may perform part or all of the processing that should be performed by the information processing device 1300. Note that such a server device may be the information processing device 2400 shown in FIG. 2.

[0030] In this specification, such distribution by the information processing system 1000 is referred to as studio distribution.

[0031] In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.

[0032] Furthermore, the information processing system 1000 of the present invention can cooperate with another information processing system 2000 shown as an example in Fig. 2. The information processing system 2000 shown in Fig. 2 can include a broadcaster user terminal 2100, one or more viewer user terminals 2200, and an information processing device (server device) 2400 connected to the broadcaster user terminal 2100 and the viewer user terminal 2200 via a network 2300.

[0033] In the above example, the broadcaster user terminal 2100 can be an information processing terminal such as a smartphone. In this specification, broadcasting by such information processing system 2000 is referred to as mobile broadcasting.

[0034] In mobile distribution, the broadcaster user's facial movements are captured by a camera on the broadcaster user terminal 2100, and are reflected on the character's face in real time using known face tracking technology.

[0035] In mobile distribution, there is no particular distinction between distributor users and viewing users; viewing users can use mobile distribution at any time, and distributor users can become viewing users when viewing videos of other distributor users.

[0036] The moving images generated by the information processing system 1000 and the information processing system 2000 can be distributed to viewing users from one moving image distribution platform, for example.

[0037] In addition, in either distribution, the process of generating animation by reflecting motion on a character and the process of displaying gifts, which will be described later, may be shared and performed by the distribution user terminal, the viewing user terminal, the information processing device, and other devices.

[0038] In other words, "distribution" here refers to sending information that enables the video to be viewed on the viewing user's terminal, and the rendering of the video may be performed on the information processing device 1300, 2400 side, or on the distribution user terminal 2100 or viewing user terminal 1100, 2200 side.

[0039] Specifically, facial motion data and voice data of the broadcasting user are transmitted from the broadcasting user terminal or information processing device to a terminal or device that generates (renders) animation of the character object. Body motion may also be transmitted in addition to facial motion.

[0040] In the present disclosure, the process of generating animation will be described as being performed by each of the broadcasting user terminal and the viewing user terminal, but this is not limited to this.

[0041] The information processing system in the present disclosure can be applied to either of the examples shown in Figures 1 and 2. Furthermore, since it is not necessarily necessary to distinguish between a "distribution user" and a "viewing user," the information processing system 3000 in the embodiment of the present disclosure will be described as including a first user terminal 100, a second user terminal 200, and a server device 400 connectable to the first user terminal 100 and the second user terminal 200 via a network 300, as shown in Figure 3.

[0042] The first user terminal 100 functions as at least the above-mentioned information processing device 1300 or the distribution user terminal 2100, the second user terminal 200 functions as at least one or more of the above-mentioned viewing user terminals 1100, 2200, and the server device 400 functions as at least the above-mentioned server device or information processing device 2400.

[0043] In the present disclosure, the first user terminal 100 and the second user terminal 200 may be a smartphone (multifunction phone terminal), a tablet terminal, a personal computer, a console game machine, a head-mounted display (HMD), a wearable computer such as an eyeglass-type wearable terminal (AR glasses, etc.), or an information processing device other than these devices that can play videos. Furthermore, these terminals may be standalone devices that operate independently, or may be composed of multiple devices connected to each other so that various data can be transmitted and received.

[0044] <Hardware configuration> 4, the hardware configuration of the first user terminal 100 will be described. The first user terminal 100 includes a processor 101, a memory 102, a storage 103, an input / output interface (input / output I / F) 104, and a communication interface (communication I / F) 105. The components are connected to each other via a bus B.

[0045] The first user terminal 100 can realize the functions and methods described in this embodiment through cooperation between the processor 101, memory 102, storage 103, input / output I / F 104, and communication I / F 105.

[0046] The processor 101 executes functions and / or methods implemented by codes or instructions included in a program stored in the storage 103. The processor 101 may include, for example, a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may implement each process disclosed in each embodiment using a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large-scale integration (LSI)), etc. Furthermore, these circuits may be implemented using one or more integrated circuits, and multiple processes described in each embodiment may be implemented using a single integrated circuit. Furthermore, an LSI may also be referred to as a VLSI, a super LSI, an ultra LSI, etc. depending on the degree of integration.

[0047] The memory 102 temporarily stores programs loaded from the storage 103 and provides a working area for the processor 101. The memory 102 also temporarily stores various data generated while the processor 101 is executing the programs. The memory 102 includes, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.

[0048] The storage 103 stores programs and includes, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, and the like.

[0049] The communication I / F 105 is implemented as hardware such as a network adapter, communication software, or a combination thereof, and transmits and receives various data via the network 300. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication is possible. The communication I / F 105 communicates with other information processing devices via the network 300. The communication I / F 105 transmits various data to other information processing devices in accordance with instructions from the processor 101. The communication I / F 105 also receives various data transmitted from other information processing devices and transmits the data to the processor 101.

[0050] The input / output I / F 104 includes an input device for inputting various operations to the first user terminal 100, and an output device for outputting processing results processed by the first user terminal 100. The input / output I / F 104 may be an integrated input device and output device, or may be separate input device and output device.

[0051] The input device is realized by any one or combination of all types of devices that can receive input from a user and transmit information related to the input to the processor 101. Examples of the input device include hardware keys such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (for inputting operations via images), and a microphone (for inputting operations via voice).

[0052] The input device may include a sensor unit. The sensor unit includes one or more sensors that detect facial motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body relative to the sensor unit. Facial motions include blinking, opening and closing of the mouth, and other movements. A known sensor unit may be used. One example of the sensor unit includes a ToF sensor that measures the time of flight (TOF) of light irradiated toward the user and reflected from the user's face, a camera that captures the user's face, and an image processing unit that processes the data captured by the camera. The sensor unit may also include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. The RGB camera and the near-infrared camera may be, for example, the True Depth sensor in the iPhone X (registered trademark), the LIDER sensor in the iPad Pro (registered trademark), or other ToF sensors installed in smartphones. Specifically, this camera uses a dot projector to project tens of thousands of invisible dots onto the user's face, etc. The sensor unit then detects and analyzes the reflected light from the dot pattern to form a depth map of the face, and captures an infrared image of the face, etc., thereby capturing accurate facial data. The sensor unit's processing unit generates various information based on the depth map and the infrared image, and compares this information with registered reference data to calculate the depth of each point on the face (the distance between each point and the near-infrared camera) and positional deviations other than depth.

[0053] The sensor unit may also have a function of tracking not only the user's face but also their hands (hand tracking). The sensor unit may further include sensors other than the above-mentioned sensors, such as an acceleration sensor or a gyro sensor. The sensor unit may have a spatial mapping function of recognizing objects in the real space where the user exists based on the detection results of the above-mentioned ToF sensor or other known sensors, and mapping the recognized objects on a spatial map. Hereinafter, when face motion detection data and body motion detection data are described without any particular distinction, they will simply be referred to as "tracking data." The image processing unit of the sensor unit may be included in a control unit that can be included in the information processing system of the present invention.

[0054] The operation unit serving as an input device can be one that corresponds to the type of user terminal. Examples of the operation unit include a touch panel integrated with a display, operation buttons provided on the housing of the user terminal, a keyboard, a mouse, and a controller operated by the user's hands. The controller may incorporate various known sensors, such as an acceleration sensor, a gyroscope, or an inertial measurement unit (IMU). Another example of the operation unit may be a tracking device that identifies the user's hand movements, eye movements, head movements, and gaze direction. In this embodiment, for example, the user's instructions can be determined based on the user's hand movements, and various operations can be performed, such as starting or ending video distribution, rating a message or video, or requesting the display of a predetermined object (e.g., a gift, as described below). Note that if the sensor unit also has an input interface function, such as a hand truck function, the operation unit can be omitted.

[0055] The output device outputs the processing results obtained by the processor 101. The output device includes, for example, a touch panel, a speaker, and the like.

[0056] Furthermore, the second user terminal 200 and the server device 400 in the present disclosure can also be configured with the same hardware configuration as in FIG. 4, except where otherwise noted.

[0057] Next, various functions that can be executed on a user terminal that has launched an application realized by the information processing system according to an embodiment of the present disclosure, and transitions of displayed screens will be described with reference to the drawings.

[0058] FIG. 5 shows a top screen T10 that is displayed on a user terminal when a video distribution and viewing application is launched.

[0059] As shown in Figure 5, a user can watch videos being played on one distribution channel by selecting one distribution channel (distribution slot, distribution program, distribution video, etc.) from thumbnail images of one or more recommended distribution channels T12 listed in the recommendation tab T11 on the top screen T10.

[0060] Alternatively, a user can view a video played on a specific distribution channel by accessing the fixed link of the specific distribution channel. Such a fixed link can be obtained through notifications from broadcasters they follow or through notifications of shares sent by other users.

[0061] In this way, the user who watches the video becomes a viewing user, and the terminal at which the video is watched becomes the second user terminal 200.

[0062] 5, the top screen T10 may display a display field T13 for announcements such as campaigns and events. This announcement display field T13 can be switched to display other announcements by sliding the display field.

[0063] The top screen T10 displays a follow tab T14, a game tab T15 for displaying game categories, a collaboration waiting tab T16 for displaying distribution channels waiting for collaboration, and a beginner tab T17 for displaying distribution channels for beginners. By selecting these (by switching tabs), the top screen T10 transitions to each of the different screens.

[0064] The service name display T18 and search button T19 in the upper frame of the top screen T10 may remain fixed and displayed on the transition destination screen.

[0065] Similarly, the home button T20, message button T21, distribution preparation button T22, gacha button T23, and profile button T24 in the bottom frame of the top screen T10 may also be fixed and remain displayed on the transition destination screen.

[0066] On the top screen T10 shown in Figure 5, for example, a user who selects a displayed thumbnail image T12 can become a viewing user (second user) who watches the video as described above, and a user who selects the distribution preparation button T22 can become a distribution user (first user) who distributes the video.

[0067] As an example, when the distribution preparation button T22 is selected on the top screen T10 shown in Fig. 5, the screen transitions to the avatar setting screen D10 shown in Fig. 6. Then, when the distribution button D11 is selected on the avatar setting screen D10, the screen transitions to the distribution setting screen D20 shown in Fig. 7. Then, when the distribution start button D25 is selected on the distribution setting screen D20, the screen transitions to the avatar distribution screen D30 shown in Fig. 8.

[0068] Next, we will explain the details of the flow up to the start of video distribution.

[0069] The one or more computer processors in the present disclosure may include a distribution start request receiving unit, a distribution setting unit, and a distribution start unit.

[0070] The distribution start request receiving unit receives a request to start distribution of a first moving image including animation of a character object from a broadcast user terminal of a broadcast user.

[0071] Here, the first moving image refers to a moving image including animation of a character object. In this specification, a character object may also be called an "avatar."

[0072] The distribution start request can be transmitted from the user terminal (later becoming the distribution user terminal 2100) to the information processing device 2400 by selecting a distribution button D11 located on an avatar setting screen or the like transitioned from the above-mentioned top screen displayed on the user terminal that has launched a dedicated application (video distribution / viewing application) for accessing the video distribution platform.

[0073] 6 shows an example of an avatar setting screen D10. The avatar setting screen D10 can display a character object CO, a distribution button D11, a gacha button D12, a change of clothes button D13, a photo button D14, and the like.

[0074] When the user selects the change clothes button D13, a closet screen appears for selecting various avatar parts of the character object CO, such as eyes, nose, mouth, hair, accessories, clothes, and background.

[0075] When the user selects the gacha button D12, a lottery screen for obtaining the avatar parts appears.

[0076] When the user selects the photo button D14, a photography screen for taking a still image of the character object appears.

[0077] When the user selects the distribution button D11, a distribution start request is transmitted to the information processing device 2400 (server device 400).

[0078] The distribution setting unit sets the distribution settings of the first moving image based on the instructions from the broadcaster user terminal 2100 in response to the distribution start request for the first moving image received by the distribution start request receiving unit.

[0079] As an example, when the broadcast button D11 is selected, the screen displayed on the broadcast user terminal 2100 transitions from the avatar setting screen D10 shown in FIG. 6 to the broadcast setting screen D20 shown in FIG.

[0080] The distribution settings can include at least one of settings regarding the title of the first video, settings regarding whether other users can appear in the first video, settings regarding the number of people who can appear in the first video, and settings regarding a password.

[0081] These distribution settings can be set in a title setting field D21, a collaboration permission setting field D22, a number of people setting field D23, and a password setting field D24 in Fig. 7. Furthermore, Fig. 7 also displays a collaboration permission setting field D26 for anyone and a SNS posting permission field D27.

[0082] The title of the first video can be freely determined by the broadcaster within the range of the maximum number of characters allowed. If there is no input from the broadcaster, a pre-set title including the name of the broadcaster or character object, such as "This is XXX's broadcast," may be automatically determined.

[0083] The broadcasting user can freely decide whether or not other users can appear in the first video. If yes, other users can make an appearance request to the broadcasting user, and if no, other users cannot make an appearance request to the broadcasting user. The state in which other users appear in the broadcasting user's video is sometimes referred to as "collaboration" in this specification. Details of collaboration will be described later.

[0084] The number of people who can appear in the first video can only be set if other users are allowed to appear in the first video as described above, and can be freely determined by the distribution user within the range of the maximum number of people allowed.

[0085] The password can be set arbitrarily only if other users are allowed to appear in the first video, and the distribution user can freely set a number with a specified number of digits. When other users request to appear in the first video, they are required to enter the password. Note that the password setting field D24 may be configured to be active only when the collaboration setting field D26 for anyone is OFF.

[0086] The distribution starting unit distributes information about the first moving image to the viewing user terminal 2200 of the viewing user based on the conditions set by the distribution setting unit.

[0087] Such a distribution start instruction is sent by selecting the distribution start button D25 shown in FIG.

[0088] As an example, the distribution starting unit distributes information about a video (first video) including animation of the distributor user's character object to the viewing user terminal 2200 of the viewing user (avatar distribution).

[0089] The information about the first video includes, for example, motion information indicating the movement of the character object, voice information of the broadcasting user, gift object information indicating gifts sent by other viewing users, etc. The gift object information includes at least gift object identification information that specifies the type of gift object and position information that indicates the position where the gift object is displayed.

[0090] The distribution starting unit can then live-distribute the video via the video distribution platform described above.

[0091] FIG. 8 shows an avatar distribution screen D30 displayed on the broadcaster user terminal 2100.

[0092] The avatar distribution screen D30 displays a character object CO, as well as a comment input button D31 for the distribution user to enter a comment, a photo button D32 for saving a still image of the screen, a start play button D33 for playing the game described below, an external service linkage button D34 for watching videos provided by an external service, and a gacha button D12 for obtaining avatar parts.

[0093] Also, at the top of the avatar distribution screen D30, a cumulative viewer count display D35, a cumulative like count display D36, a collaborator count display D37, a share button D38 for external SNS, a guest details button D39, a ranking display button D40, a settings button D41, and an audio switch button D42 for switching audio ON / OFF can be displayed. Also, an end button D43 for ending distribution is displayed.

[0094] Detailed description of these displays and buttons will be omitted, but by selecting the setting button D41, it is possible to change the distribution settings made on the distribution setting screen D20.

[0095] 8 shows an example in which distribution has been started on distribution setting screen D20 with other users allowed to appear in the first video and the maximum number of people who can appear in the first video set to three, so character object CO is displayed in a position shifted to the bottom left. Up to three character objects of other users can appear in the empty space.

[0096] This concludes the description of the screen transitions when delivering an avatar according to the invention of the present disclosure.

[0097] Next, the screen transitions that occur when a broadcaster user plays a game during broadcasting will be described.

[0098] The one or more computer processors in the present disclosure may include a game request receiving unit, a game video distribution unit, and a game display processing unit.

[0099] During avatar distribution as shown in FIG. 8, the broadcasting user can request to start playing the game by selecting the start play button D33.

[0100] Note that the game displayed upon selection of the start play button D33 is a dedicated game implemented in an application realized by the information processing system of the present disclosure, and may be different from general-purpose games provided by external services. Therefore, game distribution in the present disclosure may be distinguished from distribution of gameplay videos of general-purpose games provided by external services along with commentary by the distributor user.

[0101] Alternatively, the request to start play can be sent from the broadcast user terminal 2100 to the information processing device 2400 by selecting a start play button located on a specified screen displayed on the broadcast user terminal 2100 of the broadcast user.

[0102] Fig. 9 shows an example of a screen G10 on which a play start button G11 is arranged as the predetermined screen. The screen G10 shown in Fig. 9 is a screen transitioned to by selecting a game tab T15 from a top screen T10 (Fig. 5) displayed on a user terminal that has started an application realized by the information processing system of the present disclosure.

[0103] The screen G10 displays at least a play start button G11 that can send a request to start playing a predetermined game.

[0104] Then, when the game request receiving unit receives a request to start playing a predetermined game, the game video distribution unit distributes information about the second video to the viewing user terminal.

[0105] Here, the second video is a video of a game being played in a predetermined game. In this specification, the delivery of such a video so that it is displayed on the screen of the viewing user terminal 2200 is referred to as "game delivery."

[0106] Furthermore, after launching the application realized by the invention of the present disclosure, the user can, as a distribution user, send a request to start distribution of the second video to the information processing device 2400 by selecting a play start object placed on the game list screen and the game details screen.

[0107] The game list screen or game details screen is the first screen, which will be described in detail next.

[0108] That is, the game display processing unit performs display processing of a first screen including a distribution start object capable of sending a distribution start request, a play start object capable of sending a request to start playing a specified game, and a thumbnail image of a video of a gameplay video of a specified game currently being distributed.

[0109] 9 corresponds to the game list screen of the first screen. The first screen, which is the game list screen, is a screen transitioned to by selecting the game tab T15 from the top screen T10.

[0110] The first screen includes a distribution preparation button T22 as a distribution start object, a play start button G11 as a play start object, and thumbnail images indicating distribution channels for the video.

[0111] The first screen displays, for each of the multiple playable games, a start play button G11, a game icon G12, the game name G13, the total number of viewers of the game's distribution channel G14, and a distribution list G15 including thumbnail images of the distribution channels currently distributing the game.

[0112] The order of thumbnail images displayed in the distribution list G15 can be different for each viewing user. As an example, the order is arranged in descending order of priority, such as the number of views by the viewing user who follows the images, the cumulative number of viewers, or the oldest distribution start date. The display range of the thumbnail images in this distribution list G15 can be changed by scrolling horizontally.

[0113] The games displayed on this game list screen are the top 10 titles with the following priorities: For example, the priorities are determined by the most recent date the viewing user last played within 48 hours of the game distribution start date and time within the last 30 days, the highest priority period ID, and the lowest priority period ID.

[0114] This distribution list G15 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.

[0115] 10 corresponds to the game details screen of the first screen. The first screen, which is the game details screen, is G20, which is the screen transitioned to by selecting the game icon G12 or game name G13 displayed on the game list screen shown in FIG.

[0116] The first screen includes a distribution preparation button T22 which is a distribution start object, a play start button G21 which is a play start object, and thumbnail images which indicate distribution channels for the video.

[0117] The first screen also displays a game icon G22, a game name G23, the total number of viewers of the game's distribution channel G24, and a distribution list G25 including thumbnail images of distribution channels currently distributing the game.

[0118] The order of thumbnail images displayed in the distribution list G25 can be different for each viewing user. For example, the order is arranged in descending order of priority, such as the number of views by the viewing user who follows the images, the number of cumulative viewers, or the oldest distribution start date. The display range of the thumbnail images in this distribution list G25 can be changed by vertical scrolling.

[0119] This distribution list G25 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.

[0120] As described above, a user who selects a distribution start object or a play start object becomes a distribution user who makes a distribution start request or a play start request.

[0121] Furthermore, the user who selects the thumbnail image becomes a viewing user who views the second moving image.

[0122] The first screen also includes a first area where scrolling is not possible and a second area where scrolling is possible.

[0123] The first screen here refers to the first screen shown in Fig. 10. The first screen includes a first area R1 and a second area R2. Specifically, the first area R1 displays the game title, and the second area R2 displays the above-mentioned start play button G21, game icon G22, game name G23, viewer count G24, and distribution list G25.

[0124] The first area R1 is a fixed area on the display screen that cannot be scrolled, while the second area R2 is an area that can be scrolled by the user. By scrolling the second area R2, the user can view thumbnail images that are hidden off-screen.

[0125] However, since there is a risk that the play start button G21 will be hidden off the screen when the second area is scrolled, the display processing unit in the present disclosure can display the play start object (play start button G21) in the first area R1 depending on the display state of the play start object (play start button G21) displayed in the second area R2.

[0126] As an example, the play start button G21 is displayed in the second area R2 in Fig. 10, but is displayed in the first area R1 in Fig. 11. In other words, when part or all of the play start button G21 is no longer displayed in the second area R2, the play start button G21 appears in the first area.

[0127] The game display processing unit may also display the play start object in the first area R1 in stages according to the display state of the play start object displayed in the second area R2.

[0128] Such an expression can be realized by changing the transparency of the play start object in accordance with the amount of scrolling of the second region R2.

[0129] As an example, the scroll amount (unit: pixels) 0 to 50 corresponds to the button transparency from 0.0 (completely transparent) to 1.0 (completely opaque). In this case, the object is completely transparent in the initial display state and is therefore invisible, but when scrolled 50 pixels or more, the object becomes completely visible. It is preferable to change the object's transparency linearly in this range (0 to 50). Note that the unit of the scroll amount is logical pixels, which may differ from the actual pixels on the display.

[0130] Furthermore, the game request receiving unit is capable of receiving a request to end play of a predetermined game from the broadcast user terminal 100 after the game video distribution unit has distributed information about the second video.

[0131] A request to end play can be sent by selecting the end button located on the game screen.

[0132] Then, when the game request receiving unit receives a request to end play of a predetermined game, the video distribution unit can end distribution of information about the second video and distribute information about the first video.

[0133] In other words, what is distributed here is not just a portion of the information about the first moving image, but the entire information about the first moving image.

[0134] Then, when the video distribution unit finishes distributing information about the second video and distributes information about the first video, it is assumed that the first video is displayed on the viewing user terminal 2200.

[0135] Next, the flow for starting to watch a video will be explained.

[0136] The one or more processors in the present disclosure may further include a viewing acceptance unit.

[0137] The viewing acceptance unit accepts a request to view a video from a user.

[0138] In response to a viewing request, the video distribution unit distributes information relating to video and audio as video information to the user's information processing terminal.

[0139] FIG. 12 shows an example of a viewing screen V10 of an avatar video displayed on the viewing user terminal 2200.

[0140] A viewing user can post a comment by entering text in the comment posting field V11 and pressing the send button V12.

[0141] Furthermore, by pressing the gift button V13, a gift list (screen V30 in FIG. 13) is displayed to the viewing user, and a display request for a specified gift can be sent by selection.

[0142] In this case, one or more processors in the present disclosure may include a determination unit that determines whether or not a gift display request has been made from the viewer user terminal 2200.

[0143] The display request may include gift object information, which includes at least gift object identification information that identifies the type of the gift object and location information that indicates the location where the gift object is to be displayed.

[0144] As shown in FIG. 13, gifts can be displayed by classification (free (paid) gifts, accessories, support goods, appeals, variety, etc.).

[0145] Here, a paid gift is a gift that can be purchased by consuming My Coins purchased by the viewing user, and a free gift is a gift that can be obtained by consuming My Points obtained for free by the viewing user, or without consuming them.

[0146] It should be noted that the term "gift" used in this application has the same concept as the term "token." Therefore, the technology described in this application can be understood by replacing the term "gift" with the term "token."

[0147] Furthermore, the viewing user can post a rating that shows a favorable opinion by pressing the like button V14. Note that in addition to / instead of the like button V14, it is also possible to display a button for posting a negative rating or other emotions.

[0148] Additionally, if the broadcasting user has set the option to allow other users to appear in the video in their broadcast settings, they can send a request to appear in the video by selecting the collaboration request button V15.

[0149] Additionally, a follow button V16 is displayed on the screen of a video distributed by a distributor that the viewing user is not yet following. This follow button functions as an unfollow button on the screen of a video distributed by a distributor that the viewing user is already following.

[0150] Note that this "following" may be from viewing user to viewing user, from broadcasting user to viewing user, or from broadcasting user to broadcasting user. However, following is managed as a one-way association, and associations in the reverse direction are managed separately as followers.

[0151] A photo button V25 for saving a still image of the screen may also be displayed.

[0152] Additionally, the viewing screen V10 also displays a support ranking display button V17, a share button V18, and a ranking display button V19.

[0153] The support ranking displays a ranking of viewing users who are supporting a broadcaster user, and the ranking can be calculated according to the amount of the gift (points / coins) or the like.

[0154] In addition, when sharing videos, viewers can press the share button V18 to see a list of SNS (social networking services) on which the video can be shared, and by selecting it, they can send a fixed link to a specified location on the specified SNS.

[0155] Additionally, by pressing the collaboration request button V15, a collaboration broadcast can be requested from the broadcasting user. Collaborative broadcasting refers to having a character object of the viewing user appear in the broadcasting user's broadcast video.

[0156] At the top of the viewing screen V10, a broadcasting user icon V21, a broadcasting user name (character object name) V22, a cumulative viewer count display V23, and a cumulative like count display V24 can be displayed.

[0157] Furthermore, when the viewing end button V20 is selected, a screen for ending viewing appears, allowing a viewing end request to be sent.

[0158] The screen for ending such viewing will be explained in detail below. This screen is called "small window audio distribution" and is used for viewing in a mode where only the audio is played back without displaying the video image.

[0159] Selection of the above-mentioned viewing end button V20 is accepted by the viewing acceptance unit as a request to end viewing of the video.

[0160] At this time, the video distribution unit ends the distribution of information related to the video in response to the request to end viewing, but does not end the distribution of information related to the audio.

[0161] When information about video and audio is distributed to the user terminal, the video is displayed on the main screen of the user terminal, and when information about audio only is distributed, the video is not displayed on the user terminal but a sub-screen indicating that a video is being viewed is displayed.

[0162] FIG. 14 shows an image of the screen V50 on which the sub-screen V51 is displayed.

[0163] When this sub-screen V51 is displayed, the main screen displayed in the background transitions to the screen before watching the video. For example, if you move from the recommendation tab to the viewing frame, it will return to the recommendation tab display, and if you move from the follow tab to the viewing frame, it will transition to the follow tab.

[0164] When this sub-screen V51 is displayed, operations on the main screen are possible, and transitions to other screens are possible.

[0165] The sub-screen V51 displays a profile picture, name, title, and an audio icon that visually indicates that audio is being played.

[0166] Then, by selecting the end icon V52 displayed on the sub-screen V51, the viewing can be completely ended.

[0167] Regarding the termination of the video display, the server device may transmit information but not display it on the terminal side, or the server device may stop transmitting information altogether.

[0168] With this configuration, it becomes possible to search for other broadcasts and enjoy chatting with other users while listening to only the audio.

[0169] Next, we will explain "collaboration," in which other users appear in a video of a broadcasting user.

[0170] As described above, the viewing user can transmit a request to participate in the video via the collaboration distribution participation request confirmation screen that is displayed by pressing the collaboration request button V15 shown in FIG.

[0171] In the present disclosure, the collaboration avatar display unit provided in one or more computer processors displays, in response to the participation request received by the reception unit, a character object generated based on the movement of the viewing user who made the participation request in the video.

[0172] 15 shows an example of a viewing or distribution screen in which a second avatar A2, a character object of a guest user, is participating in a video in which a first avatar A1, a character object of a host user, is displayed. Note that in FIG. 15, the display of objects other than the avatars is omitted.

[0173] Furthermore, as shown in Fig. 16, a third avatar A3, which is a character object generated based on the movement of another viewing user, may also participate in the video. Note that, although the third avatar A3 is placed behind the first avatar A1 and the second avatar A2 in Fig. 16, the three may also be placed in a horizontal line. The placement position of the avatar may also be specified by the distributing user.

[0174] Fig. 17 shows a list screen T30 of users who have mutual follow relationships, which is displayed by selecting the Follow tab on the top screen shown in Fig. 5. Mutual follow refers to a relationship in which both users are followers of each other.

[0175] This list screen T30 displays the profile images and names of users with whom a user has a mutual follow relationship.

[0176] 17, the list screen T30 displays a first object T31 for each user who has a mutual follow relationship. A chat object T32 may also be displayed together with the first object T31. By selecting this chat object, the user can transition to an individual chat screen with the second user.

[0177] The first object T31 transmits a predetermined notification to the terminal of the user associated with the first object T31.

[0178] The predetermined notification may be, for example, a call notification.

[0179] First Embodiment Next, various functions that can be executed by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the first embodiment of the present disclosure will be described with reference to the drawings.

[0180] The one or more computer processors included in the information processing system 3000 according to the first embodiment of the present disclosure include a transmitting unit 411, a receiving unit 412, a first video generating unit 413, a second video generating unit 414, and a video switching unit 415, as shown in FIG. 18.

[0181] Here, the explanation will be given assuming that the above-mentioned transmitting unit 411, receiving unit 412, first moving image generating unit 413, second moving image generating unit 414 and moving image switching unit 415 are all provided in the server device 400, but this is not limited to this.

[0182] The transmission unit 411 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user.

[0183] The moving image may be a moving image including a character object CO of the first user, as shown in FIG. 19 as an example.

[0184] The information regarding the video may be information that enables the video to be viewed on the second user terminal 200, and rendering of the video may be performed on the server device 400 or the first user terminal 100, or may be performed on the second user terminal 200.

[0185] At least the facial portion of the character object CO included in the video may reflect the facial movements of the first user captured by a camera (here, as an example, the in-camera) provided in the first user terminal 100.

[0186] The receiving unit 412 receives a request to display the first object from the second user terminal 200.

[0187] As an example, the first object may be the gift object described above. As shown in Figures 13 and 20, the second user can send a display request for a desired gift object from the gift list screen V30 displayed on the second user terminal 200. The points (P, pt) shown in the figures are available to the user for free as rewards or events in the system, and the coins (C) shown in the figures are available to the user for a fee by purchasing them.

[0188] The first moving image generating unit 413 generates first information for displaying the character object of the first user and the first object in a first area in the virtual space as a first moving image.

[0189] The first information differs depending on the content of the video, but as an example, in the case of a video in which the broadcasting user's character object appears as described above, it includes motion information indicating the character object's movements, voice information of the broadcasting user, gift object information indicating gifts sent by viewing users, etc. The gift object information includes at least gift object identification information that specifies the type of gift object and location information that indicates the location where the gift object is displayed.

[0190] Fig. 19 shows an image of a screen V10 displaying a first moving image displayed on the display unit of the first user terminal 100 and / or the second user terminal 200. The screen V10 shown in Fig. 19 includes at least a character object CO and a first object G1. Although omitted in Fig. 19, various displays and operation UIs may be displayed superimposed on each other, as shown in Figs. 8 and 12.

[0191] The second video generation unit 414 generates second information for displaying a second object S1 different from the first object G1 in a second area in the virtual space as the second video, and for displaying the first user's character object CO movably between the first area and the second area.

[0192] Unlike the first object G1, the second object S1 is not displayed in response to a display request from the second user terminal 200, but the display position and timing of the second object S1 are controlled by the server device 400 (system side).

[0193] Fig. 21 shows an image of a screen V40 displaying the second moving image displayed on the display unit of the first user terminal 100 and / or the second user terminal 200. The screen V40 shown in Fig. 21 includes at least a character object CO and a second object S1. Although omitted in Fig. 21, various displays and operation UIs may be displayed superimposed on each other, as shown in Figs. 8 and 12.

[0194] Here, the image of the expansion of the virtual space in this disclosure will be described in detail with reference to FIG.

[0195] As shown as an example in Figure 22, the virtual space in this embodiment is arranged with a disk-shaped island (world) floating in the air. This island is an object that resembles an upside-down tower-shaped cake, and various objects can be arranged on the disk-shaped ground. Note that this island and ground are shown as examples, and their display modes are not particularly limited.

[0196] As the objects, at least the above-mentioned character object CO, first object G1 and second object S1 can be displayed.

[0197] In this way, what is provided as the content of the second moving image is a "world," and this "world" is developed by executing the above-mentioned "world function."

[0198] Fig. 23 is a top view of the ground shown in Fig. 22, and is an image diagram for explaining the first area and the second area in the above configuration. Note that each object is drawn as seen from the front for ease of viewing.

[0199] As shown in FIG. 23, the areas in which the character object CO can move can be defined as a first area R10 and a second area R20 in the virtual space.

[0200] The first region R10 and the second region R20 may be continuous regions, and there are no particular limitations on their positional relationship or shape.

[0201] As an example, the first video is generated as an image of a first region R10 captured from the position of a virtual camera VC1 shown in Fig. 24 (Fig. 19). Note that the position and orientation of this virtual camera VC1 can be changed within a predetermined range by the operation of the first user.

[0202] As an example, the second video is generated as an image of the first region R10 and / or the second region R20 captured from the position of the virtual camera VC2 shown in Fig. 25 (Fig. 21). Note that the position and orientation of this virtual camera VC2 can be changed by the operation of the first user, but the virtual camera basically moves in accordance with the movement of the character object CO. The method of operating the virtual camera VC2 will be described in detail later.

[0203] In this way, the first video and the second video can be videos taken in the same virtual space (world). Alternatively, the first video and the second video can be videos taken in different virtual spaces. In this case, the second video is a video taken in the world.

[0204] In addition, the first user's room, which is the first user's private space in the virtual space, may be set as the first area, and the area outside the room, which is the public space, may be set as the second area, and the user may be able to move between these areas.

[0205] The video switching unit 415 is characterized in that it switches the video to be displayed on the second user terminal 200 between the first video and the second video in response to an instruction from the first user terminal 100 of the first user.

[0206] The instruction can be transmitted to the server device 400 by operating a predetermined operation UI displayed on the first video and the second video displayed on the first user terminal 100.

[0207] As an example, switching from the first video to the second video / from the second video to the first video can be performed by selecting a switching button displayed on the first video and the second video.

[0208] If the world function as the second video is provided as one of the games described above, the above-described game distribution start and end procedures can be applied.

[0209] Specifically, switching from the first video to the second video can be performed by selecting the play button D33 (Figure 8) of the game displayed in the first video or the play button G11, G21 (Figures 9, 10) of one of the games selected from the list of games displayed on the screen to which the transition is made by selecting the play button D33.

[0210] Moreover, switching from the second moving image to the first moving image can be performed by selecting the play end button V41 (FIG. 21, etc.) displayed on the second moving image.

[0211] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0212] Specifically, first, the presence of two types of video, the first video and the second video, increases the interest of the video.

[0213] In particular, the virtual world "World" that serves as the setting for the second video is filled with attractive second objects that fit the theme, and the character objects can be moved freely to generate videos from any location and viewpoint, making it possible to generate videos that reflect the user's individuality more than the first video.

[0214] In addition, by generating videos of people exploring the world, it becomes easier to create topics of conversation and comments.

[0215] Furthermore, by being able to switch between these two types of video, it is possible to extend the distribution time.

[0216] In this way, the existence of two types of video, the first video and the second video, and the ability to switch between them improves the quality of the video content compared to conventional methods.

[0217] Furthermore, as the quality of video content improves, users' willingness to watch the video also increases, and as the number of users watching increases, users' willingness to distribute the video also increases.

[0218] Furthermore, as the willingness to distribute and view increases, communication between distribution users and viewing users, as well as communication between distribution users and viewing users, will become more active.

[0219] The virtual space displayed by executing the world function described above has been described as a space for distributing the second video, but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can walk around freely and communicate with each other, rather than being limited to a space for distributing the second video.

[0220] One of the avatars (first user) in the virtual space may be configured to broadcast a first video as a broadcasting user. In other words, the information processing system of the present disclosure enables one-to-many video broadcasting in a many-to-many metaverse virtual space.

[0221] Next, other application examples of the first embodiment will be described.

[0222] When the video switching unit 415 switches the video from the first video to the second video, the second video generation unit 414 can generate the second information while maintaining the display of the already displayed first object G1 in the first area.

[0223] Specifically, the first object G1 (apple object) displayed on the first video screen V10 shown in Figure 19 continues to be displayed even when it changes to the second video screen V40 shown in Figure 21.

[0224] When the video switching unit 415 switches the video from the second video to the first video, the first video generation unit 413 can generate the first information while maintaining the display of the already displayed first object G1 in the first area.

[0225] Specifically, the first object G1 (apple object) displayed on the second video screen V40 shown in Fig. 21 continues to be displayed even when the screen changes to the first video screen V10 shown in Fig. 19. At this time, not only the first object G1 displayed in the first area, but also the first object G1 displayed in the second area can be configured to change its display position and continue to be displayed.

[0226] Note that the display of the first object G1 is controlled based on the display time set for each first object G1, and therefore the display of the first object G1 ends when the display time has elapsed since the start of display. A request to display the first object G1 can be made while the first video or the second video is being displayed, and in either case, the display of the first object G1 continues until the display time has elapsed, regardless of whether the video is switched midway. In other words, the display time of the gift deposited by the viewing user is not changed by the operation (action) of the broadcasting user, so the viewing user who deposited the gift by consuming coins or the like will not be dissatisfied.

[0227] The second moving image generating unit 414 can change at least the second object S1 to another second object S1 based on a predetermined condition.

[0228] 21 and 22, the second objects S1 are, for example, a dog object, a pumpkin object, a tower cake object, etc., but as for these second objects S1, at least the dog object and the pumpkin object can be changed to a jellyfish object and a fish object, as shown in FIGS. 26 and 27. Also, there may be second objects S1 that do not change, such as tower cake objects. In the present disclosure, changing such second objects S1 is referred to as changing the theme.

[0229] The predetermined condition may be the arrival of a scheduled time, the lapse of a scheduled time, or the receipt of a change instruction from the first user or another user.

[0230] If the predetermined condition is the arrival of a scheduled time, the second video generation unit 414 changes the second object to another second object when the scheduled time arrives, regardless of the distribution start time of the video. As an example, the scheduled time can be set to regular intervals such as 10:20, 10:40, and 11:00. The scheduled time can also be set to morning (6:00), afternoon (12:00), or night (18:00). Note that this time may be changed according to the actual times of sunrise and sunset.

[0231] Furthermore, the arrival of the scheduled time also includes the arrival of the scheduled date and time. In this case, the second video generation unit 414 changes the second object to another second object when the scheduled date and time arrives, regardless of the distribution start time of the video. As an example, the scheduled date and time can be the start date and time of an event, such as October 31st, 0:00 (Halloween), December 25th, 0:00 (Christmas), or January 1st, 0:00 (New Year's Day).

[0232] If the predetermined condition is the passage of a scheduled time, the second video generation unit 414 changes the second object to another second object when the scheduled time has passed since the start time of the video distribution. As an example, the scheduled time may be a fixed interval such as 20 minutes, 40 minutes, or 60 minutes from the start of distribution.

[0233] If the predetermined condition is that a change instruction has been received from the first user or another user, the second video generation unit 414 changes the second object to another second object when a change instruction is received from the first user or another user during video distribution. As an example, the change instruction can be made by selecting a change instruction object displayed on the screen. Note that the other users referred to here include not only viewing users but also guest users, which will be described later.

[0234] If the predetermined condition is the arrival of a scheduled time or the passage of a scheduled time, the scheduled time or the time until the second object is changed may be displayed within the video.

[0235] Furthermore, even if the second object S2 is changed to another second object S2, the second video generation unit 414 can generate the second information while maintaining the display of the already displayed first object G1 in the first area or the second area.

[0236] Specifically, the first object G1 (apple object) displayed on the second video screen V40 shown in Figure 21 continues to be displayed even when it changes to the second video screen V40 shown in Figure 26.

[0237] Since the display of the first object G1 is controlled based on the display time set for each first object G1, the display of the first object G1 ends when the display time has elapsed from the start of display. The display of the first object G1 continues until the display time has elapsed, regardless of whether the second object S1 has changed.

[0238] Furthermore, as shown in FIG. 28, one or more computer processors in the present disclosure may further include an effect generation unit 416.

[0239] The effect generating unit 416 generates a predetermined effect when an already displayed first object G1 or a newly displayed first object G1 has a specific relationship with a second object S1.

[0240] Specifically, the presence or absence of the specific relationship is determined based on combination data previously stored in a predetermined storage unit. As an example, an identification number and / or attribute information is associated with each of the first object and the second object, and if these match or are associated, it is determined that there is a specific relationship.

[0241] The attribute information includes, for example, attributes relating to seasons (summer, winter, etc.), attributes relating to events (Halloween, Christmas, New Year's holidays, etc.), attributes relating to locations (sea, space, sky, etc.), and the like.

[0242] The timing of the above determination can be the timing when a request to display the first object is received, the timing when the first object is displayed, or the timing when the second object is changed to another second object.

[0243] The predetermined effect may be, for example, but is not limited to, displaying another object, generating a sound effect, etc. The other object may be, for example, a confetti object, a cracker object, a paper balloon object, or another effect object.

[0244] Moreover, as shown in FIG. 28, one or more computer processors in the present disclosure may further include a movement operation receiving unit 417 and a virtual camera control unit 418.

[0245] The movement operation receiving unit 417 receives an operation to move the character object of the first user in the virtual space. Details of the movement operation will be described later.

[0246] The virtual camera control unit 418 controls the operation of the virtual camera that takes pictures in the virtual space. Details of the operation control will be described later.

[0247] Furthermore, in an embodiment of the present disclosure, the movement of the face of the character object of the first user can be generated based on the movement of the face of the first user captured by the in-camera of the first user terminal 100.

[0248] The first moving image generating unit 413 can generate the facial movement of the character object of the first user in an inverted state that is the inverse of the facial movement of the first user.

[0249] Specifically, when the first user winks with his right eye, the character object of the first user winks with his left eye. Since the first user broadcasts while looking at the face of the character object displayed on the first user terminal 100, by setting the display to an inverted state (mirror display), the first user can broadcast with an intuitive feeling (operation) as if looking in a mirror. Note that a non-inverted state in which the left and right sides are not inverted (i.e., a state in which the character object winks with its right eye when the first user winks with its right eye) creates an awkward feeling and makes it difficult to operate with an intuitive feeling.

[0250] The second video generation unit 414 can generate the facial movement of the first user's character object in an inverted or non-inverted state depending on the positional relationship between the first user's character object and the virtual camera.

[0251] As an example, when the virtual camera is positioned within the range in front of the first user's character object (for example, within a range of 90 degrees left and right from the front of the character object), the facial movement of the character object is generated in an inverted state, and when the virtual camera is positioned outside the range in front of the first user's character (for example, within a range exceeding 90 degrees left and right from the front of the character object), the facial movement of the character object is generated in a non-inverted state.

[0252] Specifically, if the virtual camera is determined to be located within the front range of the first user's character object, when the first user winks with their right eye, the first user's character object will wink with their left eye. Conversely, if the virtual camera is determined to be located beyond the front range of the first user's character object, when the first user winks with their right eye, the first user's character object will wink with their right eye.

[0253] In the above example, the movement of the face has been described, but the same control method can be used for the movement of the head and arms.

[0254] This can eliminate the sense of incongruity that may arise from the positional relationship between the virtual camera and the character object.

[0255] The inverted state and the non-inverted state may be switched by an instruction from the first user.

[0256] Furthermore, if the character object of the first user moves beyond the movable area, the second moving image generating unit 414 can make the character object reappear at another position within the virtual space.

[0257] In a virtual space such as that shown in Figures 22 and 27, if a character object moves beyond the edge of the disk-shaped ground, the character object can be made to fall to the bottom of the tower and reappear by descending from the top center of the disk-shaped ground. By making the reappearance position the center, it is convenient for the character object to move in any direction within the world. Also, if the character object gets lost within the world, it can return to the reference central position.

[0258] As described above, the configuration of the first embodiment can provide technical improvements that solve or alleviate at least some of the problems of the conventional technology described above. Specifically, the configuration can improve the distribution users' motivation to distribute, the viewing users' motivation to watch, and / or the users' motivation to interact with each other.

[0259] Second Embodiment Next, various functions that can be executed by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the second embodiment of the present disclosure will be described with reference to the drawings.

[0260] The one or more computer processors included in the information processing system 3000 according to the second embodiment of the present disclosure include a transmitting unit 421, a receiving unit 422, a first moving image generating unit 423, and a second moving image generating unit 424, as shown in FIG.

[0261] Here, the description will be given assuming that the sending unit 421, the receiving unit 422, the first moving image generating unit 423, and the second moving image generating unit 424 are all included in the server device 400, but this is not limiting.

[0262] The transmission unit 421 transmits information about a moving image including a character object of the first user to the second user terminal 200 of the second user. The transmission unit 421 can have the same configuration as the transmission unit 411 described above.

[0263] The receiving unit 422 receives a request to display the first object from the second user terminal 200. The receiving unit 422 can have the same configuration as the receiving unit 422 described above.

[0264] The first moving image generation unit 423 generates first information for displaying the character object of the first user and the first object in a first area in the virtual space as a first moving image. The first moving image generation unit 423 can have the same configuration as the first moving image generation unit 413 described above.

[0265] The second moving image generation unit 424 generates second information for displaying, as the second moving image, a second object S1 different from the first object G1 in a second area in the virtual space and displaying the first user's character object CO movably between the first area and the second area. The second moving image generation unit 424 can have a configuration similar to that of the second moving image generation unit 424 described above.

[0266] The second video generation unit 440 is characterized in that, based on the placement position information associated with the first object G1, the first object G1 is displayed at a predetermined position in the first area R10 (e.g., Figure 23) or at a position associated with the first user's character object CO.

[0267] As described in the explanation of the gift object, the first object information of the first object G1 includes position information (placement position information) indicating the position where the first object G1 is displayed.

[0268] As an example, the placement position information of the first object G1 defines the coordinates of a predetermined position (predetermined area) in the first area R10, or a part of the character object CO of the first user.

[0269] In the present disclosure, the first object G1 having the former arrangement position information is referred to as a non-attached object, and the first object G1 having the latter arrangement position information is referred to as an attached object.

[0270] The appearance position (display start position) of the first object G1 may be different from the above-mentioned arrangement position.

[0271] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0272] Specifically, first, the presence of two types of video, the first video and the second video, increases the interest of the video.

[0273] In particular, the virtual world "World" that serves as the setting for the second video is filled with attractive second objects that fit the theme, and the character objects can be moved freely to generate videos from any location and viewpoint, making it possible to generate videos that reflect the user's individuality more than the first video.

[0274] In addition, by generating videos of people exploring the world, it becomes easier to create topics of conversation and comments.

[0275] Furthermore, by making it possible to display the first object not only in the first video but also in the second video, it becomes possible to provide the first video and the second video without unnecessarily reducing the viewing user's motivation to gift.

[0276] In this way, the existence of two types of videos, the first video and the second video, and gifting improve the quality of the video content more than ever before.

[0277] Furthermore, as the quality of video content improves, users' willingness to watch the video also increases, and as the number of users watching increases, users' willingness to distribute the video also increases.

[0278] Furthermore, as the willingness to distribute and view increases, communication between distribution users and viewing users, as well as communication between distribution users and viewing users, will become more active.

[0279] The virtual space displayed by executing the world function described above has been described as a space for distributing the second video, but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can walk around freely and communicate with each other, rather than being limited to a space for distributing the second video.

[0280] One of the avatars (one user) in the virtual space may be configured to broadcast a first video as a broadcasting user. In other words, the information processing system of the present disclosure enables one-to-many video broadcasting in a many-to-many metaverse virtual space.

[0281] When displaying the first object G1, the second moving image generating unit 424 can display a system comment indicating that the first object G1 is displayed in the second moving image.

[0282] Alternatively, when the second video generation unit 424 receives a request to display the first object G1, it can display a system comment in the second video indicating that a request to display the first object G1 has been made (that a gift has been received).

[0283] 30 and 31 show how comments from the first user, the second user, and / or the system are displayed on a screen V40 displaying the second moving image displayed on the first user terminal 100 and / or the second user terminal 200. Although omitted in Fig. 30 and 31, various displays and operation UIs may be displayed superimposed on each other, as shown in Fig. 8 and 12.

[0284] In the example shown in FIGS. 30 and 31, a comment "I gave you 3 bananas, Mr. / Ms. XXX" is displayed as a system comment indicating that the first object G1 (banana object) is being displayed.

[0285] The system comment may be displayed in a manner different from the comments from the first user and the second user. For example, a predetermined mark (such as the "It's here!" speech bubble in FIG. 31) may be displayed as a system comment indicating that the first object G1 is being displayed.

[0286] In the embodiment of the present disclosure, the character object CO of the first user is capable of moving between the first region R10 and the second region R20. For example, as shown in Fig. 31 , if the first object G1 is placed in the first region R10 while the character object CO of the first user is moving through the second region R20 that is far away from the first region R10, the first object G1 may not be displayed on the screen, and therefore, displaying such a system comment is beneficial.

[0287] Moreover, as shown in FIG. 32, one or more computer processors in the present disclosure may further include a movement operation receiving unit 425 and a virtual camera control unit 426.

[0288] The movement operation receiving unit 425 receives an operation to move the character object of the first user in the virtual space. Details of the movement operation will be described later.

[0289] The virtual camera control unit 426 controls the operation of the virtual camera that takes pictures in the virtual space. Details of the operation control will be described later.

[0290] When the first object G1 is displayed at a predetermined position in the first region R10, the virtual camera control unit 426 can control the operation of the virtual camera in accordance with the positional relationship between the predetermined position and the virtual camera.

[0291] As an example, virtual camera control unit 426 adjusts the orientation and position of the virtual camera so that a first object G1 displayed at a predetermined position in first region R10 is within the shooting range, as shown in Fig. 33. This is automatically applied even if the virtual camera is being operated by a user, as will be described later.

[0292] At this time, the virtual camera is controlled so that both the first object G1 and the character object CO are within the shooting range.

[0293] On the other hand, if the first object and the character object cannot be included on the same screen due to the positional relationship between the specified position and the virtual camera, the virtual camera control unit 426 can control the operation of the virtual camera to include the first object on the screen.

[0294] As an example, virtual camera control unit 426 adjusts the orientation and position of the virtual camera so that only a first object G1 displayed at a predetermined position in first region R10 is within the shooting range, as shown in Fig. 34. This is automatically applied even if the virtual camera is being operated by a user, as will be described later.

[0295] In addition, when the second video generation unit 224 displays the first object G1 at a predetermined position in the first area R10, it can display a marker object M1 indicating the position of the first object in the virtual space according to the position of the character object CO in the virtual space.

[0296] As an example, the second video generation unit 424 displays a marker object M1 to point to (the direction of) a first object displayed at a predetermined position in the first region R10, regardless of the current position and orientation of the virtual camera, as shown in Figure 35.

[0297] Furthermore, the second video generation unit 424 can display the first object G1 at a position associated with the first user's character object CO, even if the placement position information associated with the first object G1 indicates that the first object should be displayed at a predetermined position in the first area R10.

[0298] As an example, the second video generation unit 424 displays a first object G1 at a position associated with (above) the first user's character object CO, as shown in Fig. 36. According to this example, it is possible to increase the likelihood that the first object G1 will be included in the shooting range regardless of the position of the first user's character object CO in the virtual space. This makes it possible to effectively inform the broadcasting user and viewing users of important gifts on a display screen of limited size that cannot display the entire large virtual space.

[0299] As described above, the configuration of the second embodiment can provide technical improvements that solve or alleviate at least some of the problems of the conventional technology described above. Specifically, the configuration can improve the distribution motivation of distribution users, the viewing motivation of viewing users, and / or the motivation of users to interact with each other.

[0300] <Third embodiment> Next, various functions that can be executed by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the third embodiment of the present disclosure will be described with reference to the drawings.

[0301] The one or more computer processors included in the information processing system 3000 according to the third embodiment of the present disclosure include a transmitting unit 431, a receiving unit 432, a first moving image generating unit 433, a second moving image generating unit 434, and an associating unit 435, as shown in FIG. 37.

[0302] Here, the explanation will be given assuming that the sending unit 431, the receiving unit 432, the first moving image generating unit 433, the second moving image generating unit 434 and the associating unit 435 are all provided in the server device 400, but this is not limited to this.

[0303] The transmission unit 431 transmits information about the video including the character object CO of the first user to the second user terminal 200 of the second user. The transmission unit 431 can have the same configuration as the transmission unit 411 described above.

[0304] The receiving unit 432 receives a request to display the first object from the second user terminal 200. The receiving unit 432 can have the same configuration as the receiving unit 412 described above.

[0305] The first moving image generation unit 433 generates first information for displaying the character object of the first user and the first object in a first area in the virtual space as a first moving image. The first moving image generation unit 433 can have the same configuration as the first moving image generation unit 413 described above.

[0306] The second moving image generation unit 434 generates second information for displaying a second object S1 different from the first object G1 in a second area in the virtual space as the second moving image and displaying the first user's character object CO movably between the first area and the second area. The second moving image generation unit 434 can have a configuration similar to that of the second moving image generation unit 414 described above.

[0307] Also, as shown in FIG. 38, the second moving image generating unit 434 displays a third object P1, which is different from the first object G1 and the second object S1, in the second region R20.

[0308] Fig. 39 shows an image of the third object P1. In Fig. 39, two-dimensional panel-like objects P11 to P14 are shown as the third object P1. Note that the third object is not limited to a two-dimensional panel-like object, and may be a three-dimensional object.

[0309] Each of the objects P11 to P14 displays an attachment object together with a character image. The character image displayed on the image object may be the image of the character object of the first user, or may be a different image.

[0310] When a predetermined relationship is established between the first user's character object CO and the third object P1, the associating unit 435 associates the first user's character object CO with the fourth object W1 that is associated with the third object P1.

[0311] The predetermined relationship may be at least a part (hand, foot, etc.) of the character object CO touching the third object P1, the distance between the character object CO and the third object P1 becoming a predetermined distance, the character object CO pressing a button object associated with the third object P1, etc. Note that touching the third object P1 includes the character object CO being in contact with the third object P1 for a predetermined period of time, being within a predetermined distance for a predetermined period of time, and pressing for a predetermined period of time.

[0312] These predetermined relationships are not particularly limited, but can be set in a manner that allows the second user watching the video to visually understand that the first user's character object CO is attempting to associate with the fourth object W1.

[0313] In addition, when the association unit 435 associates the fourth object W1 with the character object CO of the first user, the second video generation unit 434 displays the fourth object W1 in association with the character object CO of the first user.

[0314] That is, the attachment object displayed on the third object P1 is attached to the character object CO and displayed as the fourth object W1. In the example shown in Fig. 39, the character object CO of the first user is in a predetermined relationship with the third object P14, and the fourth object (sparkling object) W14, which is the attachment object displayed on the third object P14, is attached around the head of the character object CO.

[0315] This fourth object W1 may be the same object as a gift object that the second user can request to be displayed as a gift, as will be described later, or may be a special object that cannot be thrown as a gift.

[0316] In the former case, the fourth object W1 corresponds to a valuable gift. Since valuable gifts are rarely given by the second user, the first and second users have little opportunity to see / wear the object. However, by making the object available for free in the world function, the world function is activated and users are motivated to give the object in the first video.

[0317] The third object P1 may be the same for all users, or may vary depending on the theme of the world being displayed. The third object P1 to be displayed may also be determined based on information about the first user.

[0318] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0319] Specifically, first, the presence of two types of video, the first video and the second video, increases the interest of the video.

[0320] In particular, the virtual world "World" that serves as the setting for the second video is filled with attractive second objects that fit the theme, and the character objects can be moved freely to generate videos from any location and viewpoint, making it possible to generate videos that reflect the user's individuality more than the first video.

[0321] In addition, by generating videos of people exploring the world, it becomes easier to create topics of conversation and comments.

[0322] In addition, by displaying the third object shown in the second video and allowing the character object to freely attach a corresponding fourth object, it becomes easier to create topics of conversation and comments, and interactions between users become more active.

[0323] Furthermore, by visually showing the process up to putting on the fourth object in the video, it is possible to give the first user and / or the second user a sense of anticipation.

[0324] Furthermore, if the fourth object corresponds to a high-value gift, since high-value gifts are rarely cast by the second user, the first and second users will have difficulty seeing / wearing the object. However, by making it possible to specially wear the object in this world function, the world function will be activated and users will be motivated to cast it in the first video as well.

[0325] In this way, the existence of two types of moving images, the first moving image and the second moving image, and the fourth object improve the quality of the moving image as content compared to the past.

[0326] Furthermore, as the quality of video content improves, users' willingness to watch the video also increases, and as the number of users watching increases, users' willingness to distribute the video also increases.

[0327] Furthermore, as the willingness to distribute and view increases, communication between distribution users and viewing users, as well as communication between distribution users and viewing users, will become more active.

[0328] The virtual space displayed by executing the world function described above has been described as a space for distributing the second video, but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can walk around freely and communicate with each other, rather than being limited to a space for distributing the second video.

[0329] One of the avatars (one user) in the virtual space may be configured to broadcast a first video as a broadcasting user. In other words, the information processing system of the present disclosure enables one-to-many video broadcasting in a many-to-many metaverse virtual space.

[0330] The second moving image generating section 434 can display a loading image for a predetermined time when the associating section 435 performs the association.

[0331] An example of the loading image L1 is shown in Figure 40. In Figure 40, the loading image L1 is displayed at the same time as the character object CO steps on the third object P1 (P11), and when the circular meter increases from 0% to 100%, the fourth object W1 (W11) is attached to the character object CO.

[0332] This is done by intentionally taking the time to load, so that the second user who is watching can see that the character object is trying to associate with the fourth object, which can further increase the sense of anticipation of the first user and / or the second user.

[0333] The time it takes for the meter to fill up (loading time) is not particularly limited, but the loading time may be increased as the value of the fourth object increases.

[0334] As shown in FIG. 41, one or more computer processors in the present disclosure may further include a selection screen generation unit 436.

[0335] The selection screen generation unit 436 generates information for displaying on the second user terminal 200 the selection screen V30 for requesting the display of the first object G1.

[0336] As shown in FIG. 20, a selection screen V30 displays a plurality of selectable images for requesting the display of the first object G1.

[0337] Among the images, the image for requesting the display of the first object G1 related to the fourth object can be displayed in a manner different from the other images, as shown in FIG.

[0338] For example, in a situation where a first user can freely wear a triangular hat as a fourth object in a second video, there is little display benefit for a second user to give a gift of a triangular hat (however, there is a benefit in that respect, as it contributes to the amount of the gift (points) obtained by the first user (given by the second user)).

[0339] Therefore, the image of the first object G1 related to the fourth object is displayed in a manner different from the other images, so that the second user can make a selection after understanding the above circumstances.

[0340] Note that "related to the fourth object" does not necessarily mean that the object is the same as the fourth object, but also means that the object is different from the fourth object but is displayed in approximately the same position.

[0341] As an example of the different aspect, FIG. 42 shows an example in which the frame is emphasized, but it is also possible to add a badge or change the color.

[0342] Furthermore, when a display request for the first object G1 related to the fourth object is made by the second user, a special effect may be generated in the video.

[0343] The special effect may be, for example, but is not limited to, displaying another object, generating a sound effect, etc. The other object may be, for example, a confetti object, a cracker object, or other effect object.

[0344] This configuration makes it possible to compensate for the disadvantages in terms of display.

[0345] Moreover, as shown in FIG. 41, one or more computer processors of the present disclosure may further include a determination unit 437.

[0346] When a request is made to display a first object G1 that should be displayed in association with a specific position of the first user's character object CO, the determination unit 437 determines whether a fourth object W1 is already being displayed in association with a specific position of the first user's character object CO.

[0347] FIG. 43 shows an example of a processing flow including a determination step by the determination unit 437.

[0348] As shown in FIG. 43, one or more computer processors execute a step of determining whether there has been a request to display a first object that should be associated with a specific position of a character object of a first user (S401).

[0349] If it is determined that there is a display request for the first object to be displayed in association with a specific position of the first user's character object, a step of determining whether or not a fourth object is displayed in association with the specific position of the first user's character object is executed (S402). The specific position may be the same position, or may include a substantially same position.

[0350] Then, if it is determined that the fourth object is already being displayed in association with a specific position of the first user's character object, the second video generation unit 440 can either display the first object in place of the fourth object, or display both the fourth object and the first object in association with a specific position.

[0351] That is, if it is determined that the fourth object is displayed in association with a specific position of the first user's character object, the second video generation unit 440 executes a step (S403) of displaying the first object instead of the fourth object, or displaying both the fourth object and the first object in association with a specific position.

[0352] Whether to display the first object instead of the fourth object or both the fourth object and the first object can be determined based on the properties of the first object. For example, if the value of the first object is higher than a standard, the first object is displayed instead of the fourth object, and if the value of the first object is lower than the standard, both objects are displayed. The standard may be the value of the fourth object when it is a gift, or may be set by the first user or the management side.

[0353] If it is determined that the fourth object is not displayed in association with a specific position of the first user's character object, the second video generation unit 440 executes a step of displaying the first object in association with a specific position (S404).

[0354] As another example, when there is a request to display a first object that should be displayed in association with a specific position of the first user's character object, if the determination unit 437 determines that a fourth object is already being displayed in association with the specific position of the first user's character object, the second video generation unit 434 can display the first object instead of the fourth object based on instructions from the first user terminal.

[0355] At this time, a display instruction object for performing the above instruction may be displayed on the screen of the first user, thereby allowing the first user to display the first object, which is a gift from the second user, at a timing of his / her choosing.

[0356] In the above example, it is determined whether or not the fourth object is already displayed, but the reverse is also true.

[0357] That is, as shown in FIG. 44, one or more computer processors execute a step of determining whether or not a predetermined relationship has been established between the character object CO of the first user and the third object P1 (S405).

[0358] Then, when it is determined that the character object CO of the first user and the third object P1 have a predetermined relationship, a step of determining whether or not the first object is displayed in association with a specific position of the character object of the first user is executed (S406). The specific position may be the same position, or may include a substantially same position.

[0359] Then, if it is determined that the first object is displayed in association with a specific position of the first user's character object, the second video generation unit 440 executes a step of displaying a fourth object in place of the first object, or displaying both the fourth object and the first object in association with a specific position (S407).

[0360] Whether to display a fourth object in place of the first object or both the fourth object and the first object can be determined based on the properties of the fourth object. For example, if the value of the fourth object is higher than the value of the first object, the fourth object is displayed in place of the first object, and if the value of the fourth object is lower than the value of the first object, both objects are displayed. The value of the fourth object can be determined based on the value of the fourth object if it is a gift.

[0361] If it is determined that the first object is not displayed in association with a specific position of the first user's character object, the second video generation unit 440 executes a step of displaying a fourth object in association with a specific position (S408).

[0362] As another example, if the determination unit 437 determines that a first object is already being displayed in association with a specific position of the first user's character object, the second video generation unit 434 can display a fourth object in place of the first object based on instructions from the first user terminal.

[0363] At this time, a display instruction object for performing the above instruction may be displayed on the screen of the first user, thereby enabling the first user to display the fourth object at a timing of his / her choice.

[0364] Also, as shown in FIG. 38, the second video generation unit 440 can display a fifth object P2, which is different from the first object G1, the second object S1, and the third object P1, in the second region R20.

[0365] The fifth object P2 is a release object as shown in FIG. 45 as an example.

[0366] Then, when the character object of the first user and the fifth object P2 have a predetermined relationship, the association unit 435 can release the association of the fourth object associated with the character object of the first user.

[0367] That is, the fifth object P2 is an object for disassociating and hiding the fourth object W1 from the character object CO. The predetermined relationship can be the same as that described in the explanation of the third object.

[0368] In addition, when a fourth object W1 is associated with the first user's character object CO, the association unit 435 can release the association of the fourth object W1 associated with the first user's character object CO when the first user's character object CO and the third object P1 once again have a predetermined relationship.

[0369] That is, when the character object CO steps on the third object P1 once, the fourth object W1 is associated with it, and when the character object CO steps on the third object P1 a second time, the association of the fourth object W1 is released and the character object W1 is hidden. Note that when the character object CO steps on the third object P1 a third time, the fourth object W1 is again associated with the character object, but an upper limit may be set on the number of times the fourth object W1 can be associated with the character object.

[0370] Also, as shown in Figure 45, for example, when a fourth object W11 is displayed as associated with a third object P11 by stepping on it, if another third object P12 is then stepped on, the association of the fourth object W11 is released and a fourth object W12 corresponding to the other third object P12 is attached.

[0371] Alternatively, for example, when a fourth object W11 is displayed as associated with a third object P11 by stepping on it, and then another third object P12 is stepped on, the association of the fourth object W11 is not released, and a fourth object W12 corresponding to the other third object P12 may be further attached.

[0372] Furthermore, as described above, when the character object CO moves out of the area and reappears, the association with all fourth objects may also be released.

[0373] If the display time is not set for the fourth object W1, the association may not be released unless the above action is taken.

[0374] When the theme of the world is changed (when the second object S1 is changed), the third object P1 can be changed to another third object P1 in accordance with the theme of the world. When there are multiple third objects P1, all or some of them may be changed.

[0375] Even if the world theme is changed, the fourth object W1 that has already been worn continues to be displayed.

[0376] By using this configuration, a mission using the fourth object may be generated, and a predetermined effect may be generated when the mission is completed.

[0377] An example of a mission is to equip, after changing the theme, a fourth object that has a specific relationship with the fourth object that was equipped before the theme was changed, etc. Such a mission can be continued over multiple theme changes.

[0378] For example, if a fourth object that is an ice cream object can be equipped in each theme, the mission can be to pile up ice cream on the head of the character object every time the theme is changed.

[0379] The predetermined effect may be, for example, but is not limited to, displaying another object, generating a sound effect, etc. The other object may be, for example, a presentation object such as a confetti object, a cracker object, or a paper balloon object.

[0380] Such predetermined effects can be configured to become more spectacular each time the theme is changed.

[0381] According to the above configuration, the delivery time for the first user can be extended, and the interest of the video can be increased, thereby increasing the willingness of the second user to watch.

[0382] As described above, the configuration of the first embodiment can provide technical improvements that solve or alleviate at least some of the problems of the conventional technology described above. Specifically, the configuration can improve the distribution users' motivation to distribute, the viewing users' motivation to watch, and / or the users' motivation to interact with each other.

[0383] <Fourth embodiment> Next, various functions that can be executed by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the fourth embodiment of the present disclosure will be described with reference to the drawings.

[0384] As shown in FIG. 46, one or more computer processors included in the information processing system 3000 according to the fourth embodiment of the present disclosure include a transmission unit 141, a movement operation reception unit 142, a virtual camera control unit 143, and a video generation unit 144.

[0385] Here, the description will be given assuming that the transmission unit 141, movement operation reception unit 142, virtual camera control unit 143, and video generation unit 144 are all provided in the first user terminal 100, but this is not limited to this.

[0386] The transmission unit 141 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user.

[0387] As an example, the video may be a video streamed in real time by a first user.

[0388] As an example, the information regarding the video may be information that enables the video to be viewed on the second user terminal 200, and rendering of the video may be performed on the first user terminal 100 or the server device 400, or may be performed on the second user terminal 200.

[0389] At least the facial portion of the character object included in the video may reflect the facial movements of the first user captured by a camera provided in the first user terminal.

[0390] The movement operation receiving unit 142 receives a movement operation of the character object of the first user in the virtual space. The virtual space can be the space shown in Fig. 22. The method of receiving the movement operation will be described later.

[0391] The virtual camera control unit 143 receives camera operations for the virtual camera that captures images in the virtual space. The method for receiving camera operations will be described later.

[0392] The video generation unit 144 generates information for enabling the character object of the first user to move within the virtual space based on the movement operation and the camera operation.

[0393] The information generated here is the second information described above, and the video is displayed based on the second information. That is, the video transmitted to the second user terminal 200 is the second video.

[0394] In this embodiment, a first movement action is applied to the character object of the first user in response to a predetermined operation on the first operation UI displayed on the first user terminal 100 of the first user.

[0395] Furthermore, in response to a predetermined operation on a second operation UI displayed on the first user terminal 100, a second movement action is applied to the character object of the first user.

[0396] Furthermore, in response to a predetermined operation on the third operation UI displayed on the first user terminal 100, the viewpoint of the virtual camera can be switched between a first-person viewpoint and a third-person viewpoint.

[0397] FIG. 47 shows an image in which a first operation UI 51, a second operation UI 52, and a third operation UI 53 are displayed on a screen D50 displayed on the first user terminal 100.

[0398] The first operation UI 51 is a virtual joystick, and can move an object horizontally in a virtual space according to the swipe direction from an initial position of a touch within an outer circular area of ​​the first operation UI 51. The inner circle within the outer circular area is displayed to move within the outer circular area according to the touch position. The moving speed of the character object may be changed according to the moving distance from the initial position. Alternatively, the moving speed of the character object may not be changed according to the moving distance from the initial position. In this case, the moving speed changes at a constant rate, and an easy-to-view screen can be provided.

[0399] The second operation UI 52 can move the character object in the vertical direction in the virtual space in response to a tap within the circular region of the second operation UI 52.

[0400] The third operation UI 53 switches between the first-person perspective and the third-person perspective by tapping. Figure 47 shows an image of a screen displaying a video from a third-person perspective, and Figure 48 shows an image of a screen displaying a video from a first-person perspective.

[0401] Then, in accordance with a predetermined operation on an area (fifth area) on the first user terminal 100 where the first operation UI 51, the second operation UI 52, and the third operation UI 53 are not displayed, operations to move, rotate, and / or zoom the virtual camera are applied.

[0402] Specifically, a rotation operation is applied to the virtual camera in response to a one-finger swipe operation on the fifth area.

[0403] Furthermore, in response to a two-finger swipe operation on the fifth area, a movement operation is applied to the virtual camera.

[0404] In addition, in response to a pinch-in / pinch-out operation with two fingers on the fifth area, a zoom operation is applied to the virtual camera.

[0405] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0406] Specifically, the presence of the second video improves the quality of the video content.

[0407] Furthermore, the above configuration improves the operability of the character object in the second moving image.

[0408] Furthermore, as the quality of the video improves, the viewing users' willingness to watch increases, and as the number of viewing users increases, the distributing users' willingness to distribute also increases.

[0409] As the willingness to distribute and view increases, communication between distribution users and viewing users, as well as communication between viewing users themselves, will become more active.

[0410] The virtual space displayed by executing the world function described above has been described as a space for distributing the second video (world function), but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can walk around freely and communicate with each other, rather than being limited to a space for distributing the second video.

[0411] One of the avatars (one user) in the virtual space may be configured to be able to distribute a first video as a distribution user. In other words, one-to-many video distribution can be performed in a many-to-many metaverse virtual space.

[0412] In response to a predetermined operation on the first user terminal, it is possible to switch between displaying and not displaying comments on a video displayed on the first user terminal.

[0413] FIG. 49 shows the screen D50 shown in FIG. 48 with a comment field D54 displayed.

[0414] When switching between displaying and not displaying comments on a video, one or more computer processors can change the display positions of the first operation UI and the second operation UI, or can hide the first operation UI 51, the second operation UI 52, and the third operation UI 53.

[0415] Specifically, the display position is changed in the examples shown in FIGS. 48 and 49, but is not displayed in the examples shown in FIGS.

[0416] As described above, the first movement motion can be horizontal movement (walking, etc.), and the second movement motion can be vertical movement (jumping, etc.).

[0417] Additionally, the one or more computer processors apply a rotation operation to the virtual camera in response to a one-finger swipe operation on the region (fifth region).

[0418] Additionally, the one or more computer processors apply a movement operation to the virtual camera in response to a two-finger swipe operation on the region (fifth region).

[0419] Furthermore, the one or more computer processors apply a zoom operation to the virtual camera in response to a pinch-in / pinch-out operation with two fingers on the area (fifth area).

[0420] These operations allow you to freely project images within the virtual space.

[0421] Furthermore, the virtual camera control unit 143 can accept camera operations from the first user or a user authorized by the first user.

[0422] The user authorized by the first user may be, for example, one of the guest users, and details will be described later.

[0423] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0424] <Fifth embodiment> Next, various functions that can be executed by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the fifth embodiment of the present disclosure will be described with reference to the drawings.

[0425] As shown in FIG. 51, one or more computer processors included in the information processing system 3000 according to the fifth embodiment of the present disclosure include a transmission unit 151, a movement operation reception unit 152, a virtual camera control unit 153, and a video generation unit 154.

[0426] The transmitting unit 151 transmits information about a moving image including a character object of the first user to the second user terminal 200 of the second user. The transmitting unit 151 can have the same configuration as the transmitting unit 141 described above.

[0427] The movement operation receiving unit 152 receives an operation to move the character object of the first user in the virtual space. The movement operation receiving unit 152 can have the same configuration as the movement operation receiving unit 142 described above.

[0428] Virtual camera control unit 153 receives camera operations for a virtual camera that captures images in the virtual space. Virtual camera control unit 153 can have the same configuration as virtual camera control unit 143 described above.

[0429] The video generation unit 154 generates information for enabling the first user's character object to move within the virtual space based on the movement operation and the camera operation. The video generation unit 154 can have the same configuration as the video generation unit 144 described above.

[0430] The video generation unit 154 in the present disclosure is also capable of generating information for displaying character objects of one or more other users in the video.

[0431] A video generated in this manner is called a collaboration video, in which the first user is the "host user" and the other users are "guest users." Details of collaboration videos have been described above. The viewing user (second user) sends a request to participate in the video via a collaboration distribution participation request confirmation screen that is displayed by pressing the collaboration request button V15 shown in FIG. 12. In response to the participation request accepted by the accepting unit, the video generating unit 154 displays a character object of the viewing user (other user) who made the participation request in the video. Note that this character object of the other user may be generated based on the movement of the other user or may be based on the operation of the other user. Hereinafter, guest users participating in collaboration will be referred to as "other users," and viewing users not participating in collaboration will be referred to as "second users."

[0432] FIG. 52 shows an image of a screen V50 displaying a moving image in which a character object C1 of a first user (host user) and character objects C2 and C3 of other users (guest users) are displayed.

[0433] The display start position of the character objects of other users is the first area. If a display request is made while the first video is being displayed, all of the character objects are in the first area, so the character objects are displayed in an aligned state (FIGS. 15 and 16). However, if a display request is made while the second video is being displayed, users other than the other user who made the display request can move freely within the first area or the second area, so the character objects may be displayed in a scattered state.

[0434] Furthermore, when a switch is made to a second video during collaboration in a first video, the second video starts with all of the character objects in the first area. Specifically, in the first video, virtual camera VC1 is used to photograph the character objects from the center of the virtual space (FIG. 24), while in the second video, virtual camera VC2 is used to photograph the character objects from the edge of the virtual space (the side opposite virtual camera VC1) (FIG. 25). Therefore, at the start of the second video, a video is displayed in which virtual camera VC2 is photographing from behind the character objects.

[0435] The transmission unit 151 in the present disclosure is characterized in that it transmits to the second user terminal 200 a video of the first-person perspective or third-person perspective of the character object C1 of the first user.

[0436] Here, the moving image transmitted to the second user terminal 200 is referred to as the second moving image. That is, the collaboration moving image in the fifth embodiment is a moving image in which the world function is being executed.

[0437] Figure 52 is an example of a video of a first user's character object C1 from a third-person perspective, showing the back of the head of the first user's character object C1 and the character objects C2 and C3 of other users. On the other hand, Figure 53 is an example of a video of the other user's character object C2 from a first-person perspective, showing the first user's character object C1 and the character object C3 of the other user. Note that the positions of the character objects and other objects in Figure 52 and Figure 53 are not related to each other.

[0438] The above-mentioned switching between the first-person perspective and the third-person perspective can be performed by operating the third operation UI 53 shown in Fig. 47. Note that other users can operate their own character objects while their own character objects are participating in a collaboration, and the first operation UI 51, second operation UI 52, and third operation UI 53 shown in screen D50 are displayed on the screen of their own terminals.

[0439] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0440] Specifically, by providing a collaboration function for the second video, the quality of the video content will be improved, and it will also lead to more active interaction between users participating in the collaboration, between users participating in the collaboration and viewers, and even between viewers themselves.

[0441] Furthermore, as the quality of the video improves, the viewing users' willingness to watch increases, and as the number of viewing users increases, the distributing users' willingness to distribute also increases.

[0442] In addition, the transmission unit 151 can transmit information regarding multiple videos of the first-person or third-person perspective of the first user's character object and the first-person or third-person perspective of the other user's character object to the second user terminal 200.

[0443] As an example, Figure 54 shows an example in which a display area V61 for a video of a first user's character object C1 from a third-person perspective, a display area V62 for a video of another user's character object C2 from a third-person perspective, and a display area V63 for a video of another user's character object C3 from a first-person perspective are displayed on a single screen V60.

[0444] As will be described later, the first user or the second user can select whether to display only the screen from the viewpoint of the character object of the first user, as in the examples shown in Figures 52 and 53, or to split and display the screens from the viewpoints of the character objects of all users, as in the example shown in Figure 54. Note that in Figure 54, there is a blank space because there are two guests participating in the collaboration, but a third guest can be displayed here.

[0445] Also, while Figure 54 shows an example in which the display area is divided equally into rectangles, the shape of the display area is not particularly limited, and the size of the display area may be distributed so that the first user is larger and the other users are smaller.

[0446] Also, while FIG. 54 shows a state in which various displays and operation UIs are not displayed, various displays and operation UIs may be displayed in an overlapping manner, as shown in FIGS.

[0447] Furthermore, the screens of the users participating in the collaboration (the first user and other users) may display only their own first-person / third-person screens, or may display the first-person / third-person screens of all users as shown in Fig. 54. These may be switchable by the selection of each user participating in the collaboration.

[0448] Furthermore, one or more computer processors in the present disclosure may include a selection receiving unit 155, as shown in FIG.

[0449] The selection receiving unit 155 receives a selection by the first user or the second user of one of the first user and one or more other users.

[0450] That is, the first user who is the host user or the second user who is the viewing user can select one user from among the users participating in the collaboration.

[0451] At this time, the transmitting unit 151 can transmit information related to the video in accordance with the selection accepted by the selection accepting unit 155.

[0452] Specifically, when the selection receiving unit 155 receives a selection of one other user from one or more other users by the first user, the transmitting unit 151 transmits information about a first-person perspective video of the one other user.

[0453] This assumes, for example, that the first user's character object is a performer and the selected other user is a cameraman. Typically, the first user must operate the virtual camera while simultaneously controlling his or her own movements and / or the character object. However, to generate higher quality video, it is easier to delegate camera operation authority to another user. In this case, the character object of the selected other user will be a backstage staff member, so the video will automatically be set to a first-person perspective rather than a third-person perspective.

[0454] In addition, when the selection receiving unit 155 receives a selection by the second user of one user from the first user and one or more other users, the transmitting unit 151 may transmit information regarding a first-person or third-person perspective video of the character object of the selected user to the second user terminal.

[0455] The second user's screen may display a video from the viewpoint of the character object of the user selected by the second user, or a video from the viewpoint of the character object of the user who has been selected (voted for) the most by multiple second users, including the second user and other second users. Note that the type of viewpoint (first-person viewpoint / third-person viewpoint) displayed at this time may be the type of viewpoint selected by the user who provides the video from that viewpoint, or may be further selected by the first user or the second user.

[0456] In the above example, multiple second users vote equally, but a specific second user may be configured to determine the video to be displayed to all other second users. The specific second user may be, for example, a user who has a large number of points calculated based on the gift display request and the value of the gift for which the display request has been made (for example, a user who has given a large amount of gifting), or a user who has viewed a large number of videos distributed by the first user.

[0457] Furthermore, when the selection receiving unit 155 receives a selection by the first user of one other user from one or more other users, one or more computer processors in the present disclosure may further include a performance receiving unit 156 and an effect generation unit 157, as shown in FIG. 55.

[0458] The effect receiving unit 156 receives a request from another user to display an effect on a video.

[0459] The effect generating unit 157 generates a dramatic effect on the video in response to the display request received by the effect receiving unit 156.

[0460] Examples of the effect include, but are not limited to, displaying another object or generating a sound effect, as shown in Fig. 56. The other object may be, for example, a confetti object, a cracker object, a paper balloon object, or the like.

[0461] The transmitting unit 151 is characterized by transmitting information relating to the moving image in which the dramatic effect has been generated.

[0462] This assumes, for example, that the first user's character object is a performer and the selected other users are special effects staff. Typically, the first user needs to activate special effects while simultaneously controlling their own movements and / or the character object. However, in order to generate higher quality video, it is easier to delegate the authority to activate effects to other users.

[0463] Furthermore, when the selection receiving unit 155 receives a selection of one other user from one or more other users by the first user, one or more computer processors in the present disclosure may further include a switching receiving unit 158.

[0464] The switching reception unit 158 ​​receives a request from another user to switch an object to a video.

[0465] The object switching request is a request to change the above-mentioned second object to another second object. In the above example, the conditions for changing the second object were explained as the arrival of a scheduled time, the passage of a scheduled time, or a change instruction from the first user or another user, but this example corresponds to the change instruction from another user.

[0466] In response to a switching request received by the switching receiving unit 158, the video generating unit 154 can change objects other than the first user's character object C1 and the other user's character object C2 displayed in the virtual space to other objects (Figures 57 and 58).

[0467] As shown in FIGS. 57 and 58, some objects may remain unchanged (such as a tower cake object).

[0468] Furthermore, when a viewing user requests the display of an attached gift, a display instruction object for displaying a gift object corresponding to the attached gift in the video in response to the display request may be displayed on the screen of one of the other users whose selection by the first user or the second user is accepted by the selection accepting unit 155. This allows the other user to have the attached gift object attached to the first user (or a guest user other than the other user) and displayed at a time of their choice.

[0469] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0470] The first to fifth embodiments described above can be combined with each other, and it is also possible to combine parts of these embodiments with each other.

[0471] Next, an information processing method according to an embodiment of the present disclosure will be described.

[0472] The information processing method according to the embodiment of the present disclosure is an information processing method in the information processing system 3000 shown in Fig. 3. The information processing system 3000 includes one or more first user terminals 100, second user terminals 200, and a server device 400.

[0473] As shown as an example in FIG. 59, the information processing method of the present disclosure causes one or more computer processors provided in an information processing system 3000 to execute a transmission step S441, a movement operation reception step S442, a virtual camera control step S443, and a video generation step S444.

[0474] In the sending step S441, information about the video including the character object of the first user is sent to the second user terminal 200 of the second user. The sending step S441 can be executed by the sending unit 141 described above.

[0475] The sending step S441 may be executed on the server side (server device 400) or on the client side (first user terminal 100).

[0476] The movement operation receiving step S442 receives a movement operation of the first user's character object in the virtual space. The movement operation receiving step S442 can be executed by the movement operation receiving unit 142 described above.

[0477] The moving operation receiving step S442 may be executed on the server side (server device 400) or on the client side (first user terminal 100).

[0478] In the virtual camera control step S443, camera operations for a virtual camera that takes pictures in the virtual space are accepted. This virtual camera control step S443 can be executed by the virtual camera control unit 143 described above.

[0479] The virtual camera control step S443 may be executed on the server side (server device 400) or on the client side (first user terminal 100).

[0480] The moving image generating step S444 generates information for enabling the first user's character object to move within the virtual space based on the movement operation and the camera operation. The moving image generating step S444 can be executed by the moving image generating unit 144 described above.

[0481] The moving image generating step S444 may be executed on the server side (server device 400) or on the client side (first user terminal 100).

[0482] Then, in the video generation step S444, a first movement action is applied to the first user's character object in accordance with a predetermined operation on the first operation UI displayed on the first user terminal 100 of the first user, a second movement action is applied to the first user's character object in accordance with a predetermined operation on the second operation UI displayed on the first user terminal, the viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in accordance with a predetermined operation on the third operation UI displayed on the first user terminal, and movement, rotation and / or scaling operations of the virtual camera are applied in accordance with a predetermined operation on an area on the first user terminal where the first operation UI, second operation UI and third operation UI are not displayed.

[0483] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0484] Next, a computer program according to an embodiment of the present disclosure will be described.

[0485] The computer program according to the embodiment of the present disclosure is a computer program executed in an information processing system 3000 that distributes moving images, as shown in Fig. 3. The information processing system 3000 includes one or more first user terminals 100, second user terminals 200, and a server device 400.

[0486] The computer program in the present disclosure is characterized by causing one or more computer processors included in the information processing system 3000 to realize a transmission function, a movement operation reception function, a virtual camera control function, and a video generation function.

[0487] The transmission function transmits information about a moving image including a character object of the first user to the second user terminal 200 of the second user.

[0488] The movement operation reception function receives a movement operation of the first user's character object in the virtual space.

[0489] The virtual camera control function accepts camera operations for a virtual camera that takes pictures in a virtual space.

[0490] The video generation function generates information that enables the first user's character object to move within the virtual space based on movement operations and camera operations.

[0491] The video generation function then applies a first movement action to the first user's character object in response to a predetermined operation on the first operation UI displayed on the first user terminal of the first user, applies a second movement action to the first user's character object in response to a predetermined operation on the second operation UI displayed on the first user terminal 100, switches the viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation on the third operation UI displayed on the first user terminal 100, and applies movement, rotation and / or scaling operations to the virtual camera in response to a predetermined operation on an area of ​​the first user terminal 100 where the first operation UI, second operation UI and third operation UI are not displayed.

[0492] The above functions can be realized by transmission circuit 1441, movement operation reception circuit 1432, virtual camera control circuit 1443, and video generation circuit 1444 shown in Fig. 60. Transmission circuit 1441, movement operation reception circuit 1432, virtual camera control circuit 1443, and video generation circuit 1444 are realized by the above-mentioned transmission unit 141, movement operation reception unit 142, virtual camera control unit 143, and video generation unit 144, respectively. Details of each unit are as described above.

[0493] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0494] Next, an information processing device according to an embodiment of the present disclosure will be described. The information processing device corresponds to the first user terminal 100 in the information processing system 3000 described above.

[0495] As shown in FIG. 46, the information processing device includes a transmission unit 141, a movement operation reception unit 142, a virtual camera control unit 143, and a video generation unit 144.

[0496] The transmitting unit 141 transmits information about the video including the character object of the first user to the server device. Details of the transmitting unit 141 are as described above.

[0497] The movement operation receiving unit 142 receives an operation to move the character object of the first user in the virtual space. Details of the transmission unit 141 are as described above.

[0498] The virtual camera control unit 143 receives camera operations for the virtual camera that captures images in the virtual space. The details of the virtual camera control unit 143 are as described above.

[0499] The video generation unit 144 generates information for enabling the character object of the first user to move within the virtual space based on the movement operation and the camera operation. Details of the video generation unit 144 are as described above.

[0500] Then, in response to a predetermined operation on the first operation UI displayed on the first user terminal 100 of the first user, a first movement action is applied to the character object of the first user, in response to a predetermined operation on the second operation UI displayed on the first user terminal 100, a second movement action is applied to the character object of the first user, in response to a predetermined operation on the third operation UI displayed on the first user terminal 100, the viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint, and in response to a predetermined operation on an area on the first user terminal where the first operation UI, the second operation UI and the third operation UI are not displayed, an operation to move, rotate and / or zoom the virtual camera is applied.

[0501] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0502] Next, an information processing method according to an embodiment of the present disclosure will be described. This information processing method is an information processing method executed in the above-described information processing device (first user terminal 100).

[0503] The information processing method of the present disclosure is characterized in that, as shown as an example in FIG. 61, one or more computer processors provided in an information processing device execute a transmission step S141, a movement operation reception step S142, a virtual camera control step S143, and a video generation step S144.

[0504] In the sending step S141, information about the video including the character object of the first user is sent to the server device 400. The sending step S141 can be executed by the sending unit 141 described above.

[0505] The movement operation receiving step S142 receives a movement operation of the character object of the first user in the virtual space. The movement operation receiving step S142 can be executed by the movement operation receiving unit 142 described above.

[0506] In the virtual camera control step S143, camera operations for a virtual camera that takes pictures in the virtual space are accepted. This virtual camera control step S143 can be executed by the virtual camera control unit 143 described above.

[0507] The moving image generating step S144 generates information for enabling the first user's character object to move within the virtual space based on the movement operation and the camera operation. The moving image generating step S144 can be executed by the moving image generating unit 144 described above.

[0508] Then, in the video generation step S144, a first movement action is applied to the first user's character object in accordance with a predetermined operation on the first operation UI displayed on the first user terminal 100 of the first user, a second movement action is applied to the first user's character object in accordance with a predetermined operation on the second operation UI displayed on the first user terminal 100, the viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in accordance with a predetermined operation on the third operation UI displayed on the first user terminal 100, and movement, rotation and / or scaling operations of the virtual camera are applied in accordance with a predetermined operation on an area on the first user terminal where the first operation UI, second operation UI and third operation UI are not displayed.

[0509] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0510] Next, a computer program according to an embodiment of the present disclosure will be described. This computer program is executed in the information processing device (first user terminal 100) described above.

[0511] The computer program according to the present disclosure is characterized by causing one or more processors included in the information processing system to realize a transmission function, a movement operation reception function, a virtual camera control function, and a video generation function.

[0512] The transmission function transmits to the server device 400 information relating to a moving image including the character object of the first user.

[0513] The movement operation reception function receives a movement operation of the first user's character object in the virtual space.

[0514] The virtual camera control function accepts camera operations for a virtual camera that takes pictures in a virtual space.

[0515] The video generation function generates information that enables the first user's character object to move within the virtual space based on movement operations and camera operations.

[0516] The video generation function applies a first movement motion to the first user's character object in response to a predetermined operation on a first operation UI displayed on the first user terminal 100 of the first user, applies a second movement motion to the first user's character object in response to a predetermined operation on a second operation UI displayed on the first user terminal 100, switches the viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation on a third operation UI displayed on the first user terminal 100, and applies movement, rotation and / or scaling operations of the virtual camera in response to a predetermined operation on an area on the first user terminal where the first operation UI, second operation UI and third operation UI are not displayed.

[0517] The above functions can be realized by transmission circuit 1141, movement operation reception circuit 1142, virtual camera control circuit 1143, and video generation circuit 1144 shown in Fig. 62. Transmission circuit 1141, movement operation reception circuit 1142, virtual camera control circuit 1143, and video generation circuit 1144 are realized by the above-mentioned transmission unit 141, movement operation reception unit 142, virtual camera control unit 143, and video generation unit 144, respectively. Details of each unit are as described above.

[0518] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0519] Next, an information processing device according to an embodiment of the present disclosure will be described. The information processing device is the second user terminal 200 in the information processing system 3000, and corresponds to the second user terminal 200 of the second user who will be the guest user.

[0520] As shown in FIG. 63, the information processing device includes a receiving unit 241, a movement operation receiving unit 242, a virtual camera control unit 243, a transmitting unit 244, and a display unit 245.

[0521] The receiving unit 241 receives, from the server device 400, information relating to a moving image including a character object of a first user and a character object of a second user.

[0522] The movement operation receiving unit 242 receives a movement operation of the character object of the second user in the virtual space.

[0523] The virtual camera control unit 243 accepts camera operations for the virtual camera that takes pictures in the virtual space.

[0524] The transmitting unit 244 transmits information relating to the movement operation and the camera operation to the server device 400.

[0525] The display unit 245 displays the character object of the first user and the character object of the second user so that they can move within the virtual space.

[0526] Then, in response to a predetermined operation on the first operation UI displayed on the second user terminal 200 of the second user, a first movement action is applied to the character object of the second user, in response to a predetermined operation on the second operation UI displayed on the second user terminal 200, a second movement action is applied to the character object of the first user, in response to a predetermined operation on the third operation UI displayed on the second user terminal 200, the viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint, and in response to a predetermined operation on an area of ​​the second user terminal 200 where the first operation UI, the second operation UI and the third operation UI are not displayed, movement, rotation and / or scaling operations of the virtual camera are applied.

[0527] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0528] Next, an information processing method according to an embodiment of the present disclosure will be described. This information processing method is an information processing method executed in the above-described information processing device (second user terminal 200).

[0529] The information processing method of the present disclosure is characterized in that, as shown as an example in FIG. 64, one or more computer processors provided in an information processing device execute a receiving step S241, a moving operation receiving step S242, a virtual camera control step S243, a transmitting step S244, and a display step S245.

[0530] In the receiving step S241, information about a moving image including a character object of a first user and a character object of a second user is received from the server device 400. The receiving step S241 can be executed by the receiving unit 241 described above.

[0531] The movement operation receiving step S242 receives a movement operation of the character object of the second user in the virtual space. The movement operation receiving step S242 can be executed by the movement operation receiving unit 242 described above.

[0532] In the virtual camera control step S243, camera operations for a virtual camera that takes pictures in the virtual space are accepted. This virtual camera control step S243 can be executed by the virtual camera control unit 243 described above.

[0533] In the transmitting step S244, information relating to the movement operation and the camera operation is transmitted to the server device 400. The transmitting step S244 can be executed by the transmitting unit 244 described above.

[0534] The display step S245 displays the character object of the first user and the character object of the second user so that they can be moved within the virtual space. This display step S245 can be executed by the display unit 245 described above.

[0535] Then, in response to a predetermined operation on the first operation UI displayed on the second user terminal 200 of the second user, a first movement action is applied to the character object of the second user, in response to a predetermined operation on the second operation UI displayed on the second user terminal 200, a second movement action is applied to the character object of the first user, in response to a predetermined operation on the third operation UI displayed on the second user terminal 200, the viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint, and in response to a predetermined operation on an area of ​​the second user terminal 200 where the first operation UI, the second operation UI and the third operation UI are not displayed, movement, rotation and / or scaling operations of the virtual camera are applied.

[0536] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0537] Finally, a computer program according to an embodiment of the present disclosure will be described, which is executed in the information processing device (second user terminal 200) described above.

[0538] The computer program according to the present disclosure is characterized in that it causes one or more processors included in the information processing system to realize a receiving function, a moving operation accepting function, a virtual camera control function, a transmitting function, and a display function.

[0539] The receiving function receives information about a moving image including a character object of a first user and a character object of a second user from the server device 400.

[0540] The movement operation reception function receives a movement operation of the second user's character object in the virtual space.

[0541] The virtual camera control function accepts camera operations for a virtual camera that takes pictures in a virtual space.

[0542] The transmission function transmits information about movement operations and camera operations to the server device 400.

[0543] The display function displays the character object of the first user and the character object of the second user so that they can be moved within the virtual space.

[0544] Then, in response to a predetermined operation on the first operation UI displayed on the second user terminal 200 of the second user, a first movement action is applied to the character object of the second user, in response to a predetermined operation on the second operation UI displayed on the second user terminal 200, a second movement action is applied to the character object of the first user, in response to a predetermined operation on the third operation UI displayed on the second user terminal 200, the viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint, and in response to a predetermined operation on an area of ​​the second user terminal 200 where the first operation UI, the second operation UI and the third operation UI are not displayed, movement, rotation and / or scaling operations of the virtual camera are applied.

[0545] The above functions can be realized by receiving circuit 1241, movement operation receiving circuit 1242, virtual camera control circuit 1243, transmission circuit 1244, and display circuit 1245 shown in Fig. 65. Receiving circuit 1241, movement operation receiving circuit 1242, virtual camera control circuit 1243, transmission circuit 1244, and display circuit 1245 are realized by the above-mentioned receiving unit 241, movement operation receiving unit 242, virtual camera control unit 243, transmission unit 244, and display unit 245, respectively. Details of each unit are as described above.

[0546] The above configuration can provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. Specifically, the above configuration can improve distribution users' motivation to distribute, viewing users' motivation to view, and / or users' motivation to interact with each other.

[0547] Furthermore, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-described embodiments. Such an information processing device can be realized by storing a program describing the processing content for realizing each function of the server device or terminal device according to the embodiments in a storage unit of the information processing device, and reading and executing the program by a CPU of the information processing device.

[0548] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims.

[0549] Furthermore, the methods described in the embodiments can be stored as a program executable by a computer on a recording medium such as a magnetic disk (e.g., a floppy disk, a hard disk, etc.), an optical disk (e.g., a CD-ROM, a DVD, an MO, etc.), or a semiconductor memory (e.g., a ROM, a RAM, a flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium also includes a configuration program for configuring software means (including not only execution programs but also tables and data structures) within the computer to be executed by the computer. The computer implementing this device reads the program stored on the recording medium and, in some cases, configures the software means using the configuration program, and executes the above-described processing by controlling the operation of this software means. The term "recording medium" as used herein is not limited to a storage medium for distribution, but also includes storage media such as a magnetic disk or semiconductor memory installed within the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory.

[0550] Furthermore, all of the objects sent and received in the information processing system of the present disclosure, such as the above-mentioned "gifts" and "comments," are electronic "data."

[0551] The Summary section above is provided to introduce selected concepts in a simplified form, which are described below in the Detailed Description section. All trademarks used herein are the property of their respective owners. The statements in this Summary section are not intended to identify key features or essential features of the claimed inventions, nor are they intended to limit the scope of the claimed inventions. The above and other objects, features, and advantages of the claimed inventions will become more apparent from the following Detailed Description section, taken in conjunction with the accompanying drawings.

[0552] The communication links for implementing the above-described networks may include, but are not limited to, a cellular network, a wireless network (e.g., RF connections via Bluetooth, WiFi (such as IEEE 802.11a / b / n), WiMax, cellular, satellite, laser, infrared), a landline network, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), and / or an Ethernet network.

[0553] The memory may include, but is not limited to, computer-readable media such as volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drives (HDD), solid-state drives (SSD), magnetic tape, optical media). As will be readily understood, the term "computer-readable recording medium" may include media for data storage, such as memory and storage, as well as transmission media, such as modulated data signals or transitory signals.

[0554] This specification is described in terms of various representative embodiments, which are not intended to be limiting in any way. As used in this application, singular forms such as "a," "the," "said," "the," "the," "this," and "the" can include the plural unless clearly indicated as not being plural. Also, the term "comprises" can mean "comprises" or "has." Furthermore, the terms "coupled," "coupled," "coupled," "connected," or "connected" encompass mechanical, electrical, magnetic, and optical ways of coupling, connecting, or joining objects together, among other ways, and do not exclude the presence of intermediate elements between objects so coupled, coupled, coupled, coupled, connected, or connected.

[0555] The various systems, methods, and devices described herein should not be construed as limiting in any way. Indeed, the present disclosure is directed to all novel features and aspects of each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. The various systems, methods, and devices described herein are not limited to specific aspects, features, or combinations of such aspects with specific features, nor do the products and methods described herein require that one or more particular advantages be present or problems be solved. Furthermore, various features or aspects of the various embodiments described herein, or portions of such features or aspects, may be used in combination with each other.

[0556] Although the operations of some of the various methods disclosed herein may be described in a particular order for convenience, it should be understood that description in this manner encompasses rearranging the order of the operations unless a particular order is required by specific text below. For example, operations described in a sequence may, in some cases, be rearranged or performed simultaneously. Furthermore, for purposes of simplicity, the accompanying drawings may not show the various ways in which the various items and methods described herein may be used in conjunction with other items and methods. In addition, the specification may use terms such as "generate," "generate," "display," "receive," "evaluate," and "deliver." These terms are high-level descriptions of the various actual operations that may be performed. The actual operations corresponding to these terms may vary depending on the particular implementation and will be readily discernible by one of ordinary skill in the art having the benefit of the disclosure herein.

[0557] Any theories of operation, scientific principles, or other theoretical descriptions presented herein in connection with the devices or methods of the present disclosure are provided for the purpose of better understanding and are not intended to limit the scope of the technology, and the devices and methods in the appended claims are not limited to devices and methods that operate in a manner described by such theories of operation.

[0558] Any of the various methods disclosed herein may be implemented using computer-executable instructions stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media, such as one or more optical media discs, volatile memory components, or non-volatile memory components), and executed on a computer. Here, the volatile memory components may include, for example, DRAM or SRAM. Also, the non-volatile memory components may include, for example, hard drives and solid-state drives (SSDs). Furthermore, the computer may include any computer available on the market, including, for example, smartphones and other mobile devices with computing hardware.

[0559] Any such computer-executable instructions for implementing the techniques disclosed herein, along with any data generated or used during the implementation of various embodiments disclosed herein, may be stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media). Such computer-executable instructions may, for example, be part of a separate software application, or may be part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may, for example, be executed on a single local computer (e.g., as an agent executing on any suitable commercially available computer) or in a networked environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more networked computers.

[0560] For clarity, only certain selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the techniques disclosed herein are not limited to a particular computer language or program. For example, the techniques disclosed herein may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed herein are not limited to a particular computer or type of hardware. Specific details of suitable computers and hardware are well known and need not be described in detail herein.

[0561] Moreover, any of the various software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) may be uploaded, downloaded, or remotely accessed by suitable communications means, including, for example, the Internet, the World Wide Web, an intranet, a software application, cable (including fiber optic cable), magnetic communication, electromagnetic communication (including RF, microwave, and infrared communication), electronic communication, or other such communications means. [Additional Notes] The following additional notes are about the inventions described in the claims of the original application of this application. [1] One or more computer processors: a transmitting unit that transmits information about a moving image including a character object of a first user to a second user terminal of a second user; a movement operation receiving unit that receives a movement operation of the character object of the first user in a virtual space; a virtual camera control unit that accepts camera operations of a virtual camera that captures images in the virtual space; a video generation unit that generates information for enabling a character object of the first user to move within the virtual space based on the movement operation and the camera operation; Equipped with applying a first movement action to a character object of the first user in response to a predetermined operation on a first operation UI displayed on a first user terminal of the first user; applying a second movement action to a character object of the first user in response to a predetermined operation on a second operation UI displayed on the first user terminal; switching a viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation on a third operation UI displayed on the first user terminal; An information processing system that applies movement, rotation, and / or scaling operations to the virtual camera in response to a predetermined operation on an area of ​​the first user terminal where the first operation UI, the second operation UI, and the third operation UI are not displayed. [2] the one or more computer processors: The information processing system according to claim 1, characterized in that the display of comments on the video displayed on the first user terminal is switched on or off in response to a predetermined operation on the first user terminal. [3] the one or more computer processors: The information processing system described in claim 2, characterized in that when the display of comments on the video is switched on or off, the display positions of the first operation UI and the second operation UI are changed, or the first operation UI, the second operation UI, and the third operation UI are hidden. [4] The information processing system according to claim 1, 2 or 3, characterized in that the first movement motion is horizontal movement and the second movement motion is vertical movement. [5] the one or more computer processors: applying a rotation operation to the virtual camera in response to a single-finger swipe operation on the region; applying a movement operation to the virtual camera in response to a two-finger swipe operation on the region; 5. The information processing system according to claim 1, wherein a zoom operation is applied to the virtual camera in response to a pinch-in / pinch-out operation with two fingers on the area. [6] The information processing system according to any one of claims 1 to 5, characterized in that the virtual camera control unit accepts camera operations from the first user or a user authorized by the first user. [7] The facial movement of the character object of the first user is generated based on the facial movement of the first user captured by an in-camera of the first user terminal; The information processing system according to any one of claims 1 to 6, characterized in that the video generation unit generates the facial movement of the first user's character object in an inverted or non-inverted state depending on the positional relationship between the first user's character object and the virtual camera. [8] The information processing system of any one of claims 1 to 7, characterized in that the video generation unit causes the character object of the first user to reappear from another position within the virtual space if the character object moves beyond the movable area. [9] one or more computer processors, a transmitting step of transmitting information about the moving image including the character object of the first user to a second user terminal of a second user; a movement operation receiving step of receiving a movement operation of the character object of the first user in a virtual space; a virtual camera control step of accepting a camera operation of a virtual camera that captures images in the virtual space; a video generation step of generating information for enabling the character object of the first user to move within the virtual space based on the movement operation and the camera operation; Execute In the video generation step, applying a first movement action to a character object of the first user in response to a predetermined operation on a first operation UI displayed on a first user terminal of the first user; applying a second movement action to a character object of the first user in response to a predetermined operation on a second operation UI displayed on the first user terminal; switching a viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation on a third operation UI displayed on the first user terminal; An information processing method that applies movement, rotation, and / or scaling operations to the virtual camera in response to a predetermined operation on an area in the first user terminal where the first operation UI, the second operation UI, and the third operation UI are not displayed.

[10] one or more computer processors, a transmitting step of transmitting information about a moving image including a character object of the first user to a server device; a movement operation receiving step of receiving a movement operation of the character object of the first user in a virtual space; a virtual camera control step of accepting a camera operation of a virtual camera that captures images in the virtual space; a video generation step of generating information for enabling the character object of the first user to move within the virtual space based on the movement operation and the camera operation; Execute In the video generation step, applying a first movement action to a character object of the first user in response to a predetermined operation on a first operation UI displayed on a first user terminal of the first user; applying a second movement action to a character object of the first user in response to a predetermined operation on a second operation UI displayed on the first user terminal; switching a viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation on a third operation UI displayed on the first user terminal; An information processing method that applies movement, rotation, and / or scaling operations to the virtual camera in response to a predetermined operation on an area in the first user terminal where the first operation UI, the second operation UI, and the third operation UI are not displayed.

[11] one or more computer processors, a transmission function for transmitting information about a video including a character object of the first user to a server device; a movement operation receiving function that receives a movement operation of the character object of the first user in a virtual space; a virtual camera control function that accepts camera operations of a virtual camera that captures images in the virtual space; a video generation function that generates information for enabling the character object of the first user to move within the virtual space based on the movement operation and the camera operation; To achieve this, The video generation function is applying a first movement action to a character object of the first user in response to a predetermined operation on a first operation UI displayed on a first user terminal of the first user; applying a second movement action to a character object of the first user in response to a predetermined operation on a second operation UI displayed on the first user terminal; switching a viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation on a third operation UI displayed on the first user terminal; A computer program that applies movement, rotation, and / or scaling operations to the virtual camera in response to a predetermined operation on an area of ​​the first user terminal where the first operation UI, the second operation UI, and the third operation UI are not displayed.

[12] one or more computer processors, a receiving step of receiving information about a moving image including a character object of a first user and a character object of a second user from a server device; a movement operation receiving step of receiving a movement operation of the character object of the second user in a virtual space; a virtual camera control step of accepting a camera operation of a virtual camera that captures images in the virtual space; a transmitting step of transmitting information about the movement operation and the camera operation to the server device; a display step of displaying the character object of the first user and the character object of the second user movably in the virtual space; Execute applying a first movement action to a character object of the second user in response to a predetermined operation on a first operation UI displayed on a second user terminal of the second user; a second movement action is applied to the character object of the first user in response to a predetermined operation on a second operation UI displayed on the second user terminal; a viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation on a third operation UI displayed on the second user terminal; An information processing method in which the virtual camera is moved, rotated, and / or scaled in response to a predetermined operation performed on an area of ​​the second user terminal in which the first operation UI, the second operation UI, and the third operation UI are not displayed.

[13] one or more computer processors, a receiving function for receiving information about a video including a character object of a first user and a character object of a second user from a server device; a movement operation receiving function that receives a movement operation of the character object of the second user in a virtual space; a virtual camera control function that accepts camera operations of a virtual camera that captures images in the virtual space; a transmission function of transmitting information about the movement operation and the camera operation to the server device; a display function for displaying a character object of the first user and a character object of the second user movably within the virtual space; To achieve this, applying a first movement action to a character object of the second user in response to a predetermined operation on a first operation UI displayed on a second user terminal of the second user; a second movement action is applied to the character object of the first user in response to a predetermined operation on a second operation UI displayed on the second user terminal; a viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation on a third operation UI displayed on the second user terminal; A computer program that applies operations to move, rotate, and / or zoom the virtual camera in accordance with a predetermined operation performed on an area of ​​the second user terminal where the first operation UI, the second operation UI, and the third operation UI are not displayed. [Explanation of symbols]

[0562] 1000 Information Processing Systems 2000 Information Processing Systems 3000 Information Processing Systems 100 First user terminal 200 Second user terminal 300 Network 400 Server device

Claims

[Claim 1] The one or more computer processors a transmitting unit that transmits information about a moving image including a character object of a first user to a second user terminal of a second user; a movement operation receiving unit that receives a movement operation of the character object of the first user in a virtual space; a virtual camera control unit that accepts camera operations of a virtual camera that captures images in the virtual space; a video generation unit that generates information about a video in which a character object of the first user moves within the virtual space based on the movement operation and the camera operation; Equipped with The virtual camera control unit is an information processing system that accepts camera operations from a user authorized by the first user.

Images