Information processing system, information processing method, and computer program
The information processing system addresses the challenge of user engagement by enabling dynamic video switching and interactive elements within a virtual space, thereby enhancing streaming, viewing, and user interaction desires.
Patent Information
- Application Number
- JP2024048901
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-03-26
- Publication Date
- 2025-03-18
- Estimated Expiration
- 2041-10-29
AI Technical Summary
Existing information processing systems fail to effectively enhance the desire for streaming users to stream, viewing users to view, and users to interact with each other.
An information processing system that allows for the transmission of moving images with character objects, enabling video switching between different objects and regions in a virtual space, while maintaining the display of existing objects and allowing for interactive elements like gift objects and effects.
Improves user engagement by providing dynamic and interactive video content, increasing the desire for streaming and viewing, and enhancing user interaction within the system.
Smart Images

Figure 0007648113000001 
Figure 0007648113000002 
Figure 0007648113000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing system, an information processing method, and a computer program. [Background technology]
[0002] 2. Description of the Related Art There is known an information processing system that generates animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2015-184689 A Summary of the Invention [Problem to be solved by the invention]
[0004] In this technical field, how to increase distribution users' willingness to distribute, viewing users' willingness to view, and / or users' willingness to interact with each other is an important issue.
[0005] Therefore, an object of the present disclosure is to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. A more specific object of the present disclosure is to provide an information processing system, an information processing method, and a computer program that can improve the distribution motivation of distribution users, the viewing motivation of viewing users, and / or the motivation of users to interact with each other. [Means for solving the problem]
[0006] The information processing system of the present disclosure is characterized in that one or more computer processors include a transmitting unit that transmits information regarding a video including a character object of a first user to a second user terminal of a second user; a receiving unit that receives a request to display a first object from the second user terminal; a first video generation unit that generates first information for displaying the character object of the first user and the first object in a first area in a virtual space as a first video; a second video generation unit that generates second information for displaying a second object different from the first object in a second area in the virtual space as a second video and displaying the character object of the first user movably in the first area and the second area; and a video switching unit that switches the video to be displayed on the second user terminal between the first video and the second video in response to an instruction from the first user terminal of the first user.
[0007] When the video switching unit switches the video from a first video to a second video, the second video generation unit can generate second information while maintaining the display of the already-displayed first object in the first area.
[0008] When the video switching unit switches the video from the second video to the first video, the first video generation unit can generate the first information while maintaining the display of the already-displayed first object in the first area.
[0009] The second moving image generating section can change at least the second object to another second object based on a predetermined condition.
[0010] The predetermined condition may be the arrival of a scheduled time, the lapse of a scheduled time, or the receipt of a change instruction from the first user or another user.
[0011] The second video generating section can generate the second information while maintaining the display of the already-displayed first object in the first area or the second area, even when the second object is changed to another second object.
[0012] The one or more computer processors may further include an effect generating unit that generates a predetermined effect when an already displayed first object or a newly displayed first object has a specific relationship with a second object.
[0013] The one or more computer processors may further include a movement operation receiving unit that receives movement operations of the first user's character object within the virtual space, and a virtual camera control unit that controls the operation of a virtual camera that captures images within the virtual space.
[0014] a facial movement of the character object of the first user is generated based on the facial movement of the first user captured by the in-camera of the first user terminal, and a first video generation unit generates the facial movement of the character object of the first user in an inverted state with respect to the facial movement of the first user; The second video generation unit can generate the movement of the face of the first user's character object in an inverted or non-inverted state, depending on the positional relationship between the first user's character object and the virtual camera.
[0015] When the character object of the first user moves beyond the movable area, the second video generation section can make the character object reappear from another position within the virtual space.
[0016] The information processing method of the present disclosure is characterized in that it has one or more computer processors execute a transmitting step of transmitting information regarding a video including a character object of a first user to a second user terminal of a second user; a receiving step of receiving a display request for a first object from the second user terminal; a first video generation step of generating first information for displaying the character object of the first user and the first object in a first area in a virtual space as a first video; a second video generation step of generating second information for displaying a second object different from the first object in a second area in the virtual space as a second video and displaying the character object of the first user movably in the first area and the second area; and a video switching step of switching the video to be displayed on the second user terminal between the first video and the second video in response to an instruction from the first user terminal of the first user.
[0017] The information processing method of the present disclosure is characterized by having one or more computer processors execute a transmitting step of transmitting information regarding a video including a character object of a first user to a server device; a first video generation step of generating first information for displaying, as a first video, the character object of the first user and a first object requested to be displayed from a second user terminal of a second user in a first area in a virtual space; a second video generation step of generating second information for displaying, as a second video, a second object different from the first object in a second area in the virtual space and displaying the character object of the first user movably in the first area and the second area; and a video switching step of switching the video to be displayed on the second user terminal between the first video and the second video in response to an instruction from the first user.
[0018] The computer program of the present disclosure is characterized in that it realizes, in one or more computer processors, a transmission function for transmitting information regarding a video including a character object of a first user to a server device; a first video generation function for generating first information for displaying, as a first video, the character object of the first user and a first object requested to be displayed from a second user terminal of a second user in a first area in a virtual space; a second video generation function for generating second information for displaying, as a second video, a second object different from the first object in a second area in the virtual space and displaying the character object of the first user movably in the first area and the second area; and a video switching function for switching the video to be displayed on the second user terminal between the first video and the second video in response to an instruction from the first user.
[0019] The information processing method of the present disclosure is characterized in that it has one or more computer processors execute a receiving step of receiving information regarding a video including a character object of a first user from a server device, a transmitting step of transmitting a display request for the first object to the server device, and a display step of switching between a first video in which the first user's character object and the first object are displayed in a first area in a virtual space and a second video in which a second object different from the first object is displayed in a second area in the virtual space and the first user's character object is displayed movably between the first area and the second area in response to an instruction from the first user.
[0020] The computer program of the present disclosure is characterized in that it causes one or more computer processors to realize a receiving function for receiving information regarding a video including a character object of a first user from a server device, a transmitting function for transmitting a display request for the first object to the server device, and a display function for switching between a first video in which the first user's character object and the first object are displayed in a first area in a virtual space and a second video in which a second object different from the first object is displayed in a second area in the virtual space and the first user's character object is displayed movable between the first area and the second area in response to an instruction from the first user. Effect of the Invention
[0021] According to the present disclosure, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the present disclosure, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other. [Brief description of the drawings]
[0022] [Figure 1] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Diagram 2] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Diagram 3] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 4] FIG. 2 is a configuration diagram showing an example of a hardware configuration of a server device, a first user terminal, and a second user terminal in the present disclosure. [Diagram 5] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 6] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 7] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 8]FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 9] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 10] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 11] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 12] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 13] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 14] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 15] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 16] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 17] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 18] FIG. 2 is a configuration diagram illustrating an example of a functional configuration of a server device according to the first embodiment of the present disclosure. [Figure 19] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 20] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 21] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 22] FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. [Diagram 23] FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. [Figure 24] FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. [Diagram 25] FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. [Figure 26]FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 27] FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. [Figure 28] FIG. 11 is a configuration diagram showing another example of the functional configuration of the server device according to the first embodiment of the present disclosure. [Figure 29] FIG. 11 is a configuration diagram illustrating an example of a functional configuration of a server device according to a second embodiment of the present disclosure. [Diagram 30] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Diagram 31] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Diagram 32] FIG. 11 is a configuration diagram showing another example of the functional configuration of the server device according to the second embodiment of the present disclosure. [Diagram 33] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Diagram 34] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Diagram 35] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Diagram 36] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 37] FIG. 13 is a configuration diagram illustrating an example of a functional configuration of a server device according to a third embodiment of the present disclosure. [Figure 38] FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. [Figure 39] FIG. 11 is a conceptual diagram showing an image of a third object and a fourth object in the present disclosure. [Diagram 40] FIG. 2 is a conceptual diagram showing an image of a loading image in the present disclosure. [Diagram 41] FIG. 13 is a configuration diagram showing another example of the functional configuration of the server device according to the third embodiment of the present disclosure. [Diagram 42] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Diagram 43] FIG. 2 is a flow diagram showing an example of a processing flow in the present disclosure. [Diagram 44] FIG. 2 is a flow diagram showing an example of a processing flow in the present disclosure. [Diagram 45] FIG. 13 is a conceptual diagram showing an image of a fifth object in the present disclosure. [Figure 46] FIG. 13 is a configuration diagram showing an example of a functional configuration of a first user terminal in a fourth embodiment of the present disclosure. [Figure 47] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 48] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 49] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 50] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 51] FIG. 13 is a configuration diagram showing an example of a functional configuration of a first user terminal in a fifth embodiment of the present disclosure. [Figure 52] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 53] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 54] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 55] FIG. 13 is a configuration diagram showing another example of the functional configuration of the first user terminal in the fifth embodiment of the present disclosure. [Figure 56] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 57] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 58] FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 59] FIG. 1 is a flow diagram showing an example of the flow of an information processing method according to the present disclosure. [Figure 60]FIG. 2 is a circuit configuration diagram showing an example of a circuit configuration for implementing a computer program according to the present disclosure. [Figure 61] FIG. 2 is a configuration diagram showing an example of a functional configuration of a first user terminal in the present disclosure. [Figure 62] 11 is a flow diagram showing an example of the flow of an information processing method in a first user terminal in the present disclosure. [Figure 63] FIG. 2 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a first user terminal in the present disclosure. [Figure 64] FIG. 2 is a configuration diagram showing an example of a functional configuration of a second user terminal in the present disclosure. [Figure 65] 11 is a flow diagram showing an example of the flow of an information processing method in a second user terminal in the present disclosure. [Figure 66] FIG. 11 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a second user terminal in the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] First, an overview of an information processing system according to an embodiment of the present disclosure will be described with reference to the drawings.
[0024] The information processing system in the present disclosure is an information processing system including one or more information processing devices and a server device, and includes one or more computer processors.
[0025] The video displayed on each device will be described as including animation of a character object generated based on the broadcasting user's movements, but is not limited to this and may include animation of a character object generated in response to the broadcasting user's operations, or may include an image of the broadcasting user himself / herself. Also, these character objects and the broadcasting user may not be displayed, and only the voice of the broadcasting user may be included.
[0026] The space displayed in the video may be a virtual space, a real space, or an augmented reality space that combines these. The video may be something like a karaoke video or a game commentary video that reproduces at least a predetermined image and the voice of the broadcasting user, or may be a display in which a character object or an actual image of the broadcasting user is superimposed on the above.
[0027] Furthermore, when a broadcast user is included in the real space, a character object generated based on the movement of the broadcast user may be displayed superimposed on an actual image of the broadcast user. Also, an animation of a gift object or the like may be displayed superimposed on an image captured in the real space.
[0028] The information processing system in an embodiment of the present disclosure can be used to provide a next Internet space (metaverse) in which many people can participate simultaneously and freely engage in activities such as interacting, working, and playing through character objects (avatars) at a level close to that of the real world, transcending the gap between reality and virtuality and enabling social activities.
[0029] In this embodiment, as one element of the metaverse, it can be used to realize a "world function" that allows one's avatar (character object) to roam freely in a virtual space and communicate with others.
[0030] <System configuration> As shown as an example in FIG. 1, the information processing system 1000 according to the present disclosure may include one or more viewing user terminals 1100, and an information processing device (support computer) 1300 located in a video distribution studio or the like, which is connected to these viewing user terminals 1100 via a network 1200.
[0031] Moreover, the information processing device 1300 may be connected to a server device via the Internet, and the server device may perform part or all of the processing that should be performed by the information processing device 1300. The server device may be the information processing device 2400 shown in FIG.
[0032] In this specification, such distribution by the information processing system 1000 is referred to as studio distribution.
[0033] In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.
[0034] Furthermore, the information processing system 1000 of the present invention can cooperate with another information processing system 2000 shown as an example in Fig. 2. The information processing system 2000 shown in Fig. 2 can include a broadcaster user terminal 2100, one or more viewer user terminals 2200, and an information processing device (server device) 2400 connected to the broadcaster user terminal 2100 and the viewer user terminal 2200 via a network 2300.
[0035] In the above example, the broadcaster user terminal 2100 may be an information processing terminal such as a smartphone. In this specification, such broadcasting by the information processing system 2000 is referred to as mobile broadcasting.
[0036] In mobile distribution, the broadcast user's facial movements are captured by a camera mounted on the broadcast user terminal 2100, and are reflected on the character's face in real time using known face tracking technology.
[0037] In addition, there is no particular distinction between distributor users and viewing users in mobile distribution; viewing users can perform mobile distribution at any time, and distributor users can become viewing users when viewing videos of other distributor users.
[0038] The moving images generated by the information processing system 1000 and the information processing system 2000 can be distributed to viewing users from one moving image distribution platform, for example.
[0039] In addition, in any broadcast, the process of generating animation by reflecting motion on a character and the process of displaying gifts, which will be described later, may be shared and performed by the broadcasting user terminal, the viewing user terminal, an information processing device, and other devices.
[0040] In other words, "distribution" here refers to the transmission of information to enable the video to be viewed on the viewing user's terminal, and the rendering of the video may be performed on the information processing device 1300, 2400 side, or on the distribution user terminal 2100 or the viewing user terminal 1100, 2200 side.
[0041] Specifically, face motion data and voice data of a broadcast user are transmitted from a broadcast user terminal or an information processing device to a terminal or device that generates (renders) animation of a character object. Also, body motion may be transmitted in addition to face motion.
[0042] In the present disclosure, the process of generating animation will be described as being performed by each of the broadcasting user terminal and the viewing user terminal, but this is not limited to the above.
[0043] The information processing system in the present disclosure can be applied to both of the examples shown in Fig. 1 and Fig. 2. Since it is not necessary to distinguish between a "distribution user" and a "viewing user", the information processing system 3000 in the embodiment of the present disclosure will be described as including a first user terminal 100, a second user terminal 200, and a server device 400 connectable to the first user terminal 100 and the second user terminal 200 via a network 300, as shown in Fig. 3.
[0044] The first user terminal 100 functions at least as the above-mentioned information processing device 1300 or the broadcasting user terminal 2100, the second user terminal 200 functions at least as one or more of the above-mentioned viewing user terminals 1100, 2200, and the server device 400 functions at least as the above-mentioned server device or information processing device 2400.
[0045] In the present disclosure, the first user terminal 100 and the second user terminal 200 may be a smartphone (multifunction phone terminal), a tablet terminal, a personal computer, a console game machine, a head mounted display (HMD), a wearable computer such as a glasses-type wearable terminal (AR glasses, etc.), or an information processing device capable of playing videos other than these devices. Furthermore, these terminals may be standalone devices that operate independently, or may be composed of multiple devices connected to each other so that they can transmit and receive various data.
[0046] <Hardware configuration> Here, the hardware configuration of the first user terminal 100 will be described with reference to Fig. 4. The first user terminal 100 includes a processor 101, a memory 102, a storage 103, an input / output interface (input / output I / F) 104, and a communication interface (communication I / F) 105. The components are connected to each other via a bus B.
[0047] The first user terminal 100 can realize the functions and methods described in this embodiment through cooperation between a processor 101, a memory 102, a storage 103, an input / output I / F 104, and a communication I / F 105.
[0048] The processor 101 executes functions and / or methods realized by codes or instructions included in a program stored in the storage 103. The processor 101 includes, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may realize each process disclosed in each embodiment by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large scale integration (LSI)), etc.). These circuits may be realized by one or more integrated circuits, and a plurality of processes shown in each embodiment may be realized by one integrated circuit. An LSI may also be called a VLSI, a super LSI, an ultra LSI, etc., depending on the degree of integration.
[0049] The memory 102 temporarily stores the programs loaded from the storage 103 and provides a working area for the processor 101. The memory 102 also temporarily stores various data generated while the processor 101 is executing the programs. The memory 102 includes, for example, a random access memory (RAM) and a read only memory (ROM).
[0050] The storage 103 stores programs. The storage 103 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, and the like.
[0051] The communication I / F 105 is implemented as hardware such as a network adapter, communication software, or a combination of these, and transmits and receives various data via the network 300. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication I / F 105 executes communication with other information processing devices via the network 300. The communication I / F 105 transmits various data to other information processing devices according to instructions from the processor 101. The communication I / F 105 also receives various data transmitted from other information processing devices and transmits it to the processor 101.
[0052] The input / output I / F 104 includes an input device for inputting various operations to the first user terminal 100, and an output device for outputting processing results processed by the first user terminal 100. The input / output I / F 104 may be an integrated input device and output device, or may be separate input device and output device.
[0053] The input device is realized by any one or a combination of all kinds of devices that can receive input from a user and transmit information related to the input to the processor 101. The input device includes, for example, a touch panel, a touch display, hardware keys such as a keyboard, a pointing device such as a mouse, a camera (operation input via an image), and a microphone (operation input by voice).
[0054] The input device may include a sensor unit. The sensor unit is one or more sensors that detect face motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body with respect to the sensor unit. Face motions include blinking, opening and closing of the mouth, and other movements. The sensor unit may be a publicly known one. An example of the sensor unit includes a ToF sensor that measures and detects the time of flight (Time of Flight) until light irradiated toward the user is reflected by the user's face or the like and returns, a camera that photographs the user's face, and an image processing unit that performs image processing on the data photographed by the camera. The sensor unit may also include an RGB camera that photographs visible light and a near-infrared camera that photographs near-infrared light. For the RGB camera and the near-infrared camera, for example, True Depth of the "iPhoneX (registered trademark)", or "LIDER" of the "iPad Pro (registered trademark)", or other ToF sensors mounted on smartphones can be used. Specifically, this camera projects tens of thousands of invisible dots (points) onto the user's face or the like using a dot projector. Then, the reflected light of the dot pattern is detected and analyzed to form a depth map of the face, and an infrared image of the face, etc. is captured, thereby capturing accurate facial data. The arithmetic processing unit of the sensor unit generates various information based on the depth map and the infrared image, and compares the information with registered reference data to calculate the depth of each point of the face (the distance between each point and the near-infrared camera) and positional deviations other than the depth.
[0055] The sensor unit may have a function of tracking not only the user's face but also the user's hands (hand tracking). The sensor unit may further include sensors other than the above-mentioned sensors, such as an acceleration sensor or a gyro sensor. The sensor unit may have a spatial mapping function of recognizing an object in the real space where the user exists based on the detection result of the above-mentioned ToF sensor or other known sensors, and mapping the recognized object on a spatial map. Hereinafter, when the face motion detection data and the body motion detection data are not particularly distinguished from each other, they are simply referred to as "tracking data". The image processing unit of the sensor unit may be provided in a control unit that can be provided in the information processing system of the present invention.
[0056] The operation unit as an input device can be one that corresponds to the type of the user terminal. Examples of the operation unit include a touch panel integrated with a display, operation buttons provided on the housing of the user terminal, a keyboard, a mouse, and a controller operated by the user's hand. The controller may incorporate various known sensors such as an acceleration sensor, an inertial measurement unit (IMU) such as a gyroscope, etc. Another example of the operation unit may be a tracking device that identifies the user's hand movement, eye movement, head movement, line of sight, etc. In this aspect, for example, the user's instruction can be determined based on the user's hand movement, and various operations can be performed such as starting or ending the distribution of a video, rating a message or a video, and requesting the display of a predetermined object (for example, a gift to be described later). Note that if the sensor unit also has an input interface function such as a hand truck function, the operation unit can be omitted.
[0057] The output device outputs the results of processing performed by the processor 101. The output device includes, for example, a touch panel, a speaker, and the like.
[0058] Moreover, the second user terminal 200 and the server device 400 in the present disclosure can also be configured with the same hardware configuration as that in FIG. 4, unless otherwise noted.
[0059] Next, various functions that can be executed on a user terminal that has launched an application realized by the information processing system according to an embodiment of the present disclosure, and transitions of displayed screens will be described with reference to the drawings.
[0060] FIG. 5 shows a top screen T10 that is displayed on a user terminal when a video distribution and viewing application is launched.
[0061] As shown in FIG. 5, a user can watch a video being played on a distribution channel by selecting a distribution channel (distribution slot, distribution program, distribution video, etc.) from thumbnail images of one or more recommended distribution channels T12 listed in a recommendation tab T11 on the top screen T10.
[0062] Alternatively, a user can view a video being played on a specific distribution channel by accessing a fixed link for the specific distribution channel. Such a fixed link can be obtained from a notification from a distribution user that the user is following, or a share notification sent by another user.
[0063] In this way, the user who watches the video becomes a viewing user, and the terminal at which the video is watched becomes the second user terminal 200.
[0064] 5, the top screen T10 may display a display field T13 for announcements such as campaigns and events. This announcement display field T13 can be switched to display other announcements by a sliding operation.
[0065] From the top screen T10, a follow tab T14, a game tab T15 for displaying game categories, a collaboration waiting tab T16 for displaying distribution channels waiting for collaboration, and a beginner tab T17 for displaying distribution channels for beginners are displayed. By selecting these (by switching between tabs), the top screen T10 transitions to each of the different screens.
[0066] The service name display T18 and the search button T19 in the upper frame of the top screen T10 may be fixed and remain displayed on the transition destination screen.
[0067] Similarly, the home button T20, message button T21, delivery preparation button T22, gacha button T23, and profile button T24 in the lower frame of the top screen T10 may also be fixed and remain displayed on the transition destination screen.
[0068] A user who selects a displayed thumbnail image T12 on the top screen T10 shown in FIG. 5, for example, can become a viewing user (second user) who watches the video as described above, and a user who selects the distribution preparation button T22 can become a distribution user (first user) who distributes the video.
[0069] As an example, when a distribution preparation button T22 is selected on the top screen T10 shown in Fig. 5, the screen transitions to an avatar setting screen D10 shown in Fig. 6. Then, when a distribution button D11 is selected on the avatar setting screen D10, the screen transitions to a distribution setting screen D20 shown in Fig. 7. Then, when a distribution start button D25 is selected on the distribution setting screen D20, the screen transitions to an avatar distribution screen D30 shown in Fig. 8.
[0070] Next, we will explain the details of the flow up to the start of video distribution.
[0071] The one or more computer processors in the present disclosure may include a distribution start request receiving unit, a distribution setting unit, and a distribution starting unit.
[0072] The distribution start request receiving unit receives a request to start distribution of a first moving image including animation of a character object from a broadcast user terminal of a broadcast user.
[0073] Here, the first moving image refers to a moving image including animation of a character object. In this specification, a character object may be called an "avatar."
[0074] The distribution start request can be transmitted from a user terminal (later becoming the distribution user terminal 2100) to the information processing device 2400 by selecting a distribution button D11 located on an avatar setting screen or the like transitioned to from the above-mentioned top screen displayed on the user terminal that has launched a dedicated application (video distribution / viewing application) for accessing the video distribution platform.
[0075] 6 shows an example of an avatar setting screen D10. A character object CO, a distribution button D11, a gacha button D12, a change of clothes button D13, a photo button D14, and the like can be displayed on the avatar setting screen D10.
[0076] When the user selects the change clothes button D13, a closet screen appears for selecting various avatar parts for the character object CO, such as eyes, nose, mouth, hair, accessories, clothes, and background.
[0077] When the user selects the gacha button D12, a lottery screen for obtaining the avatar parts appears.
[0078] When the user selects the photo button D14, a shooting screen for taking a still image of the character object appears.
[0079] When the user selects the distribution button D11, a distribution start request is transmitted to the information processing device 2400 (server device 400).
[0080] The distribution setting section sets distribution settings for the first moving image based on instructions from the distributor user terminal 2100 in response to a distribution start request for the first moving image received by the distribution start request receiving section.
[0081] As an example, when the broadcast button D11 is selected, the screen displayed on the broadcast user terminal 2100 transitions from the avatar setting screen D10 shown in FIG. 6 to the broadcast setting screen D20 shown in FIG.
[0082] The distribution settings may include at least one of a setting regarding the title of the first video, a setting regarding whether other users may appear in the first video, a setting regarding the number of people who may appear in the first video, and a setting regarding a password.
[0083] These distribution settings can be set in a title setting field D21, a collaboration permission setting field D22, a number of people setting field D23, and a password setting field D24 in Fig. 7. In Fig. 7, a collaboration permission setting field D26 for anyone and an SNS posting permission field D27 are also displayed.
[0084] The title of the first video can be freely determined by the broadcasting user within the range of the maximum number of characters allowed. If there is no input by the broadcasting user, a preset title including the name of the broadcasting user or character object, such as "This is XXX's broadcast," may be automatically determined.
[0085] The distribution user can freely decide whether or not other users can appear in the first video. If it is yes, other users can make an appearance request to the distribution user, and if it is no, other users cannot make an appearance request to the distribution user. In this specification, the state in which other users appear in the distribution user's video is sometimes called "collaboration." Details of collaboration will be described later.
[0086] The number of people who can appear in the first video can only be set if other users are allowed to appear in the first video as described above, and can be freely determined by the distribution user within the range of the allowable upper limit.
[0087] The password can be set arbitrarily only if other users are allowed to appear in the first video, and the distribution user can freely decide the number of digits specified. When other users apply to appear in the first video, they are required to enter the password. Note that the password setting field D24 may be configured to be active only when the collaboration permission setting field D26 for anyone is OFF.
[0088] The distribution starting unit distributes information about the first moving image to the viewing user terminal 2200 of the viewing user based on the conditions set by the distribution setting unit.
[0089] The instruction to start such distribution is transmitted by selecting the distribution start button D25 shown in FIG.
[0090] As an example, the distribution starting unit distributes (avatar distributes) information about a video (first video) including animation of the distributor user's character object to the viewing user terminal 2200 of the viewing user.
[0091] The information about the first moving image includes, for example, motion information showing the movement of a character object, voice information of the broadcasting user, gift object information showing gifts sent from other viewing users, etc. The gift object information includes at least gift object identification information that specifies the type of the gift object, and position information that indicates the position where the gift object is displayed.
[0092] The distribution starting unit can then live-distribute the video via the video distribution platform described above.
[0093] FIG. 8 shows an avatar distribution screen D30 displayed on the broadcaster user terminal 2100.
[0094] The avatar distribution screen D30 displays a character object CO, as well as a comment input button D31 for the distribution user to input a comment, a photo button D32 for saving a still image of the screen, a start play button D33 for playing a game described below, an external service linkage button D34 for watching videos provided by an external service, and a gacha button D12 for obtaining avatar parts.
[0095] Also, at the top of the avatar distribution screen D30, a cumulative viewer count display D35, a cumulative like count display D36, a collaborator count display D37, a share button for external SNS D38, a guest details button D39, a ranking display button D40, a settings button D41, and an audio switch button D42 for switching audio ON / OFF can be displayed. Also, an end button D43 for ending the distribution is displayed.
[0096] Although detailed description of these displays and buttons will be omitted, by selecting the setting button D41, it is possible to change the distribution settings made on the distribution setting screen D20.
[0097] 8 shows an example in which distribution has been started with the distribution setting screen D20 set to allow other users to appear in the first video and the number of people who can appear in the first video set to three, so character object CO is displayed shifted to the lower left. Up to three character objects of other users can appear in the empty space.
[0098] This concludes the description of the screen transitions when delivering an avatar according to the invention of the present disclosure.
[0099] Next, the screen transitions that occur when a broadcaster user plays a game during broadcast will be described.
[0100] The one or more computer processors in the present disclosure may include a game request receiving unit, a game video distribution unit, and a game display processing unit.
[0101] During avatar distribution as shown in FIG. 8, the distributor user can request to start playing the game by selecting the start play button D33.
[0102] Note that the game displayed by selecting the play start button D33 is a dedicated game implemented in an application realized by the information processing system in the present disclosure, and may be different from a general-purpose game provided by an external service. Therefore, the game distribution in the present disclosure may be distinguished from the distribution of a play video of a general-purpose game provided by an external service together with a live commentary by a distribution user.
[0103] Alternatively, the request to start play can be transmitted from the broadcast user terminal 2100 to the information processing device 2400 by selecting a start play button located on a specified screen displayed on the broadcast user terminal 2100 of the broadcast user.
[0104] Fig. 9 shows an example of a screen G10 on which a play start button G11 is arranged as the above-mentioned predetermined screen. The screen G10 shown in Fig. 9 is a screen transitioned to by selecting a game tab T15 from a top screen T10 (Fig. 5) displayed on a user terminal that has started an application realized by the information processing system in the present disclosure.
[0105] At least a play start button G11 capable of transmitting a request to start playing a predetermined game is displayed on the screen G10.
[0106] Then, when the game request receiving unit receives a request to start playing a specific game, the game video distribution unit distributes information about the second video to the viewing user terminal.
[0107] Here, the second video is a video of a specific game being played. In this specification, the delivery of such a video so that it is displayed on the screen of the viewing user terminal 2200 is referred to as "game delivery."
[0108] In addition, after launching the application realized by the invention of the present disclosure, the user can, as a distribution user, send a request to start distribution of the second video to the information processing device 2400 by selecting a play start object placed on the game list screen and the game details screen.
[0109] The game list screen or the game details screen is the first screen, which will be described in detail next.
[0110] That is, the game display processing unit performs display processing of a first screen including a distribution start object capable of sending a request to start distribution, a play start object capable of sending a request to start playing a specified game, and a thumbnail image of a video of gameplay of a specified game currently being distributed.
[0111] 9 corresponds to a game list screen of the first screen. The first screen, which is the game list screen, is a screen transitioned to by selecting the game tab T15 from the top screen T10.
[0112] The first screen includes a distribution preparation button T22 as a distribution start object, a play start button G11 as a play start object, and a thumbnail image indicating a distribution channel of the video.
[0113] The first screen displays, for each of a number of playable games, a start play button G11, a game icon G12, the game name G13, the total number of viewers of the game's distribution channel G14, and a distribution list G15 including thumbnail images of the distribution channels currently distributing the game.
[0114] The order of thumbnail images displayed in the distribution list G15 can be different for each viewing user. As an example, the order is arranged in the order of the number of views by the viewing user who follows them, the number of cumulative viewers, and the oldest distribution start. The display range of the thumbnail images in the distribution list G15 can be changed by scrolling horizontally.
[0115] The games displayed on this game list screen are the top 10 titles with the following priorities: As an example, the priorities are determined by the most recent date the viewing user last played the game within 48 hours of the game distribution start date and time within the last 30 days, the highest priority of the period ID, and descending order of the period ID.
[0116] This distribution list G15 is updated when the user returns from another tab screen or when a pull-to-refresh operation is performed.
[0117] 10 corresponds to the game details screen of the first screen. The first screen, which is the game details screen, is G20, which is a screen transitioned to by selecting the game icon G12 or the game name G13 displayed on the game list screen shown in FIG.
[0118] The first screen includes a distribution preparation button T22 which is a distribution start object, a play start button G21 which is a play start object, and a thumbnail image indicating a distribution channel of the video.
[0119] The first screen also displays a game icon G22, a game name G23, the total number of viewers of the game's distribution channel G24, and a distribution list G25 including thumbnail images of distribution channels currently distributing the game.
[0120] The order of thumbnail images displayed in the distribution list G25 can be different for each viewing user. As an example, the order is arranged in the order of the number of views by the viewing user who follows the content, the number of cumulative viewers, and the oldest distribution. The display range of the thumbnail images in the distribution list G25 can be changed by vertical scrolling.
[0121] This distribution list G25 is updated when the user returns from another tab screen or when a pull-to-refresh operation is performed.
[0122] As described above, a user who selects a distribution start object or a play start object becomes a distribution user who makes a distribution start request or a play start request.
[0123] Furthermore, the user who selects the thumbnail image becomes a viewing user who views the second moving image.
[0124] The first screen also includes a first area in which scrolling is not possible, and a second area in which scrolling is possible.
[0125] The first screen here refers to the first screen shown in Fig. 10. The first screen includes a first area R1 and a second area R2. Specifically, the game title is displayed in the first area R1, and the above-mentioned play start button G21, game icon G22, game name G23, viewer count G24, and distribution list G25 are displayed in the second area R2.
[0126] The first area R1 is a fixed area on the display screen that cannot be scrolled, and the second area R2 is an area that can be scrolled by the user. By scrolling the second area R2, the user can check thumbnail images that are hidden outside the screen.
[0127] However, since there is a risk that the play start button G21 will be hidden off-screen by scrolling the second area, the display processing unit in the present disclosure can display the play start object (play start button G21) in the first area R1 depending on the display state of the play start object (play start button G21) displayed in the second area R2.
[0128] As an example, the play start button G21 is displayed in the second area R2 in Fig. 10, but is displayed in the first area R1 in Fig. 11. That is, when a part or all of the play start button G21 is no longer displayed in the second area R2, the play start button G21 appears in the first area.
[0129] Furthermore, the game display processing unit may cause the play start object to be displayed in the first area R1 in stages according to the display state of the play start object displayed in the second area R2.
[0130] Such an expression can be realized by changing the transparency of the play start object in accordance with the amount of scrolling of the second region R2.
[0131] As an example, a scroll amount (unit: pixels) of 0 to 50 corresponds to a button transparency of 0.0 (completely transparent) to 1.0 (completely opaque). In this way, in the initial display state, the object is completely transparent and cannot be seen, but when the object is scrolled 50 pixels or more, it becomes completely visible. It is preferable to change the object's transparency linearly during this period (0 to 50). Note that the unit of the scroll amount is logical pixels, which may differ from the actual pixels on the display.
[0132] The game request receiving unit is also capable of receiving a request to end play of a specific game from the broadcast user terminal 100 after the game video distribution unit has distributed information about the second video.
[0133] A request to end play can be sent by selecting an end button located on the game screen.
[0134] Then, when the game request receiving unit receives a request to end play of a specific game, the moving image distribution unit can end distribution of information about the second moving image and distribute information about the first moving image.
[0135] In other words, what is distributed here is not just a portion of the information about the first moving image, but the entire information about the first moving image.
[0136] Then, when the moving picture distribution unit finishes distribution of information related to the second moving picture and distributes information related to the first moving picture, it is assumed that the first moving picture is displayed on the viewing user terminal 2200.
[0137] Next, the flow for starting to watch a video will be described.
[0138] The one or more processors in the present disclosure may further include a viewing acceptance unit.
[0139] The viewing acceptance unit accepts a video viewing request from a user.
[0140] In response to a viewing request, the moving image distribution unit distributes information relating to video and audio as moving image information to the information processing terminal of the user.
[0141] FIG. 12 shows an example of a viewing screen V10 of an avatar video displayed on the viewing user terminal 2200. As shown in FIG.
[0142] A viewing user can post a comment by inputting text in a comment posting field V11 and pressing a send button V12.
[0143] Moreover, by pressing the gift button V13, a gift list (screen V30 in FIG. 13) is displayed to the viewing user, and a display request for a specified gift can be sent by selection.
[0144] In this case, one or more processors in the present disclosure may include a determination unit that determines whether or not a gift display request has been made from the viewer user terminal 2200.
[0145] The display request may include gift object information, which includes at least gift object identification information for identifying the type of the gift object, and location information for indicating the location where the gift object is to be displayed.
[0146] As shown in FIG. 13, gifts can be displayed by classification (free (paid) gifts, accessories, support goods, appeals, variety, etc.).
[0147] Here, a paid gift is a gift that can be purchased by spending My Coins purchased by the viewing user, and a free gift is a gift that can be obtained by the viewing user with or without spending My Points obtained for free.
[0148] In addition, the term "gift" used in this application has the same concept as the term "token." Therefore, it is possible to understand the technology described in this application by replacing the term "gift" with the term "token."
[0149] Furthermore, the viewing user can post a rating showing a favorable opinion by pressing the like button V14. Note that in addition to / instead of the like button V14, it is also possible to display a button for posting a negative rating or other emotions.
[0150] In addition, if the broadcasting user has set the option to allow other users to appear in the video in the broadcasting settings, they can send a request to appear in the video by selecting the collaboration request button V15.
[0151] Additionally, on the screen of a video distributed by a distributor user whom the viewing user is not yet following, a follow button V16 is displayed so that the viewing user can follow the distributor user. This follow button functions as an unfollow button on the screen of a video distributed by a distributor user whom the viewing user is already following.
[0152] Note that this "following" may be from viewing user to viewing user, from broadcasting user to viewing user, or from broadcasting user to broadcasting user. However, following is managed as a one-way association, and associations in the opposite direction are managed separately as followers.
[0153] A photo button V25 for saving a still image of the screen may also be displayed.
[0154] In addition, the viewing screen V10 also displays a support ranking display button V17, a share button V18, and a ranking display button V19.
[0155] The support ranking displays a ranking of viewing users who are supporting a broadcaster user, and the ranking can be calculated according to the amount of the gift (points / coins) or the like.
[0156] In addition, when sharing videos, viewers can press the share button V18 to check a list of SNS (social networking services) on which the video can be shared, and by selecting it, send a fixed link to a specified location on a specified SNS.
[0157] In addition, by pressing the collaboration request button V15, a collaboration distribution can be requested from the broadcasting user. A collaboration distribution refers to having a character object of the viewing user appear in the broadcasting user's distributed video.
[0158] At the top of the viewing screen V10, a broadcasting user icon V21, a broadcasting user name (character object name) V22, a cumulative number of viewers display V23, and a cumulative number of likes display V24 can be displayed.
[0159] Moreover, when the viewing end button V20 is selected, a screen for ending viewing appears, and a viewing end request can be sent.
[0160] The screen for ending viewing will be described in detail below. This screen is called "small window audio distribution" and is used for viewing in a mode where only audio is played without displaying the video image.
[0161] Selection of the viewing end button V20 is accepted by the viewing acceptance unit as a request to end viewing of the video.
[0162] At this time, the video delivery unit ends the delivery of information related to the video in response to the request to end viewing, but does not end the delivery of information related to the audio.
[0163] When information relating to video and audio is distributed to the user terminal, the video is displayed on the main screen of the user terminal, and when information relating to audio only is distributed, the video is not displayed on the user terminal but a sub-screen indicating that a video is being viewed is displayed.
[0164] FIG. 14 shows an image of the screen V50 on which the sub-screen V51 is displayed.
[0165] When this sub-screen V51 is displayed, the main screen displayed in the background transitions to the screen before watching the video. For example, if you move from the recommendation tab to the viewing frame, it returns to the display of the recommendation tab, and if you move from the follow tab to the viewing frame, it transitions to the follow tab.
[0166] When this sub-screen V51 is displayed, operations on the main screen are possible, and transitions to other screens are possible.
[0167] The sub-screen V51 displays a profile picture, a name, a title, and an audio icon that visually indicates that audio is being played.
[0168] Then, by selecting the end icon V52 displayed on the sub-screen V51, viewing can be completely ended.
[0169] Regarding the end of the video display, the information may be transmitted from the server device but not displayed on the terminal side, or the transmission of information itself may be stopped from the server device.
[0170] According to this configuration, it becomes possible to search for other broadcasts and enjoy chatting with other users while listening to only the audio.
[0171] Next, we will explain "collaboration," in which other users appear in a video of a broadcasting user.
[0172] As described above, the viewing user can transmit a request to participate in the video via the collaboration distribution participation request confirmation screen that is displayed by pressing the collaboration request button V15 shown in FIG.
[0173] A collaboration avatar display unit included in one or more computer processors in the present disclosure displays, in response to the participation request accepted by the acceptance unit, a character object generated based on the movement of the viewing user who has made the participation request in a video.
[0174] Fig. 15 shows, as an example, a viewing or distribution screen in which a second avatar A2, which is a character object of a guest user, is participating in a video in which a first avatar A1, which is a character object of a host user, is displayed. Note that in Fig. 15, the display of objects other than the avatars is omitted.
[0175] Furthermore, as shown in Fig. 16, a third avatar A3, which is a character object generated based on the movement of another viewing user, may also participate in the video. Note that, although the third avatar A3 is placed behind the first avatar A1 and the second avatar A2 in Fig. 16, the three may be placed in a horizontal line. Also, the placement position of the avatar may be specified by the distribution user.
[0176] Fig. 17 shows a list screen T30 of users having mutual follow relationships, which is displayed by selecting the Follow tab on the top screen shown in Fig. 5. Mutual follow refers to a relationship in which each user is a follower of the other.
[0177] This list screen T30 displays the profile images and names of users with whom a user has a mutual follow relationship.
[0178] 17, the list screen T30 displays a first object T31 for each user having a mutual follow relationship. In addition, a chat object T32 may be displayed together with the first object T31. By selecting this chat object, it is possible to transition to an individual chat screen with the second user.
[0179] The first object T31 transmits a predetermined notification to the terminal of the user associated with the first object T31.
[0180] The predetermined notification may be, for example, a call notification.
[0181] <First embodiment> Next, various functions executable by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the first embodiment of the present disclosure will be described with reference to the drawings.
[0182] The one or more computer processors included in the information processing system 3000 according to the first embodiment of the present disclosure include a transmitting unit 411, a receiving unit 412, a first moving image generating unit 413, a second moving image generating unit 414, and a moving image switching unit 415, as shown in FIG. 18.
[0183] Here, the above-mentioned transmission unit 411, reception unit 412, first moving image generation unit 413, second moving image generation unit 414 and moving image switching unit 415 are all described as being provided in the server device 400, but this is not limited to the above.
[0184] The transmission unit 411 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user.
[0185] The video may be a video including a character object CO of the first user, as shown as an example in FIG.
[0186] The information regarding the video may be any information necessary to enable the video to be viewed on the second user terminal 200, and rendering of the video may be performed on the server device 400 or the first user terminal 100, or may be performed on the second user terminal 200.
[0187] At least the facial portion of the character object CO included in the video may reflect the facial movement of the first user captured by a camera (here, an in-camera as an example) included in the first user terminal 100.
[0188] The receiving unit 412 receives a display request for the first object from the second user terminal 200.
[0189] The first object may be, for example, the gift object described above. As shown in Fig. 13 and Fig. 20, the second user can transmit a display request for a desired gift object from the gift list screen V30 displayed on the second user terminal 200. The points (P, pt) shown in the figures are available to the user free of charge as rewards or in events in the present system, and the coins (C) shown in the figures are available to the user for a fee by purchasing them.
[0190] The first moving image generating unit 413 generates first information for displaying the character object of the first user and the first object in a first area in the virtual space as a first moving image.
[0191] The first information differs depending on the content of the video, but as an example, in the case of a video in which the distributing user's character object appears as described above, it includes motion information showing the movement of the character object, voice information of the distributing user, gift object information showing gifts sent by viewing users, etc. The gift object information includes at least gift object identification information that specifies the type of gift object, and position information that indicates the position where the gift object is displayed.
[0192] Fig. 19 shows an image of a screen V10 displaying a first moving image displayed on a display unit of the first user terminal 100 and / or the second user terminal 200. The screen V10 shown in Fig. 19 includes at least a character object CO and a first object G1. Although omitted in Fig. 19, various displays and operation UIs may be displayed in a superimposed manner as shown in Figs. 8 and 12.
[0193] The second video generation unit 414 generates second information for displaying a second object S1 different from the first object G1 in a second area in the virtual space as a second video, and for displaying the first user's character object CO movably between the first area and the second area.
[0194] Unlike the first object G1, the second object S1 is not displayed in response to a display request from the second user terminal 200, but the display position and timing of the second object S1 are controlled by the server device 400 (system side).
[0195] Fig. 21 shows an image of a screen V40 displaying the second moving image displayed on the display unit of the first user terminal 100 and / or the second user terminal 200. The screen V40 shown in Fig. 21 includes at least a character object CO and a second object S1. Although omitted in Fig. 21, various displays and operation UIs may be displayed in a superimposed manner as shown in Figs. 8 and 12.
[0196] Here, the image of the expansion of the virtual space in this disclosure will be described in detail with reference to FIG.
[0197] As shown as an example in Fig. 22, the virtual space in this embodiment is arranged so that a disk-shaped island (world) is floating in the air. This island is an object that resembles a tower-shaped cake turned upside down, and various objects can be arranged on the disk-shaped ground. Note that this island and ground are shown as examples, and their display forms are not particularly limited.
[0198] As the objects, at least the above-mentioned character object CO, first object G1 and second object S1 can be displayed.
[0199] In this way, what is provided as the content of the second moving image is a "world," and this "world" is developed by executing the above-mentioned "world function."
[0200] Fig. 23 is a top view of the ground shown in Fig. 22, and is an image diagram for explaining the first area and the second area in the above configuration. Note that each object is drawn in a front view state for ease of viewing.
[0201] As shown in FIG. 23, the areas in which the character object CO is movable can be defined as a first area R10 and a second area R20 in the virtual space.
[0202] The first region R10 and the second region R20 may be continuous regions, and there are no particular limitations on their positional relationship and shape.
[0203] As an example, the first video is generated as an image of a first region R10 captured from the position of a virtual camera VC1 shown in Fig. 24 (Fig. 19). Note that the position and orientation of this virtual camera VC1 can be changed within a predetermined range by an operation of the first user.
[0204] As an example, the second video is generated as an image of the first region R10 and / or the second region R20 captured from the position of the virtual camera VC2 shown in Fig. 25 (Fig. 21). Note that the position and orientation of this virtual camera VC2 can be changed by the operation of the first user, but the virtual camera basically moves in accordance with the movement of the character object CO. The method of operating the virtual camera VC2 will be described in detail later.
[0205] In this way, the first video and the second video can be videos taken in the same virtual space (world). Alternatively, the first video and the second video can be videos taken in different virtual spaces. In this case, the second video is the video taken in the world.
[0206] In addition, the first user's own room, which is the first user's private space in the virtual space, may be set as the first area, and the area outside the room, which is the public space, may be set as the second area, and the user may be able to move between these areas.
[0207] The video switching unit 415 is characterized in that, in response to an instruction from the first user terminal 100 of the first user, the video to be displayed on the second user terminal 200 is switched between the first video and the second video.
[0208] The instruction may be transmitted to the server device 400 by an operation on a predetermined operation UI displayed on the first video and the second video displayed on the first user terminal 100.
[0209] As an example, switching from a first video to a second video / from the second video to the first video can be performed by selecting a switching button displayed on the first video and the second video.
[0210] If the world function as the second video is provided as one of the games described above, the above-described game distribution start and end procedures can be applied.
[0211] Specifically, switching from the first video to the second video can be performed by selecting the play button D33 (FIG. 8) of the game displayed in the first video, or by selecting the play button G11, G21 (FIGS. 9, 10) of a game selected from a list of games displayed on the screen transitioned to by selecting the play button D33.
[0212] Moreover, switching from the second video to the first video can be performed by selecting the play end button V41 (FIG. 21, etc.) displayed on the second video.
[0213] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0214] Specifically, first, the presence of two types of moving images, a first moving image and a second moving image, increases the interest of the moving images.
[0215] In particular, in the virtual space "World" where the second video is set, attractive second objects are placed in accordance with the theme, and the character objects can be moved freely to generate videos from any location and viewpoint, making it possible to generate a video that reflects the user's personality more than the first video.
[0216] In addition, by generating videos of people exploring the world, it becomes easier to create topics of conversation and comments.
[0217] Furthermore, by making it possible to switch between these two types of video, it is possible to extend the distribution time.
[0218] In this way, the presence of two types of moving images, the first moving image and the second moving image, and the switching between them improves the quality of the moving image as content compared to the past.
[0219] In addition, as the quality of video content improves, users' motivation to watch the videos will also increase, and as the number of viewers increases, the motivation of users who distribute the videos will also increase.
[0220] Furthermore, as distribution and viewing motivations increase, communication between distribution users and viewing users, as well as between distribution users themselves and between viewing users themselves, will become more active.
[0221] The virtual space displayed by executing the world function described above has been described as a space for distributing the second video, but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can roam freely and communicate with each other, rather than being limited to a space for distributing the second video.
[0222] One of the avatars (first user) in the virtual space may be configured to distribute a first video as a distribution user. That is, according to the information processing system of the present disclosure, one-to-many video distribution can be performed in a many-to-many metaverse virtual space.
[0223] Next, other application examples of the first embodiment will be described.
[0224] When the video switching unit 415 switches the video from a first video to a second video, the second video generation unit 414 can generate second information while maintaining the display of the already-displayed first object G1 in the first area.
[0225] Specifically, the first object G1 (apple object) displayed on the first video screen V10 shown in FIG. 19 continues to be displayed even when it changes to the second video screen V40 shown in FIG. 21.
[0226] When the video switching unit 415 switches the video from the second video to the first video, the first video generation unit 413 can generate the first information while maintaining the display of the already-displayed first object G1 in the first area.
[0227] Specifically, the first object G1 (apple object) displayed on the second video screen V40 shown in Fig. 21 continues to be displayed even when the screen changes to the first video screen V10 shown in Fig. 19. At this time, not only the first object G1 displayed in the first area, but also the first object G1 displayed in the second area can be configured to change its display position and continue to be displayed.
[0228] In addition, since the display of the first object G1 is controlled based on the display time set for each first object G1, the display of the first object G1 ends when the display time has elapsed from the start of display. A request to display the first object G1 can be made while the first video is being displayed or while the second video is being displayed, and in either case, the display of the first object G1 continues until the display time has elapsed, regardless of whether the video is switched in the middle. In other words, since the display time of the gift deposited by the viewing user is not changed by the operation (action) of the distribution user, dissatisfaction is not generated among the viewing users who deposited the gift by consuming coins or the like.
[0229] The second moving image generating unit 414 can change at least the second object S1 to another second object S1 based on a predetermined condition.
[0230] In the examples shown in Figures 21 and 22, the second objects S1 are, for example, a dog object, a pumpkin object, a tower cake object, etc., but as for these second objects S1, at least the dog object and the pumpkin object can be changed to a jellyfish object and a fish object as shown in Figures 26 and 27. Also, there may be a second object S1 that does not change, such as a tower cake object. In the present disclosure, changing such a second object S1 is called a change of theme.
[0231] The predetermined condition may be the arrival of a scheduled time, the lapse of a scheduled time, or the receipt of a change instruction from the first user or another user.
[0232] When the predetermined condition is the arrival of the scheduled time, the second video generating unit 414 changes the second object to another second object when the scheduled time arrives, regardless of the distribution start time of the video. As an example, the scheduled time can be set to a certain interval such as 10:20, 10:40, 11:00, etc. The scheduled time can also be set to morning (6:00), midday (12:00), or night (18:00). This time may be changed according to the actual sunrise and sunset times.
[0233] Furthermore, the arrival of the scheduled time also includes the arrival of the scheduled date and time. In this case, the second video generating unit 414 changes the second object to another second object when the scheduled date and time arrives, regardless of the distribution start time of the video. As an example, the scheduled date and time can be the date and time of the start of an event, such as October 31st, 0:00 (Halloween), December 25th, 0:00 (Christmas), January 1st, 0:00 (New Year's Day), etc.
[0234] When the predetermined condition is the passage of a scheduled time, the second moving image generating unit 414 changes the second object to another second object when the scheduled time has elapsed from the start time of distribution of the moving image. As an example, the scheduled time may be a fixed interval of time such as 20 minutes, 40 minutes, or 60 minutes from the start of distribution.
[0235] If the predetermined condition is that a change instruction is received from the first user or another user, the second video generating unit 414 changes the second object to another second object when a change instruction is received from the first user or another user during distribution of the video. As an example, the change instruction can be performed by selecting a change instruction object displayed on the screen. Note that the other users referred to here include not only viewing users but also guest users described later.
[0236] If the predetermined condition is the arrival of a scheduled time or the passage of a scheduled time, the scheduled time or the time until the second object is changed may be displayed within the video.
[0237] Furthermore, even if the second object S2 is changed to another second object S2, the second video generation unit 414 can generate the second information while maintaining the display of the already displayed first object G1 in the first area or the second area.
[0238] Specifically, the first object G1 (apple object) displayed on the second video screen V40 shown in FIG. 21 continues to be displayed even when it changes to the second video screen V40 shown in FIG. 26.
[0239] Since the display of the first object G1 is controlled based on the display time set for each first object G1, the display of the first object G1 ends when the display time has elapsed from the start of display. The display of the first object G1 continues until the display time has elapsed, regardless of whether the second object S1 has been changed.
[0240] Moreover, as shown in FIG. 28, one or more computer processors in the present disclosure may further include an effect generation unit 416.
[0241] The effect generating unit 416 generates a predetermined effect when a first object G1 that has already been displayed or a newly displayed first object G1 has a specific relationship with a second object S1.
[0242] Specifically, the presence or absence of the specific relationship is determined based on combination data previously stored in a predetermined storage unit. As an example, an identification number and / or attribute information is associated with each of the first object and the second object, and when these match or are associated with each other, it is determined that there is a specific relationship.
[0243] The attribute information includes, for example, attributes relating to seasons (summer, winter, etc.), attributes relating to events (Halloween, Christmas, New Year's holidays, etc.), attributes relating to locations (sea, space, sky, etc.), and the like.
[0244] The timing of the above determination may be the timing when a request to display the first object is received, the timing when the first object is displayed, or the timing when the second object is changed to another second object.
[0245] The predetermined effect may be, for example, but is not limited to, displaying another object, generating a sound effect, etc. The other object may be, for example, a presentation object such as a confetti object, a cracker object, or a paper ball object.
[0246] Moreover, as shown in FIG. 28, one or more computer processors in this disclosure may further include a movement operation receiving unit 417 and a virtual camera control unit 418.
[0247] The movement operation receiving unit 417 receives an operation for moving the character object of the first user in the virtual space. The details of the movement operation will be described later.
[0248] A virtual camera control unit 418 controls the operation of the virtual camera that captures images in the virtual space. Details of the operation control will be described later.
[0249] Furthermore, in an embodiment of the present disclosure, the movement of the facial part of the character object of the first user can be generated based on the movement of the facial part of the first user captured by the in-camera of the first user terminal 100.
[0250] Then, the first moving image generating unit 413 can generate the facial movement of the character object of the first user in an inverted state with respect to the facial movement of the first user.
[0251] Specifically, when the first user winks with his / her right eye, the character object of the first user winks with his / her left eye. Since the first user broadcasts while looking at the face of the character object displayed on the first user terminal 100, the inverted state (mirror display) allows the first user to broadcast with an intuitive feeling (operation) as if looking in a mirror. Note that a non-inverted state where the left and right are not inverted (i.e., a state in which the character object winks with its right eye when the first user winks with its right eye) creates an awkward feeling and makes it difficult to operate with an intuitive feeling.
[0252] Then, second video generation unit 414 can generate the facial movement of the first user's character object in an inverted or non-inverted state depending on the positional relationship between the first user's character object and the virtual camera.
[0253] As one example, when the virtual camera is positioned within the range in front of the first user's character object (for example, within a range of 90 degrees left or right from the front of the character object), the facial movement of the character object is generated in an inverted state, and when the virtual camera is positioned outside the range in front of the first user's character (for example, within a range exceeding 90 degrees left or right from the front of the character object), the facial movement of the character object is generated in a non-inverted state.
[0254] Specifically, if the virtual camera is determined to be located within the front range of the first user's character object, when the first user winks with his / her right eye, the first user's character object winks with his / her left eye. Conversely, if the virtual camera is determined to be located beyond the front range of the first user's character object, when the first user winks with his / her right eye, the first user's character object winks with his / her right eye.
[0255] In the above example, the movement of the face has been described, but the same control method can be used for the movement of the head and arms.
[0256] This can eliminate any awkwardness in the display that may arise due to the positional relationship between the virtual camera and the character object.
[0257] The inverted and non-inverted states may be switched by an instruction from the first user.
[0258] Furthermore, when the character object of the first user moves beyond the movable area, the second video generating unit 414 can make it reappear from another position within the virtual space.
[0259] When the virtual space is a space as shown in Fig. 22 and Fig. 27, if the character object moves beyond the edge of the disk-shaped ground, the character object can be made to fall to the bottom of the tower and reappear so as to fall from the upper center of the disk-shaped ground. By making the reappearance position the center, it is convenient for the character object to go in any direction within the world. Also, if the character object gets lost within the world, it can return to the reference central position.
[0260] As described above, according to the configuration of the first embodiment, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0261] Second Embodiment Next, various functions executable by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the second embodiment of the present disclosure will be described with reference to the drawings.
[0262] One or more computer processors included in the information processing system 3000 according to the second embodiment of the present disclosure include a transmission unit 421, a reception unit 422, a first moving image generation unit 423, and a second moving image generation unit 424, as shown in FIG.
[0263] Here, the transmitting unit 421, the receiving unit 422, the first moving image generating unit 423, and the second moving image generating unit 424 are all described as being included in the server device 400, but the present invention is not limited to this.
[0264] The transmission unit 421 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user. The transmission unit 421 can have the same configuration as the transmission unit 411 described above.
[0265] The receiving unit 422 receives a display request for the first object from the second user terminal 200. The receiving unit 422 may have the same configuration as the receiving unit 422 described above.
[0266] The first moving image generating unit 423 generates first information for displaying the character object of the first user and the first object in a first area in the virtual space as a first moving image. The first moving image generating unit 423 may have a similar configuration to the first moving image generating unit 413 described above.
[0267] The second moving image generating unit 424 generates second information for displaying a second object S1 different from the first object G1 in a second area in the virtual space as the second moving image and displaying the character object CO of the first user movably in the first area and the second area. The second moving image generating unit 424 may have a configuration similar to that of the second moving image generating unit 424 described above.
[0268] The second video generation unit 440 is characterized in that, based on the placement position information associated with the first object G1, the first object G1 is displayed at a predetermined position in the first area R10 (e.g., FIG. 23) or at a position associated with the first user's character object CO.
[0269] As described in the explanation of the gift object, the first object information of the first object G1 includes position information (placement position information) indicating the position where the first object G1 is displayed.
[0270] As an example, the arrangement position information of the first object G1 includes coordinates of a predetermined position (predetermined area) in the first area R10, or a part of the character object CO of the first user.
[0271] In this disclosure, the first object G1 having the former placement position information is called a non-attached object, and the first object G1 having the latter placement position information is called an attached object.
[0272] The appearance position (display start position) of the first object G1 may be different from the above-mentioned arrangement position.
[0273] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0274] Specifically, first, the presence of two types of moving images, a first moving image and a second moving image, increases the interest of the moving images.
[0275] In particular, in the virtual space "World" where the second video is set, attractive second objects are placed in accordance with the theme, and the character objects can be moved freely to generate videos from any location and viewpoint, making it possible to generate a video that reflects the user's personality more than the first video.
[0276] In addition, by generating videos of people exploring the world, it becomes easier to create topics of conversation and comments.
[0277] Furthermore, by making it possible to display the first object not only in the first video but also in the second video, it becomes possible to provide the first video and the second video without unnecessarily discouraging the viewing user from gifting.
[0278] In this way, the existence of two types of videos, the first video and the second video, and gifting improves the quality of the video content more than ever before.
[0279] In addition, as the quality of video content improves, users' motivation to watch the videos will also increase, and as the number of viewers increases, the motivation of users who distribute the videos will also increase.
[0280] Furthermore, as distribution and viewing motivations increase, communication between distribution users and viewing users, as well as between distribution users themselves and between viewing users themselves, will become more active.
[0281] The virtual space displayed by executing the world function described above has been described as a space for distributing the second video, but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can roam freely and communicate with each other, rather than being limited to a space for distributing the second video.
[0282] One of the avatars (one user) in the virtual space may be configured to distribute a first video as a distribution user. In other words, according to the information processing system of the present disclosure, one-to-many video distribution can be performed in a many-to-many metaverse virtual space.
[0283] When displaying the first object G1, the second moving image generating section 424 can display a system comment to the effect that the first object G1 is being displayed in the second moving image.
[0284] Alternatively, when the second video generation unit 424 receives a request to display the first object G1, it can display a system comment in the second video indicating that a request to display the first object G1 has been made (that a gift has been received).
[0285] 30 and 31 show how comments from the first user, the second user, and / or the system are displayed on a screen V40 displaying the second moving image displayed on the first user terminal 100 and / or the second user terminal 200. Although omitted in Fig. 30 and Fig. 31, various displays and operation UIs may be displayed in a superimposed manner as shown in Fig. 8 and Fig. 12.
[0286] In the example shown in FIG. 30 and FIG. 31, a comment "XXXX, I gave you 3 bananas" is displayed as a system comment to the effect that the first object G1 (banana object) is being displayed.
[0287] The system comment may be displayed in a manner different from the comments from the first user and the second user. For example, a predetermined mark (a speech bubble mark saying "It's here!" in FIG. 31) may be displayed as a system comment indicating that the first object G1 is being displayed.
[0288] In the embodiment of the present disclosure, the character object CO of the first user is capable of moving in the first region R10 and the second region R20. For example, as shown in Fig. 31, when the first object G1 is placed in the first region R10 while the character object CO of the first user is moving in the second region R20 far away from the first region R10, the first object G1 may not be displayed on the screen, and therefore displaying such a system comment is beneficial.
[0289] Moreover, as shown in FIG. 32, one or more computer processors in the present disclosure may further include a movement operation receiving unit 425 and a virtual camera control unit 426.
[0290] The movement operation receiving unit 425 receives an operation for moving the character object of the first user in the virtual space. The details of the movement operation will be described later.
[0291] The virtual camera control unit 426 controls the operation of the virtual camera that captures images in the virtual space. Details of the operation control will be described later.
[0292] When the first object G1 is displayed at a predetermined position in the first region R10, the virtual camera control unit 426 can control the operation of the virtual camera in accordance with the positional relationship between the predetermined position and the virtual camera.
[0293] As an example, the virtual camera control unit 426 adjusts the orientation and position of the virtual camera so that a first object G1 displayed at a predetermined position in the first region R10 is included in the shooting range, as shown in Fig. 33. This is automatically applied even if the virtual camera is being operated by the user as described below.
[0294] At this time, the virtual camera is controlled so that both the first object G1 and the character object CO are within the shooting range.
[0295] On the other hand, when the first object and the character object cannot be included on the same screen due to the positional relationship between the specified position and the virtual camera, the virtual camera control unit 426 can control the operation of the virtual camera to include the first object on the screen.
[0296] As an example, virtual camera control unit 426 adjusts the orientation and position of the virtual camera so that only a first object G1 displayed at a predetermined position in first region R10 is within the shooting range, as shown in Fig. 34. This is automatically applied even if the virtual camera is being operated by a user as described below.
[0297] In addition, when the second video generation unit 224 displays the first object G1 at a predetermined position in the first area R10, it can display a marker object M1 indicating the position of the first object in the virtual space according to the position of the character object CO in the virtual space.
[0298] As an example, the second video generation unit 424 displays a marker object M1 as shown in FIG. 35 so as to point to (the direction of) a first object displayed at a predetermined position in the first region R10, regardless of the current position and orientation of the virtual camera.
[0299] In addition, even if the placement position information associated with the first object G1 indicates that the first object should be displayed at a specified position in the first area R10, the second video generation unit 424 can display the first object G1 at a position associated with the first user's character object CO.
[0300] As an example, the second video generating unit 424 displays the first object G1 at a position (above the head) associated with the character object CO of the first user, as shown in Fig. 36. According to this example, it is possible to increase the possibility that the first object G1 is included in the shooting range regardless of the position of the character object CO of the first user in the virtual space. This makes it possible to effectively inform the distribution user and the viewing user of important gifts on a display screen of limited size that cannot display the entire wide virtual space.
[0301] As described above, according to the configuration of the second embodiment, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0302] <Third embodiment> Next, various functions executable by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the third embodiment of the present disclosure will be described with reference to the drawings.
[0303] The one or more computer processors included in the information processing system 3000 according to the third embodiment of the present disclosure include a transmitting unit 431, a receiving unit 432, a first moving image generating unit 433, a second moving image generating unit 434, and an association unit 435, as shown in FIG. 37.
[0304] Here, the transmitting unit 431, the receiving unit 432, the first moving image generating unit 433, the second moving image generating unit 434 and the associating unit 435 are all described as being provided in the server device 400, but this is not limited to the above.
[0305] The transmission unit 431 transmits information about the video including the character object CO of the first user to the second user terminal 200 of the second user. The transmission unit 431 can have the same configuration as the transmission unit 411 described above.
[0306] The receiving unit 432 receives a display request for the first object from the second user terminal 200. The receiving unit 432 may have the same configuration as the receiving unit 412 described above.
[0307] The first moving image generating unit 433 generates first information for displaying the character object of the first user and the first object in a first area in the virtual space as a first moving image. The first moving image generating unit 433 may have a similar configuration to the first moving image generating unit 413 described above.
[0308] The second moving image generating unit 434 generates second information for displaying a second object S1 different from the first object G1 in a second area in the virtual space as the second moving image and displaying the character object CO of the first user movably in the first area and the second area. The second moving image generating unit 434 may have a similar configuration to the above-mentioned second moving image generating unit 414.
[0309] Also, as shown in FIG. 38, the second video generating section 434 displays a third object P1, which is different from the first object G1 and the second object S1, in the second region R20.
[0310] Fig. 39 shows an image of the third object P1. In Fig. 39, two-dimensional panel-like objects P11 to P14 are shown as the third object P1. Note that the third object is not limited to a two-dimensional panel-like object, and may be a three-dimensional object.
[0311] For each of the objects P11 to P14, an attachment object is displayed together with a character image. The character image displayed on the image object may be the image of the character object of the first user, or may be a different image.
[0312] When a predetermined relationship is established between the first user's character object CO and the third object P1, the associating unit 435 associates the first user's character object CO with the fourth object W1 associated with the third object P1.
[0313] The predetermined relationship may be at least a part (hand, foot, etc.) of the character object CO touching the third object P1, the distance between the character object CO and the third object P1 becoming a predetermined distance, the character object CO pressing a button object associated with the third object P1, etc. Note that touching the third object P1 includes the character object CO being in contact with the third object P1 for a predetermined period of time, being within a predetermined distance for a predetermined period of time, and pressing for a predetermined period of time.
[0314] These specified relationships are not particularly limited, but can be such that a second user watching the video can visually understand that the first user's character object CO is attempting to associate with the fourth object W1.
[0315] Furthermore, when the associating unit 435 associates the fourth object W1 with the character object CO of the first user, the second video generating unit 434 displays the fourth object W1 in association with the character object CO of the first user.
[0316] That is, the attachment object displayed on the third object P1 is attached to the character object CO and displayed as the fourth object W1. In the example shown in Fig. 39, the character object CO of the first user is in a predetermined relationship with the third object P14, and the fourth object (sparkling object) W14, which is the attachment object displayed on the third object P14, is attached around the head of the character object CO.
[0317] This fourth object W1 may be the same object as a gift object that the second user can request to be displayed as a gift, as described below, or it may be a special object that cannot be thrown as a gift.
[0318] In the former case, the fourth object W1 corresponds to a high-value gift. Since high-value gifts are rarely given by the second user, the first and second users have little chance to see / wear the object. However, by making the object available for free in the world function, the world function is activated and users are motivated to give the object in the first video.
[0319] The third object P1 may be the same for all users, or may be different depending on the theme of the world being displayed. The displayed third object P1 may be determined based on information about the first user.
[0320] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0321] Specifically, first, the presence of two types of moving images, a first moving image and a second moving image, increases the interest of the moving images.
[0322] In particular, in the virtual space "World" where the second video is set, attractive second objects are placed in accordance with the theme, and the character objects can be moved freely to generate videos from any location and viewpoint, making it possible to generate a video that reflects the user's personality more than the first video.
[0323] In addition, by generating videos of people exploring the world, it becomes easier to create topics of conversation and comments.
[0324] In addition, by displaying a third object shown in the second video and allowing the character object to freely attach a corresponding fourth object, it becomes easier to create topics of conversation and comments, and interactions between users become more active.
[0325] Furthermore, by visually expressing the process up to putting on the fourth object in the video, it is possible to give the first user and / or the second user a sense of anticipation.
[0326] Furthermore, if the fourth object corresponds to a high-value gift, since high-value gifts are rarely cast by the second user, the first user and the second user will have difficulty seeing / wearing the object. However, by making it possible to specially wear the object in the world function, the world function will be activated and this will motivate the first user to try casting it in the first video as well.
[0327] In this way, the presence of two types of moving images, the first moving image and the second moving image, and the fourth object improve the quality of the moving image as content compared to the past.
[0328] In addition, as the quality of video content improves, users' motivation to watch the videos will also increase, and as the number of viewers increases, the motivation of users who distribute the videos will also increase.
[0329] Furthermore, as distribution and viewing motivations increase, communication between distribution users and viewing users, as well as between distribution users themselves and between viewing users themselves, will become more active.
[0330] The virtual space displayed by executing the world function described above has been described as a space for distributing the second video, but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can roam freely and communicate with each other, rather than being limited to a space for distributing the second video.
[0331] One of the avatars (one user) in the virtual space may be configured to distribute a first video as a distribution user. In other words, according to the information processing system of the present disclosure, one-to-many video distribution can be performed in a many-to-many metaverse virtual space.
[0332] The second moving image generating section 434 can display a loading image for a predetermined period of time when the associating section 435 performs the association.
[0333] Fig. 40 shows an example of the loading image L1. In Fig. 40, the loading image L1 is displayed at the same time as the character object CO steps on the third object P1 (P11), and when the circular meter increases from 0% to 100%, the fourth object W1 (W11) is attached to the character object CO.
[0334] This is done by taking a loading time so that the second user can understand that the character object is trying to associate with the fourth object, which can further increase the expectation of the first user and / or the second user.
[0335] The time it takes for the meter to fill up (loading time) is not particularly limited, but the loading time may be set longer as the value of the fourth object increases.
[0336] As shown in FIG. 41, one or more computer processors in the present disclosure may further include a selection screen generation unit 436.
[0337] The selection screen generating unit 436 generates information for displaying, on the second user terminal 200, a selection screen V30 for making a display request for the first object G1.
[0338] As shown in FIG. 20, a selection screen V30 displays a plurality of selectable images for making a display request for the first object G1.
[0339] Among the images, an image for making a display request for a first object G1 related to the fourth object can be displayed in a manner different from the other images, as shown in FIG.
[0340] For example, in a state in which a first user can freely wear a triangular hat as a fourth object in a second video, there is little display benefit to a second user throwing a gift of a triangular hat (however, it does contribute to the amount of gifts (points) obtained by the first user (thrown by the second user), so there is some benefit in that respect).
[0341] Therefore, the image of the first object G1 related to the fourth object is displayed in a manner different from the other images, so that the second user can make a selection after understanding the above circumstances.
[0342] Note that being related to the fourth object is not limited to being the same as the fourth object, but also includes being different from the fourth object but having approximately the same display position.
[0343] As an example of the different aspect, FIG. 42 shows an example in which the frame is emphasized, but it is also possible to add a badge or change the color.
[0344] Furthermore, when a display request for a first object G1 related to a fourth object is made by the second user, a special effect may be generated in the video.
[0345] The special effect may be, for example, but is not limited to, displaying another object, generating a sound effect, etc. The other object may be, for example, a presentation object such as a confetti object or a cracker object.
[0346] According to this configuration, it becomes possible to compensate for the disadvantages in terms of display.
[0347] Moreover, as shown in FIG. 41, the one or more computer processors of the present disclosure may further include a determination unit 437.
[0348] When a display request is made for a first object G1 to be displayed in association with a specific position of the first user's character object CO, the judgment unit 437 judges whether or not a fourth object W1 is already being displayed in association with a specific position of the first user's character object CO.
[0349] FIG. 43 shows an example of a process flow including a determination step by the determination unit 437.
[0350] As shown in FIG. 43, one or more computer processors execute a step of determining whether there has been a display request for a first object to be displayed in association with a particular position of a character object of a first user (S401).
[0351] When it is determined that there is a display request for a first object to be displayed in association with a specific position of the character object of the first user, a step of determining whether or not a fourth object is displayed in association with the specific position of the character object of the first user is executed (S402). The specific position may be the same position, and also includes an approximately same position.
[0352] Then, if it is determined that the fourth object is already being displayed in association with a specific position of the first user's character object, the second video generation unit 440 can either display the first object in place of the fourth object, or display both the fourth object and the first object in association with a specific position.
[0353] That is, when it is determined that the fourth object is displayed in association with a specific position of the first user's character object, the second video generation unit 440 executes a step (S403) of either displaying the first object in place of the fourth object, or displaying both the fourth object and the first object in association with a specific position.
[0354] Whether to display the first object instead of the fourth object or both the fourth object and the first object can be determined according to the nature of the first object. For example, if the value of the first object is higher than a standard, the first object is displayed instead of the fourth object, and if the value of the first object is lower than the standard, both are displayed. The standard may be the value of the fourth object when it is a gift, or may be set by the first user or the management side.
[0355] In addition, if it is determined that the fourth object is not displayed in association with a specific position of the first user's character object, the second video generation unit 440 executes a step of displaying the first object in association with the specific position (S404).
[0356] As another example, when there is a request to display a first object to be displayed in association with a specific position of a character object of a first user, if the determination unit 437 determines that a fourth object is already being displayed in association with the specific position of the character object of the first user, the second video generation unit 434 can display the first object in place of the fourth object based on instructions from the first user terminal.
[0357] At this time, a display instruction object for performing the above instruction may be displayed on the screen of the first user, which allows the first user to display the first object, which is a gift from the second user, at a timing of his / her choice.
[0358] In the above example, it is determined whether or not the fourth object is already being displayed, but the reverse is also true.
[0359] That is, as shown in FIG. 44, one or more computer processors execute a step of determining whether or not a predetermined relationship has been established between the character object CO of the first user and the third object P1 (S405).
[0360] Then, when it is determined that the character object CO of the first user and the third object P1 have a predetermined relationship, a step of determining whether or not the first object is displayed in association with a specific position of the character object of the first user is executed (S406). The specific position may be the same position, and also includes an approximately same position.
[0361] Then, if it is determined that the first object is displayed in association with a specific position of the first user's character object, second video generation unit 440 executes a step of displaying a fourth object in place of the first object, or displaying both the fourth object and the first object in association with a specific position (S407).
[0362] Whether to display a fourth object instead of the first object or to display both the fourth object and the first object can be determined according to the nature of the fourth object. For example, if the value of the fourth object is higher than the value of the first object, the fourth object is displayed instead of the first object, and if the value of the fourth object is lower than the value of the first object, both are displayed. The value of the fourth object can be the value when the fourth object is a gift.
[0363] In addition, if it is determined that the first object is not displayed in association with a specific position of the first user's character object, the second video generation unit 440 executes a step of displaying a fourth object in association with the specific position (S408).
[0364] As another example, if the determination unit 437 determines that a first object is already being displayed in association with a specific position of the first user's character object, the second video generation unit 434 can display a fourth object in place of the first object based on an instruction from the first user terminal.
[0365] At this time, a display instruction object for performing the above instruction may be displayed on the screen of the first user, which allows the first user to display the fourth object at a timing of his / her choice.
[0366] Also, as shown in FIG. 38, the second video generating section 440 can display a fifth object P2, which is different from the first object G1, the second object S1, and the third object P1, in the second region R20.
[0367] The fifth object P2 is a release object as shown in FIG. 45 as an example.
[0368] Then, when a predetermined relationship is established between the character object of the first user and the fifth object P2, the associating unit 435 can release the association of the fourth object associated with the character object of the first user.
[0369] That is, the fifth object P2 is an object for disassociating and hiding the fourth object W1 from the character object CO. The predetermined relationship may be the same as that described in the explanation of the third object.
[0370] In addition, in a case where a fourth object W1 is associated with the first user's character object CO, the association unit 435 can release the association of the fourth object W1 associated with the first user's character object CO when the first user's character object CO and the third object P1 again have a specified relationship.
[0371] That is, when the character object CO steps on the third object P1 once, the fourth object W1 is associated with it, and when the character object CO steps on it a second time, the association of the fourth object W1 is released and the object becomes invisible. When the character object CO steps on it a third time, the fourth object W1 is again associated with the character object, but an upper limit may be set on the number of times the object can be associated.
[0372] Also, as shown in FIG. 45, for example, when a fourth object W11 is displayed in association with a third object P11 by stepping on the third object P11, if another third object P12 is then stepped on, the association of the fourth object W11 is released and a fourth object W12 corresponding to the other third object P12 is attached.
[0373] Alternatively, for example, when a fourth object W11 is displayed in association with a third object P11 by stepping on the third object P11, and then another third object P12 is stepped on, the association of the fourth object W11 is not released, and a fourth object W12 corresponding to the other third object P12 may be further attached.
[0374] Furthermore, as described above, when the character object CO moves outside the area and reappears, the association with all the fourth objects may also be released.
[0375] If the display time is not defined for the fourth object W1, the association will not be released unless the above action is taken.
[0376] When the theme of the world is changed (when the second object S1 is changed), the third object P1 can be changed to another third object P1 in accordance with the theme of the world. When there are multiple third objects P1, all or a part of them may be changed.
[0377] Even if the world theme is changed, the fourth object W1 that is already attached continues to be displayed.
[0378] By using this configuration, a mission using the fourth object may be generated, and a predetermined effect may be generated when the mission is cleared.
[0379] An example of a mission is to equip, after the theme change, a fourth object that has a specific relationship with the fourth object that was equipped before the theme change, etc. Such a mission can be continued over multiple theme changes.
[0380] For example, in the case where a fourth object that is an ice cream object can be equipped in each theme, the mission may be to pile ice cream onto the character object's head each time the theme is changed.
[0381] The predetermined effect may be, for example, but is not limited to, displaying another object, generating a sound effect, etc. The other object may be, for example, a performance object such as a confetti object, a cracker object, or a paper ball object.
[0382] Such a predetermined effect may be configured to become more spectacular each time the theme is changed.
[0383] According to the above configuration, the delivery time for the first user can be extended, and the interest of the video can be increased, thereby increasing the willingness of the second user to watch the video.
[0384] As described above, according to the configuration of the first embodiment, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0385] <Fourth embodiment> Next, various functions executable by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the fourth embodiment of the present disclosure will be described with reference to the drawings.
[0386] One or more computer processors included in the information processing system 3000 according to the fourth embodiment of the present disclosure include a transmission unit 141, a movement operation acceptance unit 142, a virtual camera control unit 143, and a video generation unit 144, as shown in FIG.
[0387] Here, the transmission unit 141, the movement operation acceptance unit 142, the virtual camera control unit 143, and the video generation unit 144 are all described as being included in the first user terminal 100, but the present invention is not limited to this.
[0388] The transmission unit 141 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user.
[0389] As an example, the video may be a video streamed in real time by a first user.
[0390] As an example, the information regarding the video may be information for enabling the video to be viewed on the second user terminal 200, and rendering of the video may be performed on the first user terminal 100 or the server device 400, or may be performed on the second user terminal 200.
[0391] At least the facial portion of the character object included in the video may reflect the facial movements of the first user captured by a camera provided in the first user terminal.
[0392] The movement operation receiving unit 142 receives a movement operation of the character object of the first user in the virtual space. The virtual space may be the space shown in Fig. 22. The method of receiving the movement operation will be described later.
[0393] The virtual camera control unit 143 receives camera operations for a virtual camera that captures images in the virtual space. The method of receiving camera operations will be described later.
[0394] The video generator 144 generates information for enabling the character object of the first user to move within the virtual space, based on the movement operation and the camera operation.
[0395] The information generated here is the above-mentioned second information, and the above moving image is displayed based on the second information. In other words, the moving image transmitted to the second user terminal 200 is the second moving image.
[0396] In this embodiment, a first movement action is applied to the character object of the first user in response to a predetermined operation on the first operation UI displayed on the first user terminal 100 of the first user.
[0397] Also, in response to a predetermined operation on a second operation UI displayed on the first user terminal 100, a second movement action is applied to the character object of the first user.
[0398] In addition, in response to a predetermined operation on the third operation UI displayed on the first user terminal 100, the viewpoint of the virtual camera can be switched between a first person viewpoint and a third person viewpoint.
[0399] FIG. 47 shows an image in which a first operation UI 51, a second operation UI 52, and a third operation UI 53 are displayed on a screen D50 displayed on the first user terminal 100.
[0400] The first operation UI 51 is a virtual joystick, and can move an object horizontally in a virtual space according to a swipe direction from an initial position of a touch within an outer circular area of the first operation UI 51. An inner circle within the outer circular area is displayed to move within the outer circular area according to the touch position. The moving speed of the character object may be changed according to the moving distance from the initial position. Also, the moving speed of the character object may not be changed according to the moving distance from the initial position. In this case, the change in speed is constant, and an easy-to-view screen can be provided.
[0401] The second operation UI 52 may move the character object vertically in the virtual space in response to a tap within a circular area of the second operation UI 52 .
[0402] The third operation UI 53 is for switching between the first-person viewpoint and the third-person viewpoint by a tap operation. Fig. 47 shows an image of a screen displaying a video from the third-person viewpoint, and Fig. 48 shows an image of a screen displaying a video from the first-person viewpoint.
[0403] Then, in response to a predetermined operation on an area (fifth area) in the first user terminal 100 where the first operation UI 51, the second operation UI 52, and the third operation UI 53 are not displayed, operations of moving, rotating, and / or zooming in and out of the virtual camera are applied.
[0404] Specifically, in response to a one-finger swipe operation on the fifth region, a rotation operation is applied to the virtual camera.
[0405] In addition, a movement operation is applied to the virtual camera in response to a two-finger swipe operation on the fifth area.
[0406] In addition, in response to a pinch-in / pinch-out operation with two fingers on the fifth area, a zoom operation is applied to the virtual camera.
[0407] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0408] Specifically, the presence of the second video improves the quality of the video as content.
[0409] Furthermore, the above configuration improves the operability of the character object in the second moving image.
[0410] Furthermore, as the quality of the video improves, viewing users will be more motivated to watch, and as the number of viewing users increases, distributing users will also be more motivated to distribute.
[0411] Furthermore, as the willingness to distribute and view increases, this leads to more active interaction between distribution users and viewing users, and furthermore, between viewing users themselves.
[0412] The virtual space displayed by executing the world function described above has been described as a space for distributing the second video (world function), but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can roam freely and communicate with each other, rather than being limited to a space for distributing the second video.
[0413] One of the avatars (one user) in the virtual space may be configured to distribute a first video as a distribution user. That is, one-to-many video distribution can be performed in a many-to-many metaverse virtual space.
[0414] In response to a predetermined operation on the first user terminal, it is possible to switch between displaying and not displaying comments on a video displayed on the first user terminal.
[0415] FIG. 49 shows the screen D50 shown in FIG. 48 with a comment field D54 displayed.
[0416] Then, when switching whether or not to display comments on a video, the one or more computer processors can change the display positions of the first operation UI and the second operation UI, or hide the first operation UI 51, the second operation UI 52, and the third operation UI 53.
[0417] Specifically, the display position is changed in the examples shown in Figs. 48 and 49, but is not displayed in the examples shown in Figs. 48 and 50.
[0418] As described above, the first movement motion can be horizontal movement (walking, etc.), and the second movement motion can be vertical movement (jumping, etc.).
[0419] Additionally, the one or more computer processors apply a rotation operation to the virtual camera in response to a one-finger swipe operation on the region (fifth region).
[0420] Additionally, the one or more computer processors apply a movement operation to the virtual camera in response to a two-finger swipe operation on the region (the fifth region).
[0421] Furthermore, the one or more computer processors apply a zoom operation to the virtual camera in response to a pinch-in / pinch-out operation with two fingers on the region (fifth region).
[0422] These operations make it possible to project images freely within the virtual space.
[0423] Furthermore, the virtual camera control unit 143 can accept camera operations from the first user or a user authorized by the first user.
[0424] The user authorized by the first user may be, for example, one of the guest users, and details of this will be described later.
[0425] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0426] <Fifth embodiment> Next, various functions executable by the first user terminal 100, the second user terminal 200, and / or the server device 400 included in the information processing system 3000 according to the fifth embodiment of the present disclosure will be described with reference to the drawings.
[0427] One or more computer processors included in the information processing system 3000 according to the fifth embodiment of the present disclosure include a transmission unit 151, a movement operation acceptance unit 152, a virtual camera control unit 153, and a video generation unit 154, as shown in FIG.
[0428] The transmission unit 151 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user. The transmission unit 151 can have a similar configuration to the transmission unit 141 described above.
[0429] The movement operation receiving unit 152 receives an operation for moving a character object of the first user in the virtual space. The movement operation receiving unit 152 may have a similar configuration to the movement operation receiving unit 142 described above.
[0430] Virtual camera control unit 153 receives camera operations of a virtual camera that captures images in a virtual space. Virtual camera control unit 153 may have the same configuration as virtual camera control unit 143 described above.
[0431] The video generation unit 154 generates information for enabling the character object of the first user to move within the virtual space based on the movement operation and the camera operation. The video generation unit 154 can be configured in the same manner as the video generation unit 144 described above.
[0432] The video generating unit 154 in the present disclosure is then capable of generating information for further displaying character objects of one or more other users in the video.
[0433] The video generated in this manner is called a collaboration video, in which the first user is the "host user" and the other users are the "guest users". The details of the collaboration video have been described above, but the viewing user (second user) sends a request to participate in the video via a confirmation screen for a collaboration distribution participation request that is displayed by pressing the collaboration application button V15 shown in FIG. 12, and the video generation unit 154 displays a character object of the viewing user (other user) who made the participation request in the video in response to the participation request accepted by the acceptance unit. Note that the character object of this other user may be generated based on the movement of the other user, or may be based on the operation of the other user. Hereinafter, the guest user participating in the collaboration will be referred to as the "other user", and the viewing user not participating in the collaboration will be referred to as the "second user".
[0434] FIG. 52 shows an image of a screen V50 displaying a moving image in which a character object C1 of a first user (host user) and character objects C2 and C3 of other users (guest users) are displayed.
[0435] The display start position of the character objects of the other users is the first area. If a display request is made while the first video is being displayed, all the character objects are in the first area, so the character objects are displayed in an aligned state (FIGS. 15 and 16), but if a display request is made while the second video is being displayed, users other than the other user who made the display request can freely move in the first area or the second area, so the character objects may be displayed in a scattered state.
[0436] In addition, when switching to the second video during collaboration in the first video, the second video starts with all the character objects in the first area. Specifically, in the first video, virtual camera VC1 is applied which shoots the character objects from the center of the virtual space (FIG. 24), while in the second video, virtual camera VC2 is applied which shoots the character objects from the edge of the virtual space (the side opposite virtual camera VC1) (FIG. 25). Therefore, at the start of the second video, a video in which virtual camera VC2 is shooting from behind the character objects is displayed.
[0437] The transmission unit 151 in the present disclosure is characterized in that it transmits to the second user terminal 200 a video of the first person perspective or third person perspective of the character object C1 of the first user.
[0438] Here, the moving image transmitted to the second user terminal 200 is referred to as the second moving image. That is, the collaboration moving image in the fifth embodiment is a moving image in which the world function is being executed.
[0439] Fig. 52 is an example showing a video of a first user's character object C1 from a third-person perspective, in which the back of the head of the first user's character object C1 and the character objects C2 and C3 of other users are displayed. On the other hand, Fig. 53 is an example showing a video of the other user's character object C2 from a first-person perspective, in which the first user's character object C1 and the character object C3 of the other user are displayed. Note that the positions of the character objects and other objects in Fig. 52 and Fig. 53 are not related to each other.
[0440] The above-mentioned switching between the first-person viewpoint and the third-person viewpoint can be performed by operating the third operation UI53 shown in Fig. 47. Note that the other users can operate their own character objects while their own character objects are participating in a collaboration, and the first operation UI51, second operation UI52, and third operation UI53 shown in screen D50 are displayed on the screen of their own terminals.
[0441] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0442] Specifically, by providing a collaboration function for the second video, the quality of the video content will be improved. It will also lead to more active interaction between users participating in the collaboration, between users participating in the collaboration and viewing users, and even between viewing users themselves.
[0443] Furthermore, as the quality of the video improves, viewing users will be more motivated to watch, and as the number of viewing users increases, distributing users will also be more motivated to distribute.
[0444] In addition, the transmission unit 151 can transmit to the second user terminal 200 information regarding a first-person or third-person perspective of the first user's character object, and multiple videos of first-person or third-person perspectives of other users' character objects.
[0445] As an example, Figure 54 shows a display area V61 of a third-person perspective video of a first user's character object C1, a display area V62 of a third-person perspective video of another user's character object C2, and a display area V63 of a first-person perspective video of another user's character object C3, all displayed on a single screen V60.
[0446] As will be described later, the first user or the second user can select whether to display only the screen from the viewpoint of the character object of the first user as in the examples shown in Figures 52 and 53, or to split and display the screens from the viewpoints of the character objects of all users as in the example shown in Figure 54. Note that in Figure 54, there is a blank space because there are two guests participating in the collaboration, but a third guest can be displayed here.
[0447] Also, while Figure 54 shows an example in which the display area is divided equally into a rectangle, the shape of the display area is not particularly limited, and the size of the display area may be allocated so that the first user is larger and the other users are smaller.
[0448] Also, while FIG. 54 shows a state in which various displays and operation UIs are not displayed, the various displays and operation UIs may be displayed in a superimposed manner as shown in FIG. 8 and FIG.
[0449] Also, the screens of the users participating in the collaboration (the first user and the other users) may display only their own first-person / third-person screens, or may display the first-person / third-person screens of all users as shown in Fig. 54. These may be switchable by the selection of each user participating in the collaboration.
[0450] Furthermore, one or more computer processors in the present disclosure may include a selection receiving unit 155 as shown in FIG.
[0451] The selection receiving unit 155 receives a selection by the first user or the second user of one of the first user and one or more other users.
[0452] That is, a first user who is a host user, or a second user who is a viewing user, can select one user from among the users participating in the collaboration.
[0453] At this time, the transmitting unit 151 can transmit information related to the video in accordance with the selection accepted by the selection accepting unit 155.
[0454] Specifically, when the selection receiving unit 155 receives a selection by the first user of one other user from one or more other users, the transmission unit 151 transmits information regarding a first-person perspective video of the one other user.
[0455] This assumes, for example, that the character object of the first user is a performer and the selected other user is a cameraman. Usually, the first user needs to operate the virtual camera while moving himself / herself and / or controlling the character object. However, in order to generate a higher quality video, it is easier to delegate the authority to operate the camera to another user. In this case, the character object of the selected other user becomes a backstage staff member, so the video is automatically set to a first-person perspective rather than a third-person perspective.
[0456] In addition, when the selection receiving unit 155 receives a selection by the second user of a user from the first user and one or more other users, the transmission unit 151 may transmit information regarding a first-person perspective or third-person perspective video of the character object of the selected user to the second user terminal.
[0457] The second user's screen may display a video of the viewpoint of the character object of the user selected by the second user, or may display a video of the viewpoint of the character object of the user selected (voted) the most by a plurality of second users including the second user and other second users. Note that the type of viewpoint (first person viewpoint / third person viewpoint) displayed at this time may be the type of viewpoint selected by the user providing the video of the viewpoint, or may be further selected by the first user or the second user.
[0458] In the above example, multiple second users vote fairly, but a specific second user may be configured to determine the video to be displayed to all other second users. The specific second user may be, for example, a user who has many points calculated based on the gift display request and the value of the gift for which the display request has been made (for example, a user who has given a large amount of gifting money), a user who has viewed a large number of videos distributed by a first user, etc.
[0459] In addition, when the selection receiving unit 155 receives a selection by the first user of one other user from one or more other users, one or more computer processors in the present disclosure may further include a performance receiving unit 156 and an effect generation unit 157, as shown in FIG. 55.
[0460] The effect receiving unit 156 receives requests from other users to display effect effects on videos.
[0461] The effect generating unit 157 generates a dramatic effect on the video in response to the display request accepted by the effect accepting unit 156 .
[0462] Examples of the effect of the presentation include, but are not limited to, displaying another object or generating a sound effect, as shown in Fig. 56. The other object may be, for example, a confetti object, a cracker object, a paper ball object, or another presentation object.
[0463] The transmitting unit 151 is characterized by transmitting information related to the moving image in which the dramatic effect has been generated.
[0464] This is based on the assumption that, for example, the character object of the first user is a performer and the selected other users are special effects staff. Usually, the first user needs to activate the special effects while controlling his / her own movements and / or the character object. However, in order to generate a higher quality video, it is easier to delegate the authority to activate the special effects to other users.
[0465] In addition, when the selection receiving unit 155 receives a selection of one other user from one or more other users by the first user, the one or more computer processors in the present disclosure may further include a switching receiving unit 158.
[0466] The switching reception unit 158 receives a switching request for an object to be switched to a video from another user.
[0467] The object switching request is a request to change the above-mentioned second object to another second object. In the above example, the conditions for changing the second object were described as the arrival of a scheduled time, the lapse of a scheduled time, or a change instruction from the first user or another user, but this example corresponds to the change instruction from the other user.
[0468] In response to a switching request received by the switching receiving unit 158, the video generation unit 154 can change objects other than the first user's character object C1 and the other user's character object C2 displayed in the virtual space to other objects (Figures 57 and 58).
[0469] As shown in FIG. 57 and FIG. 58, some objects (such as a tower cake object) may remain unchanged.
[0470] Furthermore, when a display request for a wearing gift is made by a viewing user, a display instruction object for displaying a gift object corresponding to the wearing gift in a video in response to the display request may be displayed on the screen of one other user whose selection by the first user or the second user is accepted by the selection accepting unit 155. This allows the other user to have the first user (or a guest user other than the other users) wear the wearing gift object and display it at a time of his / her choice.
[0471] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0472] The first to fifth embodiments described above can be combined with each other, and also parts of these embodiments can be combined with each other.
[0473] Next, an information processing method according to an embodiment of the present disclosure will be described.
[0474] The information processing method according to the embodiment of the present disclosure is an information processing method in an information processing system 3000 shown in Fig. 3. The information processing system 3000 includes one or more first user terminals 100, second user terminals 200, and a server device 400.
[0475] The information processing method of the present disclosure, as shown as an example in FIG. 59, causes one or more computer processors provided in an information processing system 3000 to execute a sending step S411, a receiving step S412, a first moving image generating step S413, a second moving image generating step S414, and moving image switching steps S415 and S416.
[0476] In the sending step S411, information about the video including the character object of the first user is sent to the second user terminal 200 of the second user. This sending step S411 can be executed by the sending unit 411 described above.
[0477] The sending step S411 may be executed on the server side (server device 400) or on the client side (first user terminal 100).
[0478] The receiving step S412 receives a display request for the first object from the second user terminal 200. The receiving step S412 can be executed by the receiving unit 412 described above.
[0479] The receiving step S412 may be executed on the server side (server device 400) or on the client side (first user terminal 100).
[0480] The first moving image generating step S413 generates first information for displaying the character object of the first user and the first object in a first area in the virtual space as a first moving image. The first moving image generating step S413 can be executed by the above-mentioned first moving image generating unit 413.
[0481] The first moving image generating step S413 may be executed on the server side (server device 400) or on the client side (first user terminal 100).
[0482] The second moving image generating step S414 generates second information for displaying a second object different from the first object in a second area in the virtual space as a second moving image and displaying the character object of the first user movably in the first area and the second area. Such second moving image generating step S414 can be executed by the above-mentioned second moving image generating unit 414.
[0483] The second moving image generating step S414 may be executed on the server side (server device 400) or on the client side (first user terminal 100).
[0484] In the video switching steps S415 and S416, the video displayed on the second user terminal 200 is switched between the first video and the second video in response to an instruction from the first user terminal 100 of the first user. The video switching steps S415 and S416 can be executed by the video switching unit 415 described above.
[0485] The video switching steps S415 and S416 may be executed on the server side (server device 400) or on the client side (first user terminal 100).
[0486] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0487] Next, a computer program according to an embodiment of the present disclosure will be described.
[0488] A computer program according to an embodiment of the present disclosure is a computer program executed in an information processing system 3000 that distributes moving images, as shown in Fig. 3. The information processing system 3000 includes one or more first user terminals 100, second user terminals 200, and a server device 400.
[0489] The computer program in the present disclosure is characterized by causing one or more computer processors included in the information processing system 3000 to realize a transmission function, a reception function, a first moving image generation function, a second moving image generation function, and a moving image switching function.
[0490] The transmission function transmits information about a video including a character object of the first user to the second user terminal 200 of the second user.
[0491] The reception function receives a display request for the first object from the second user terminal 200.
[0492] The first moving image generating function generates first information for displaying a character object of a first user and a first object in a first area in a virtual space as a first moving image.
[0493] The second video generation function displays a second object different from the first object in a second area in the virtual space as a second video, and generates second information for displaying the character object of the first user movably in the first area and the second area.
[0494] The video switching function switches the video displayed on the second user terminal 200 between a first video and a second video in response to an instruction from the first user terminal 100 of the first user.
[0495] The above functions can be realized by the transmission circuit 1411, reception circuit 1412, first moving image generation circuit 1413, second moving image generation circuit 1414, and moving image switching circuit 1415 shown in Fig. 60. The transmission circuit 1411, reception circuit 1412, first moving image generation circuit 1413, second moving image generation circuit 1414, and moving image switching circuit 1415 are realized by the above-mentioned transmission unit 411, reception unit 412, first moving image generation unit 413, second moving image generation unit 414, and moving image switching unit 415, respectively. Details of each unit are as described above.
[0496] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0497] Next, an information processing device according to an embodiment of the present disclosure will be described. The information processing device corresponds to the first user terminal 100 in the information processing system 3000 described above.
[0498] As shown in FIG. 61, the information processing device includes a transmission unit 111, a first moving image generating unit 112, a second moving image generating unit 113, and a moving image switching unit 114.
[0499] The transmission unit 111 transmits to the server device 400 information relating to the video including the character object of the first user.
[0500] The first moving image generating unit 112 generates first information for displaying, as a first moving image, a character object of the first user and a first object requested to be displayed by the second user terminal 200 in a first area in the virtual space. The first moving image generating unit 112 can have a similar configuration to the above-mentioned first moving image generating unit 413.
[0501] The second moving image generating unit 113 generates second information for displaying a second object different from the first object in a second area in the virtual space as a second moving image and displaying the character object of the first user movably in the first area and the second area. The second moving image generating unit 113 may have a similar configuration to the above-mentioned second moving image generating unit 414.
[0502] The video switching unit 114 switches the video to be displayed on the second user terminal 200 between the first video and the second video in response to an instruction from the first user. The video switching unit 114 may have a similar configuration to the video switching unit 415 described above.
[0503] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0504] Next, an information processing method according to an embodiment of the present disclosure will be described. The information processing method is an information processing method executed in the above-mentioned information processing device (first user terminal 100).
[0505] The information processing method of the present disclosure is characterized in that, as shown as an example in FIG. 62, one or more computer processors provided in an information processing device execute a transmission step S111, a first moving image generation step S112, a second moving image generation step S113, and a moving image switching step S114.
[0506] In the sending step S111, information about the video including the character object of the first user is sent to the server device 400. The sending step S111 can be executed by the sending unit 111 described above.
[0507] The first moving image generating step S112 generates first information for displaying, as a first moving image, a character object of the first user and a first object requested to be displayed by the second user terminal 200 in a first area in the virtual space. Such a first moving image generating step S112 can be executed by the above-mentioned first moving image generating unit 112.
[0508] The second moving image generating step S113 generates second information for displaying a second object different from the first object in a second area in the virtual space as the second moving image and displaying the character object of the first user movably in the first area and the second area. Such second moving image generating step S113 can be executed by the above-mentioned second moving image generating unit 113.
[0509] In the moving image switching step S114, the moving image displayed on the second user terminal 200 is switched between the first moving image and the second moving image in response to an instruction from the first user. The moving image switching step S114 can be executed by the moving image switching unit 114 described above.
[0510] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0511] Next, a computer program according to an embodiment of the present disclosure will be described. The computer program is executed in the information processing device (first user terminal 100) described above.
[0512] The computer program according to the present disclosure is characterized in that it causes one or more processors included in an information processing system to realize a transmission function, a first moving image generation function, a second moving image generation function, and a moving image switching function.
[0513] The transmission function transmits to the server device 400 information relating to the video including the character object of the first user.
[0514] The first video generation function generates first information for displaying, as a first video, a character object of the first user and a first object requested to be displayed by the second user terminal 200 in a first area within the virtual space.
[0515] The second video generation function displays a second object different from the first object in a second area in the virtual space as a second video, and generates second information for displaying the character object of the first user movably in the first area and the second area.
[0516] The video switching function switches the video displayed on the second user terminal 200 between a first video and a second video in response to an instruction from the first user.
[0517] The above functions can be realized by the transmission circuit 1111, first moving image generating circuit 1112, second moving image generating circuit 1113, and moving image switching circuit 1114 shown in Fig. 63. The transmission circuit 1111, first moving image generating circuit 1112, second moving image generating circuit 1113, and moving image switching circuit 1114 are realized by the above-mentioned transmission unit 111, first moving image generating unit 112, second moving image generating unit 113, and moving image switching unit 114, respectively. Details of each unit are as described above.
[0518] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0519] Next, an information processing device according to an embodiment of the present disclosure will be described. The information processing device corresponds to the second user terminal 200 in the information processing system 3000 described above.
[0520] As shown in FIG. 64, the information processing device includes a receiving unit 211, a transmitting unit 212, and a display unit 213.
[0521] The receiving unit 211 receives information about the video including the character object of the first user from the server device 400.
[0522] The transmitting unit 212 transmits a display request for the first object to the server device 400 .
[0523] In response to an instruction from the first user, the display unit 213 switches between displaying a first video in which the first user's character object and a first object are displayed in a first area in the virtual space, and a second video in which a second object different from the first object is displayed in a second area in the virtual space and the first user's character object is displayed movable between the first area and the second area.
[0524] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0525] Next, an information processing method according to an embodiment of the present disclosure will be described. The information processing method is an information processing method executed in the above-mentioned information processing device (the second user terminal 200).
[0526] The information processing method according to the present disclosure is characterized in that, as shown as an example in FIG. 65, one or more computer processors included in an information processing device execute a receiving step S211, a transmitting step S212, and a displaying step S213.
[0527] In the receiving step S211, information on the video including the character object of the first user is received from the server device 400. The receiving step S211 can be executed by the receiving unit 211 described above.
[0528] A sending step S212 sends a display request for the first object to the server device 400. The sending step S212 can be executed by the sending unit 212 described above.
[0529] In the display step S213, in response to an instruction from the first user, a first moving image in which the character object and the first object of the first user are displayed in a first area in the virtual space and a second moving image in which a second object different from the first object is displayed in a second area in the virtual space and the character object of the first user is displayed movably between the first area and the second area are switched and displayed. Such a display step S213 can be executed by the display unit 213 described above.
[0530] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0531] Finally, a computer program according to an embodiment of the present disclosure will be described below. This computer program is executed in the above-mentioned information processing device (the second user terminal 200).
[0532] A computer program according to the present disclosure is characterized in that it causes one or more processors included in an information processing system to realize a receiving function, a transmitting function, and a display function.
[0533] The receiving function receives information about a video including a character object of the first user from the server device 400.
[0534] The transmission function transmits a display request for the first object to the server device 400 .
[0535] The display function, in response to instructions from the first user, switches between displaying a first video in which the first user's character object and a first object are displayed in a first area in the virtual space, and a second video in which a second object different from the first object is displayed in a second area in the virtual space and the first user's character object is displayed movable between the first area and the second area.
[0536] The above functions can be realized by a receiving circuit 1211, a transmitting circuit 1212, and a display circuit 1213 shown in Fig. 66. The receiving circuit 1211, the transmitting circuit 1212, and the display circuit 1213 are realized by the above-mentioned receiving unit 211, the transmitting unit 212, and the display unit 213, respectively. Details of each unit are as described above.
[0537] According to the above configuration, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the conventional technology described above. Specifically, according to the above configuration, it is possible to improve the willingness of distribution users to distribute, the willingness of viewing users to view, and / or the willingness of users to interact with each other.
[0538] In addition, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-described embodiment. Such an information processing device can be realized by storing a program describing the processing contents for realizing each function of the server device or terminal device according to the embodiment in a storage unit of the information processing device, and reading and executing the program by a CPU of the information processing device.
[0539] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims.
[0540] The method described in the embodiment can be stored as a program that can be executed by a calculator (computer) on a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), or a semiconductor memory (ROM, RAM, flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium side also includes a setting program that configures software means (including not only execution programs but also tables and data structures) that the computer executes. The computer that realizes this device reads the program recorded on the recording medium, and in some cases, configures the software means by the setting program, and executes the above-mentioned processing by controlling the operation of the software means. The recording medium referred to in this specification is not limited to a storage medium for distribution, but also includes a storage medium such as a magnetic disk or semiconductor memory provided inside the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory.
[0541] Furthermore, all of the objects transmitted and received in the information processing system of the present disclosure, such as the above-mentioned "gifts" and "comments," are electronic "data."
[0542] The Summary section above is provided to introduce in a simplified form selected concepts that are described below in the Detailed Description section. All trademarks used herein are the property of their respective owners. The statements in this Summary section are not intended to identify key features or essential features of the claimed inventions, nor are they intended to limit the scope of the claimed inventions. The above and other objects, features, and advantages of the claimed inventions will become more apparent from the following Detailed Description section, taken in conjunction with the accompanying drawings.
[0543] The communication links for implementing the above-mentioned networks may include, but are not limited to, a cellular network, a wireless network (e.g., RF connections via Bluetooth, WiFi (such as IEEE 802.11a / b / n), WiMax, cellular, satellite, laser, infrared), a landline network, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), and / or an Ethernet network.
[0544] The memory mentioned above may include, but is not limited to, computer readable media such as volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drive (HDD), solid state drive (SSD), magnetic tape, optical media). As will be readily understood, the term "computer readable recording medium" may include media for data storage such as memory and storage, as well as transmission media such as modulated data signals or transitory signals.
[0545] This specification is described in terms of representative embodiments that are not intended to be limiting in any manner. As used in this application, singular forms such as "a," "the," "said," "above," "the," "the," "this," and "the" can include the plural unless clearly indicated otherwise. Also, the term "comprises" can mean "comprises" or "has." Furthermore, the terms "coupled," "coupled," "coupled," "connected," or "connected" encompass mechanical, electrical, magnetic, and optical ways of coupling, connecting, or joining objects together, as well as other ways, and do not exclude the presence of intermediate elements between objects that are so coupled, coupled, coupled, coupled, connected, or connected.
[0546] The various systems, methods, and devices described herein should not be construed as being limited in any manner. Indeed, the present disclosure is directed to all novel features and aspects of each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. The various systems, methods, and devices described herein are not limited to a particular aspect, a particular feature, or a combination of such a particular aspect with a particular feature, nor do the products and methods described herein require that one or more particular advantages be present or problems be solved. Moreover, various features or aspects of the various embodiments described herein, or portions of such features or aspects, may be used in combination with each other.
[0547] Although operations of some of the various methods disclosed herein have been described in a particular order for convenience, it should be understood that description in such a manner encompasses rearranging the order of the operations, unless a particular order is required by specific text below. For example, operations described in a sequence may in some cases be rearranged or performed simultaneously. Furthermore, for purposes of simplicity, the accompanying drawings do not show the various ways in which the various items and methods described herein may be used with other items and methods. In addition, the present specification may use terms such as "generate," "generate," "display," "receive," "evaluate," and "deliver." These terms are high-level descriptions of the various actual operations that may be performed. The actual operations that correspond to these terms may vary depending on the particular implementation and may be readily discerned by one of ordinary skill in the art having the benefit of the disclosure herein.
[0548] Any theories of operation, scientific principles, or other theoretical descriptions presented herein in connection with the devices or methods of the present disclosure are provided for the purpose of better understanding and are not intended to limit the scope of the technology, and the devices and methods in the appended claims are not limited to devices and methods that operate in a manner described by such theories of operation.
[0549] Any of the various methods disclosed herein may be implemented and executed in a computer using computer-executable instructions stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media, such as one or more optical media disks, volatile memory components, or non-volatile memory components), where the volatile memory components include, for example, DRAM or SRAM, and the non-volatile memory components include, for example, hard drives and solid-state drives (SSD). Additionally, the computer may include any computer available in the market, including, for example, smartphones and other mobile devices having hardware to perform computations.
[0550] Any such computer-executable instructions for implementing the techniques disclosed herein, along with any data generated and used during the implementation of the various embodiments disclosed herein, may be stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media). Such computer-executable instructions may be, for example, part of a separate software application, or part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may be executed, for example, on a single local computer (e.g., as an agent executing on any suitable computer available on the market) or in a network environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more networked computers.
[0551] For clarity, only certain selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the techniques disclosed herein are not limited to a specific computer language or program. For example, the techniques disclosed herein may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed herein are not limited to a specific computer or a specific type of hardware. Specific details of suitable computers and hardware are well known and need not be described in detail herein.
[0552] Moreover, any of the various such software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) may be uploaded, downloaded, or accessed in a remote manner by any suitable communication means, including, for example, the Internet, the World Wide Web, an intranet, a software application, cable (including fiber optic cable), magnetic communication, electromagnetic communication (including RF, microwave, and infrared communication), electronic communication, or other such communication means. [Additional Notes] The matters described in the claims as originally filed in the original application are appended hereto. [Claim 1] one or more computer processors, a transmission unit that transmits information about a moving image including a character object of a first user to a second user terminal of a second user; a reception unit that receives a display request for a first object from the second user terminal; a first moving image generating unit that generates first information for displaying a character object of the first user and the first object in a first area in a virtual space as a first moving image; a second moving image generating unit that generates second information for displaying, as a second moving image, a second object different from the first object in a second area in the virtual space and displaying a character object of the first user movably in the first area and the second area; a video switching unit that switches a video to be displayed on the second user terminal between the first video and the second video in response to an instruction from a first user terminal of the first user; An information processing system comprising: [Claim 2] When the video switching unit switches the video from the first video to the second video, The information processing system according to claim 1, characterized in that the second video generation unit generates the second information while maintaining the display of the first object already displayed in the first area. [Claim 3] When the video switching unit switches the video from the second video to the first video, The information processing system according to claim 1 or 2, characterized in that the first video generation unit generates the first information while maintaining the display of the first object that is already displayed in the first area. [Claim 4] 4. The information processing system according to claim 1, wherein the second moving image generating section changes at least the second object to another second object based on a predetermined condition. [Claim 5] 5. The information processing system according to claim 4, wherein the predetermined condition is arrival of a scheduled time, lapse of a scheduled time, or receipt of a change instruction from the first user or another user. [Claim 6] The information processing system of claim 4 or 5, characterized in that the second video generation unit generates the second information while maintaining the display of the first object already displayed in the first area or the second area, even if the second object is changed to another second object. [Claim 7] The one or more computer processors further include: The information processing system according to any one of claims 1 to 6, characterized in that it further comprises an effect generating unit that generates a predetermined effect when the first object that is already displayed or the first object that is newly displayed has a specific relationship with the second object. [Claim 8] The one or more computer processors further include: a movement operation receiving unit that receives a movement operation of a character object of the first user in the virtual space; a virtual camera control unit that controls an operation of a virtual camera that captures images in the virtual space; 7. The information processing system according to claim 1, further comprising: [Claim 9] a facial movement of the character object of the first user is generated based on a facial movement of the first user captured by an in-camera of the first user terminal; the first video generation unit generates a facial movement of the character object of the first user in an inverted state with respect to the facial movement of the first user; The information processing system according to claim 8, characterized in that the second video generation unit generates the facial movement of the first user's character object in the inverted state or the non-inverted state depending on a positional relationship between the first user's character object and the virtual camera. [Claim 10] The information processing system according to any one of claims 1 to 9, characterized in that the second video generation unit causes the character object of the first user to reappear from another position in the virtual space when the character object of the first user moves beyond a movable area. [Claim 11] one or more computer processors, a transmitting step of transmitting information about the moving image including the character object of the first user to a second user terminal of a second user; a receiving step of receiving a display request for a first object from the second user terminal; a first moving image generating step of generating first information for displaying a character object of the first user and the first object in a first area in a virtual space as a first moving image; a second moving image generating step of generating second information for displaying, as a second moving image, a second object different from the first object in a second area in the virtual space and displaying a character object of the first user movably in the first area and the second area; a video switching step of switching a video to be displayed on the second user terminal between the first video and the second video in response to an instruction from a first user terminal of the first user; An information processing method for executing the above. [Claim 12] one or more computer processors, a transmitting step of transmitting information about a moving image including a character object of the first user to a server device; a first moving image generating step of generating first information for displaying, as a first moving image, a character object of the first user and a first object requested to be displayed from a second user terminal of a second user in a first area in a virtual space; a second moving image generating step of generating second information for displaying, as a second moving image, a second object different from the first object in a second area in the virtual space and displaying a character object of the first user movably in the first area and the second area; a video switching step of switching the video to be displayed on the second user terminal between the first video and the second video in response to an instruction from the first user; An information processing method for executing the above. [Claim 13] one or more computer processors, a transmission function of transmitting information regarding a video including a character object of the first user to a server device; a first moving image generating function for generating first information for displaying, as a first moving image, a character object of the first user and a first object requested to be displayed from a second user terminal of a second user in a first area in a virtual space; a second moving image generation function for generating second information for displaying, as a second moving image, a second object different from the first object in a second area in the virtual space and displaying a character object of the first user movably in the first area and the second area; a video switching function for switching the video to be displayed on the second user terminal between the first video and the second video in response to an instruction from the first user; A computer program that achieves this. [Claim 14] one or more computer processors, a receiving step of receiving information about a moving image including a character object of a first user from a server device; a transmitting step of transmitting a display request for a first object to the server device; a display step of switching between a first moving image in which a character object of the first user and the first object are displayed in a first area in a virtual space and a second moving image in which a second object different from the first object is displayed in a second area in the virtual space and the character object of the first user is displayed movably between the first area and the second area in response to an instruction from the first user; An information processing method for executing the above. [Claim 15] one or more computer processors, a receiving function for receiving information regarding a video including a character object of a first user from a server device; a transmission function for transmitting a display request for a first object to the server device; a display function of switching between a first video in which a character object of the first user and the first object are displayed in a first area in a virtual space and a second video in which a second object different from the first object is displayed in a second area in the virtual space and the character object of the first user is displayed movably between the first area and the second area in response to an instruction from the first user; A computer program that achieves this. [Explanation of symbols]
[0553] 1000 Information Processing Systems 2000 Information Processing System 3000 Information Processing System 100 First user terminal 200 Second user terminal 300 Network 400 Server device
Claims
1. one or more computer processors, a generation unit that generates information for displaying a character object of a first user in a virtual space; a transmission unit that transmits the information generated by the generation unit to a first user terminal of the first user and / or a second user terminal of a second user; Equipped with the generation unit generates first information for displaying a character object of the first user in a first area in a virtual space as a first moving image, and second information for displaying the character object of the first user in a movable manner in a second area different from the first area as a second moving image, The one or more computer processors further include: An information processing system comprising a video switching unit that switches the video to be displayed on the second user terminal between the first video and the second video in response to an instruction from the first user terminal.
2. The information processing system according to claim 1 , wherein the virtual space is a metaverse space in which the character object of the first user and other character objects of other users can communicate with each other.
3. The information processing system according to claim 1, characterized in that the first area is a private space of the first user, and the second area includes a public space in which the character object of the first user and other character objects of other users are movably displayed.
4. The one or more computer processors further include: a reception unit that receives a display request for a first object from the second user terminal; an object display unit that displays the first object in the virtual space in response to a display request received by the reception unit; 2. The information processing system according to claim 1, further comprising:
5. the object display unit further displays a second object different from the first object in the second area of the virtual space; 5. The information processing system according to claim 4, wherein the object display unit changes at least the second object to another second object based on a predetermined condition.
6. 6. The information processing system according to claim 5, wherein the predetermined condition is arrival of a scheduled time, lapse of a scheduled time, or receipt of a change instruction from the first user or another user.
7. The information processing system according to claim 5, characterized in that the object display unit maintains the display of the first object already displayed even when the second object is changed to another second object.
8. The one or more computer processors further include: The information processing system according to claim 5, further comprising an effect generating unit that generates a predetermined effect when the first object that is already displayed or the first object that is newly displayed has a specific relationship with the second object.
9. The information processing system according to claim 1 , wherein the generation unit causes the character object of the first user to reappear from another position in the virtual space when the character object of the first user moves beyond a movable area.
10. one or more computer processors, A generating step of generating information for displaying a character object of a first user in a virtual space; a transmitting step of transmitting the information generated in the generating step to a first user terminal of the first user and / or a second user terminal of a second user; Run the command, In the generating step, first information for displaying a character object of the first user in a first area in a virtual space as a first moving image and second information for displaying the character object of the first user movably in a second area different from the first area as a second moving image are generated, The one or more computer processors further include: The information processing method includes executing a video switching step of switching the video to be displayed on the second user terminal between the first video and the second video in response to an instruction from the first user terminal.
11. one or more computer processors, a receiving step of receiving, from a server device, first information for displaying a character object of a first user in a first area in a virtual space as a first moving image, and second information for displaying the character object of the first user movably in a second area different from the first area as a second moving image; a display step of displaying the first moving image or the second moving image based on the first information or the second information; a video switching step of switching a video to be displayed between the first video and the second video in response to an instruction from a first user terminal of the first user; An information processing method for executing the above.
12. one or more computer processors, a receiving function for receiving from the server device first information for displaying a character object of a first user in a first area in a virtual space as a first moving image, and second information for displaying the character object of the first user movably in a second area different from the first area as a second moving image; a display function of displaying the first moving image or the second moving image based on the first information or the second information; a video switching function for switching a video to be displayed between the first video and the second video in response to an instruction from a first user terminal of the first user; A computer program that achieves this.
Citation Information
Patent Citations
Moving image generation device and program
JP2015184689A
Content distribution system, content distribution method, and computer program
JP2020017243A
Server system and video distribution system
JP2020166559A
Program, method and terminal device
JP2021039731A
JPP6934102B