Information processing systems, information processing methods, and computer programs

Abstract

To provide an information processing system, an information processing method, and a computer program which mitigate restriction of an arrangement number and an arrangement position of an object according to the size of the object in a virtual space.SOLUTION: An information processing system is provided with a server device 400 which is connectable with a plurality of user terminals via a network. The server device includes: a display control unit which controls display of a moving image which displays a prescribed virtual space on a first display window of a first information processing device; an accepting unit which accepts an operation performed by a first user; an object arrangement unit which arranges a first object in the prescribed virtual space; and an association display unit which displays a second object which satisfies a specific condition regarding a size in association with a specific object when the accepting unit accepts a specific moving operation of moving the first object to a specific position where the specific object is arranged in the prescribed virtual space.SELECTED DRAWING: Figure 26

Description

[[Technical Field]]

[0001] The present invention relates to an information processing system, an information processing method, and a computer program. [[Background Art]]

[0002] An information processing system that generates animation of a character object based on a user's movement and distributes a moving image including the animation of the character object is known (see, for example, Patent Document 1).

[0003] Furthermore, a technology has been developed that provides a virtual space in which objects can be arranged for each user regardless of whether or not a moving image is distributed. [[Prior Art Documents]] [[Patent Documents]]

[0004] [[Patent Document 1]] Japanese Patent Application Laid-Open No. 2015-184689 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]

[0005] Since the size of the virtual space provided for each user is finite, there has been a problem that the number of objects that can be arranged in the virtual space and their arrangement positions are limited depending on the size of the virtual objects.

[0006] Therefore, an object of the present disclosure is to provide a technical improvement that solves or alleviates at least part of the above-described problems of the conventional technology.

[0007] Furthermore, one of the more specific objects of the present disclosure is to provide a technology that alleviates restrictions on the number of objects arranged and their arrangement positions depending on the size of objects in a virtual space. [[Means for Solving the Problem]]

[0008] The information processing system in this disclosure is an information processing system comprising one or more computer processors, wherein one or more computer processors comprises a display control unit that controls the display of a video showing a predetermined virtual space on a first display screen of a first information processing device; a reception unit that receives operations from a first user; an object placement unit that places a first object in the predetermined virtual space; and an association display unit that, when the reception unit receives a specific movement operation to move the first object to a specific position in the predetermined virtual space where a specific object is placed, displays a second object that satisfies specific size conditions in association with the specific object.

[0009] The computer processors in this disclosure further include a generation unit that generates a second object by adjusting the size of a first object when a reception unit receives a specific movement operation, and an association display unit that can display the second object generated by the generation unit in association with a specific object.

[0010] The computer processors in this disclosure further include an extraction unit that, when a receiving unit receives a specific movement operation, extracts a second object from a pre-prepared set of objects that differs from a first object only in size, and an association display unit that can display the second object extracted by the extraction unit in association with a specific object.

[0011] The object placement unit can, in response to an operation by the first user, unlink a specific object from a second object and then reposition the first object in a predetermined virtual space.

[0012] A particular object may have at least one compartment on which a second object can be placed.

[0013] The object placement unit can rearrange a second object into a different section of a specific object in response to an operation by the first user.

[0014] The number of partitions a particular object possesses can be increased or decreased in response to specific operations performed by the first user.

[0015] The computer processors in this disclosure further include a size comparison unit that, when a receiving unit receives a specific movement operation, compares the size of a partition of a specific object with the size of a first object, and a generating unit can adjust the size of the first object to an appropriate size that fits the partition based on the comparison result by the size comparison unit.

[0016] If the generation unit determines, based on the comparison performed by the size comparison unit, that the size of the first object is larger than the size of the area, it can generate a second object by reducing the size of the first object to a size that fits the area.

[0017] If the generation unit determines, based on the comparison by the size comparison unit, that the size of the first object is the same as or smaller than the size of the partition, it can create the second object without adjusting the size of the first object.

[0018] The reception unit further accepts adjustment operations on the second object by the first user, and these adjustment operations may include adjusting the size and / or orientation of the second object.

[0019] The video further displays a first character object that can move within a predetermined virtual space, and one or more computer processors further... Comprising a virtual camera control unit that controls the operation of a virtual camera that captures an image of a predetermined virtual space, the virtual camera control unit controls the operation of the virtual camera in a first mode in a state where a movement operation for a first character object is receivable, and controls the operation of the virtual camera in a second mode in a state where a movement operation for a first object is receivable; and when the operation of the virtual camera is controlled in the second mode and a reception unit receives a specific movement operation, the virtual camera control unit can change the control of the operation of the virtual camera from the second mode to a third mode.

[0020] The first mode may be a mode in which the operation of the virtual camera can be changed according to an operation by a first user.

[0021] The second mode may be a mode in which the predetermined virtual space is captured from above.

[0022] The third mode may be a mode in which a specific object is captured from the front direction.

[0023] When the operation of the virtual camera is controlled in the first mode and the reception unit receives a selection operation for a specific object arranged in the predetermined virtual space, the virtual camera control unit can change the control of the operation of the virtual camera from the first mode to the third mode.

[0024] One or more computer processors according to the present disclosure further comprise an attribute determination unit that determines whether an attribute set for the first object and an attribute set for the specific object have a predetermined relationship in accordance with an operation by the first user, and the reception unit can receive the specific movement operation when the attribute determination unit determines that the predetermined relationship exists.

[0025] The object arrangement unit can arrange the specific object in the predetermined virtual space such that the specific object is visible or invisible to a second user based on an operation by the first user.

[0026] The association display unit can, based on an operation by a first user, display a second object in association with a specific object in such a manner that the second object is visible or invisible to a second user.

[0027] The object placement unit can place a specific object at another position in a predetermined virtual space in accordance with an operation by a first user.

[0028] The object placement unit can place a first object in a predetermined virtual space based on an instruction from a second user different from the first user.

[0029] An information processing method according to the present disclosure causes one or more computer processors to execute: a display control step of controlling display of a moving image showing a predetermined virtual space on a first display screen; an object placement step of placing a first object in the predetermined virtual space; a reception step of receiving an operation by a first user; a determination step of determining whether the operation received in the reception step is a specific movement operation for moving the first object to a specific position where a specific object is placed in the predetermined virtual space; and an association display step of, when the operation is determined to be the specific movement operation in the determination step, displaying a second object that satisfies a specific condition regarding size in association with the specific object.

[0030] A computer program according to the present disclosure causes one or more computer processors to implement: a display control function of controlling display of a moving image showing a predetermined virtual space on a first display screen; an object placement function of placing a first object in the predetermined virtual space; a reception function of receiving an operation by a first user; and an association display function of, when the reception function receives a specific movement operation for moving the first object to a specific position where a specific object is placed in the predetermined virtual space, displaying a second object that satisfies a specific condition regarding size in association with the specific object. Advantages of the Invention

[0031] This disclosure provides technical improvements that solve or mitigate at least some of the problems of the prior art described above.

[0032] More specifically, this disclosure provides a technology that can increase the number of objects that can be placed in a virtual space by making effective use of the space in the virtual space. [Brief explanation of the drawing]

[0033] [Figure 1] This is a system configuration diagram showing an example of the information processing system described in this disclosure. [Figure 2] This is a system configuration diagram showing an example of the information processing system described in this disclosure. [Figure 3] This is a system configuration diagram showing an example of the information processing system described in this disclosure. [Figure 4] This diagram shows an example of the hardware configuration of the server device, the first user terminal, and the second user terminal in this disclosure. [Figure 5] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 6] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 7] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 8] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 9] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 10] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 11] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 12] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 13]This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 14] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 15] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 16] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 17] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 18] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 19] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 20] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 21] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 22] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 23] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 24] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 25] This is a conceptual diagram illustrating the image of the virtual space described in this disclosure. [Figure 26] This diagram shows an example of the functional configuration of the server device in this disclosure. [Figure 27] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 28] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 29] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 30] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 31]This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 32] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 33] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 34] This is a conceptual diagram illustrating the image of a specific object in this disclosure. [Figure 35] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 36] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 37] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 38] This is a conceptual diagram showing an image of the screen displayed on the user's terminal. [Figure 39] This diagram shows another example of the functional configuration of the server device in this disclosure. [Figure 40] This flowchart shows an example of the information processing method described in this disclosure. [Figure 41] This is a circuit diagram showing an example of a circuit configuration for implementing the computer program described in this disclosure. [Figure 42] This diagram shows an example of the functional configuration of a user terminal in this disclosure. [Figure 43] This is a block diagram of the processing circuit that performs the computer-based operation described in this disclosure. [Modes for carrying out the invention]

[0034] First, an overview of the information processing system according to the embodiment of this disclosure will be described with reference to the drawings.

[0035] The information processing system in this disclosure is an information processing system comprising one or more client devices and server devices, and comprising one or more computer processors.

[0036] The video displayed on each client device is described as including, but is not limited to, animations of 3D or 2D character objects generated based on the movements of the streaming user. It may also include animations of character objects generated in response to the streaming user's actions, or it may include an image of the streaming user themselves. Furthermore, these character objects and the streaming user may not be displayed, and only the streaming user's voice may be included.

[0037] Here, "distributing user" means the user who transmits video and / or audio information. For example, a streaming user can be a user who hosts or organizes a solo video stream, a collaborative stream with multiple participants, a video chat or voice chat with multiple participants and / or viewers, or an event in a virtual space (such as a party) with multiple participants and / or viewers—in other words, a user who primarily performs these activities. Therefore, "distributing user" in this disclosure can also be rephrased as "user," "host user," "organizer user," or "event host."

[0038] On the other hand, a viewing user refers to a user who receives information related to video and / or audio. However, a viewing user may not only receive the above information but also be able to react to it. For example, a viewing user may be a user who watches video streams or collaborative streams, or a user who participates in and / or watches video chats, voice chats, or events. Therefore, in this disclosure, a viewing user can also be referred to as a user, guest user, participating user, listener, spectator, or supporter.

[0039] Furthermore, the information processing system in the embodiments of this disclosure can be used to provide the next internet space (metaverse), a digital world in which many people can simultaneously participate in free activities such as interaction, work, and play through character objects (avatars) at a level close to that of real society, enabling social activities that transcend the gap between reality and virtuality.

[0040] In such a space, users' avatars can freely roam the virtual world and communicate with each other.

[0041] Furthermore, the system may be configured so that one avatar among multiple avatars in such a virtual space can stream video as the character object of the streaming user. In other words, it may be possible to perform one-to-many video streaming in a many-to-many metaverse virtual space.

[0042] In such a space, there is no particular distinction between broadcasting users and viewing users.

[0043] Furthermore, the space represented in the video may be a virtual space, a real space, or an augmented reality space that combines these two. Also, the video may be something like a karaoke video or a game commentary video that plays at least predetermined video and the voice of the streaming user, or it may be a video in which character objects or the actual image of the streaming user are superimposed on these.

[0044] Furthermore, if the streaming user is present in the real world, a character object generated based on the streaming user's movements may be superimposed onto the actual image of the streaming user. Additionally, animations such as gift objects may be superimposed onto the captured image of the real world.

[0045] <System Configuration> As shown in Figure 1 as an example, the information processing system 1000 relating to this disclosure may include one or more viewing user terminals 1100, and an information processing device (support computer) 1300 located in a video distribution studio or the like, which is connected to these viewing user terminals 1100 via a network 1200.

[0046] Furthermore, the information processing device 1300 may be connected to a predetermined server device via the Internet, and some or all of the processing that would normally be performed by the information processing device 1300 may be performed by the server device. This server device may be the information processing device 2400 shown in Figure 2.

[0047] In this specification, the distribution by such information processing system 1000 shall be referred to as studio distribution.

[0048] In studio broadcasts, the full-body movements of the broadcasting user (actor) will be captured by cameras installed in the studio using markers attached to the broadcasting user, and reflected in the character in real time using known motion capture technology.

[0049] Furthermore, the information processing system 1000 of the present invention can be linked with another information processing system 2000, which is shown as an example in Figure 2. The information processing system 2000 shown in Figure 2 may include a distribution user terminal 2100, one or more viewing user terminals 2200, and an information processing device (server device) 2400 connected to these distribution user terminals 2100 and viewing user terminals 2200 via a network 2300.

[0050] In the above example, the distribution user terminal 2100 can be an information processing terminal such as a smartphone. In this specification, distribution by such information processing system 2000 will be referred to as mobile distribution.

[0051] In mobile streaming, the facial movements of the streaming user will be captured by the camera on the streaming user terminal 2100, and reflected in the character's face in real time using known face tracking technology.

[0052] Furthermore, there is no particular distinction between broadcasters and viewers in mobile streaming; viewers can broadcast from their mobile devices at any time, and broadcasters can become viewers when watching videos from other broadcasters.

[0053] The videos generated by the above-mentioned information processing systems 1000 and 2000 can, for example, be distributed to viewers from a video distribution platform.

[0054] Furthermore, in any distribution, the processes of reflecting motion onto the character to generate animation and the processes of displaying gifts (described later) may be shared among the distribution user terminal, the viewing user terminal, the information processing device, and other devices.

[0055] In other words, "distribution" as used here refers to transmitting information that enables viewing of a video on the viewing user's terminal, and video rendering may be performed on the information processing devices 1300 and 2400, or on the distribution user terminal 2100 and viewing user terminals 1100 and 2200.

[0056] Specifically, the terminal or device that generates (renders) the character object's animation receives face motion data and voice data from the distribution user's terminal or information processing device. In addition to face motion, body motion may also be transmitted.

[0057] In this disclosure, the process of generating animations is described as being performed on both the distribution user terminal and the viewing user terminal, but it is not limited to this.

[0058] Furthermore, the information processing system in this disclosure is applicable to either of the examples shown in Figures 1 and 2. Therefore, the information processing system 3000 in the embodiment of this disclosure will be described as comprising a first user terminal 100, a second user terminal 200, and a server device 400 that can be connected to these first and second user terminals 100 and 200 via a network 300, as shown in Figure 3.

[0059] The first user terminal 100 and the second user terminal 200 are interconnected with the server device 400 via, for example, a base station, a mobile communication network, a gateway, and the internet. Communication between the first user terminal 100 and the second user terminal 200 and the server device 400 is conducted based on a communication protocol such as the Hypertext Transfer Protocol (HTTP). Alternatively, a connection may be initially established between the first user terminal 100 and the second user terminal 200 and the server device 400 via HTTP communication, and thereafter, communication may be conducted based on WebSocket, which provides bidirectional communication at a lower cost (lower communication load and processing load) than HTTP communication. The communication method between the first user terminal 100 and the second user terminal 200 and the server device 400 is not limited to the above-described method; any communication technology that can realize this embodiment may be used.

[0060] The first user terminal 100 functions as at least the information processing device 1300, viewing user terminal 1100, distribution user terminal 2100, or viewing user terminal 2200 described above, the second user terminal 200 functions as at least the information processing device 1300, viewing user terminal 1100, distribution user terminal 2100, or viewing user terminal 2200 described above, and the server device 400 functions as at least the predetermined server device or information processing device 2400 described above.

[0061] In this disclosure, the first user terminal 100 and the second user terminal 200 can be smartphones (multifunction telephone terminals), tablet terminals, personal computers, console game machines, head-mounted displays (HMDs), wearable computers such as glasses-type wearable terminals (AR glasses, etc.), and information processing devices other than these that can play videos. Furthermore, these terminals may be standalone devices that operate independently, or they may consist of multiple devices connected to each other in a manner that enables them to send and receive various types of data.

[0062] <Hardware Configuration> Here, the hardware configuration of the first user terminal 100 will be described using Figure 4. The first user terminal 100 includes a processor 101, memory 102, storage 103, input / output interface (I / F) 104, and communication interface (Communication I / F) 105. Each component is interconnected via bus B.

[0063] The first user terminal 100 can realize the functions and methods described in this embodiment through the cooperation of the processor 101, memory 102, storage 103, input / output I / F 104, and communication I / F 105.

[0064] The processor 101 executes functions and / or methods realized by code or instructions contained in a program stored in the storage 103. The processor 101 may include, for example, a central processing unit (CPU), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), a microprocessor, a processor core, a multiprocessor, an ASIC (Application-Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc., and may realize each process disclosed in each embodiment by logic circuits (hardware) or dedicated circuits formed on an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)), etc. Furthermore, these circuits may be realized by one or more integrated circuits, and the multiple processes shown in each embodiment may be realized by a single integrated circuit. In addition, LSIs may be referred to as VLSI, Super LSI, Ultra LSI, etc., depending on the degree of integration.

[0065] Memory 102 temporarily stores the program loaded from storage 103 and provides a workspace for the processor 101. Various data generated while the processor 101 is executing the program are also temporarily stored in memory 102. Memory 102 includes, for example, RAM (Random Access Memory) and ROM (Read Only Memory).

[0066] Storage 103 stores programs. Storage 103 includes, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), flash memory, etc.

[0067] The communication interface 105 is implemented as hardware such as a network adapter, communication software, or a combination thereof, and transmits and receives various types of data via the network 300. This communication may be performed via wired or wireless connection, and any communication protocol may be used as long as communication between the devices is possible. The communication interface 105 communicates with other information processing devices via the network 300. The communication interface 105 transmits various types of data to other information processing devices according to instructions from the processor 101. The communication interface 105 also receives various types of data transmitted from other information processing devices and transmits them to the processor 101.

[0068] The input / output interface 104 includes an input device for inputting various operations to the first user terminal 100, and an output device for outputting the processing results processed by the first user terminal 100. The input / output interface 104 may have the input device and output device integrated, or they may be separated into an input device and an output device.

[0069] The input device is implemented by any or a combination of any type of device capable of receiving input from a user and transmitting the information related to said input to the processor 101. The input device includes, for example, hardware keys such as touch panels, touch displays, and keyboards, pointing devices such as mice, cameras (for image-based operation input), and microphones (for voice-based operation input).

[0070] The input device may include a sensor unit. The sensor unit is one or more sensors that detect face motion, which indicates changes in the user's facial expression, and body motion, which indicates changes in the relative position of the user's body to the sensor unit. Face motion includes movements such as blinking and opening and closing the mouth. Known sensor units can be used. An example of a sensor unit includes a ToF sensor that measures and detects the time of flight (TF) of light irradiated towards the user until it reflects off the user's face, etc., and returns, a camera that photographs the user's face, and an image processing unit that processes the data captured by the camera. The sensor unit may also include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. The RGB camera and near-infrared camera can be, for example, the True Depth sensor in "iPhone X®" or the LiDAR sensor in "iPad Pro®", or other ToF sensors installed in smartphones. Specifically, this camera projects tens of thousands of invisible dots onto the user's face, etc., using a dot projector. Then, by detecting and analyzing the reflected light of the dot pattern to form a depth map of the face and capturing infrared images of the face, accurate facial data is captured. The processing unit of the sensor unit generates various information based on the depth map and infrared images, and compares this information with registered reference data to calculate the depth of each point on the face (the distance between each point and the near-infrared camera) and positional deviations other than depth.

[0071] Furthermore, the sensor unit may have a function to track not only the user's face but also their hands (hand tracking). The sensor unit may also include sensors other than those mentioned above, such as an accelerometer or a gyroscope. The sensor unit may have a spatial mapping function that recognizes objects in the real space where the user is located based on the detection results of the ToF sensor and other known sensors, and maps the recognized objects onto a spatial map. Hereinafter, when face motion detection data and body motion detection data are not specifically distinguished, they will simply be referred to as "tracking data". The image processing unit of the sensor unit may be provided by a control unit that can be equipped with the information processing system of the present invention.

[0072] The control unit, as an input device, can be one that is appropriate for the type of user terminal. Examples of control units include a touch panel integrated with a display, operation buttons provided on the user terminal's casing, a keyboard, a mouse, or a controller operated by the user's hand. The controller may incorporate various known sensors, such as acceleration sensors and inertial measurement units (IMUs) like gyroscopes. Another example of a control unit is a tracking device that identifies the user's hand movements, eye movements, head movements, and gaze direction. In this embodiment, for example, the system can determine the user's instructions based on the user's hand movements and perform various operations such as starting or ending video streaming, evaluating messages and videos, and requesting the display of a predetermined object (e.g., a gift, as described later). If the sensor unit also has input interface functions such as hand tracking, the control unit can be omitted.

[0073] The output device outputs the processing results processed by the processor 101. The output device includes, for example, a touch panel, a speaker, etc.

[0074] The functions realized by the components described herein may be implemented in a circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), CPUs (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to realize the described functions. A processor includes transistors and other circuits and is considered a circuitry or processing circuitry. A processor may be a programmed processor that executes a program stored in memory.

[0075] In this specification, circuitry, unit, and means are hardware programmed to perform or execute the functions described herein. Such hardware may be any hardware disclosed herein, or any hardware known to be programmed to perform or execute the functions described herein.

[0076] If the hardware is a processor that is considered to be a type of circuitry, then the circuitry, means, or unit is a combination of hardware and software used to constitute the hardware and / or processor.

[0077] Furthermore, the second user terminal 200 and server device 400 in this disclosure can also be configured with the same hardware configuration as in Figure 4, unless otherwise noted.

[0078] Next, various functions that can be executed on a user terminal that has launched an application realized by the information processing system in the embodiment of this disclosure, as well as the transitions of the displayed screens, will be described with reference to the drawings.

[0079] Figure 5 shows the top screen T10 that appears on the user's terminal (it is not yet determined whether the user will actually watch or stream) when a video streaming / viewing application is launched.

[0080] As shown in Figure 5, on the top screen T10, users can select one streaming channel (also called a streaming slot, streaming program, or streaming video) from among the thumbnail images of one or more streaming channels T12 suggested on the pages switchable via tabs T11, T14-17, and then watch a video played on that streaming channel.

[0081] Alternatively, a user can view videos played on a specific streaming channel by accessing a permalink to that channel. Such permalinks can be obtained through notifications from the primary user being followed, or through shared notifications sent by other users.

[0082] In this case, the user watching the video is referred to as the "viewing user," and the device used to watch the video is referred to as the "second user device 200."

[0083] Furthermore, as shown in Figure 5, the top screen T10 may also display a notification area T13 for campaigns, events, and other announcements. This notification area T13 can be switched to display other announcements by sliding it.

[0084] The top screen T10 displays the Recommended tab T11, the Follow tab T14, the Games tab T15 for displaying game categories, the Collaboration Waiting tab T16 for displaying streaming channels waiting for collaborations, and the Beginners tab T17 for displaying streaming channels for beginners. By selecting one of these (switching tabs), you will transition from the top screen T10 to the respective screen.

[0085] Furthermore, the service name display T18 and the search button T19 in the upper frame of the top screen T10 may remain fixed and displayed on the destination screen.

[0086] Similarly, the home button T20, chat button T21, streaming preparation button T22, gacha / shop button T23, and profile button T24 in the lower frame of the top screen T10 may remain fixed and displayed on the destination screen.

[0087] In the top screen T10 shown in Figure 5, a user who selects the displayed thumbnail image T12 becomes a viewer (second user) who watches the video, as described above, while a user who selects the distribution preparation button T22 may become a distribution user (first user) who distributes the video.

[0088] For example, selecting the distribution preparation button T22 on the top screen T10 shown in Figure 5 will transition to the avatar settings screen D10 shown in Figure 6. Then, selecting the distribution button D11 on the avatar settings screen D10 will transition to the distribution settings screen D20 shown in Figure 7. Finally, selecting the distribution start button D21 on the distribution settings screen D20 will transition to the avatar distribution screen D30 shown in Figure 8.

[0089] Next, we will explain the details of the process leading up to the start of video distribution.

[0090] One or more computer processors in this disclosure may include a distribution start request receiving unit, a distribution setting unit, and a distribution start unit.

[0091] The distribution start request receiving unit receives a request from the first user's first user terminal to start distributing the first video, which includes the animation of character objects.

[0092] Here, the first video refers to a video that includes the animation of a character object. In this specification, character objects may sometimes be referred to as "avatars."

[0093] Furthermore, the above distribution start request can be transmitted from the user terminal to the server device 400 by selecting the distribution button D11 located on the avatar settings screen D10, etc., which is accessed from the top screen displayed on the user terminal (later to become the first user terminal) that has launched a dedicated application (video distribution / viewing application) for accessing the above video distribution platform.

[0094] Figure 6 shows an example of the avatar settings screen D10. The avatar settings screen D10 can display the character object CO, distribution button D11, room button D12, change clothes button D13, photo button D14, etc.

[0095] When the user selects the change of clothes button D13, a closet screen opens where the user can select various avatar parts for the character object CO, such as eyes, nose, mouth, hair, accessories, clothes, and background. The closet screen also displays a button to transition to a lottery screen for obtaining avatar parts.

[0096] When the user selects the Room button D12, the user's Room screen (the first virtual space, described later) will open. Details of the Room screen will be described later.

[0097] When the user selects the photo button D14, a shooting screen for taking a still image of the character object will appear.

[0098] Then, when the user selects the distribution button D11, a distribution start request is sent to the server device 400.

[0099] The distribution settings unit, in response to the distribution start request for the first video received by the distribution start request reception unit, sets the distribution settings for the first video based on the specifications from the first user terminal 100.

[0100] For example, when the above distribution button D11 is selected, the screen displayed on the first user terminal 100 transitions from the avatar settings screen D10 shown in Figure 6 to the distribution settings screen D20 shown in Figure 7.

[0101] Streaming settings may include at least one of the following: settings related to the streaming location, settings related to collaborations, settings related to the streaming topic, settings related to the audience, and settings related to the title.

[0102] These distribution settings can be configured using the distribution location setting button D22, the collaboration setting button D23, the distribution topic setting button D24, the visibility setting button D25, and the title setting field D26, respectively, in Figure 7.

[0103] When the distribution location setting button D22 is selected, the distribution location setting screen D29 expands, as shown in Figure 9, displaying the booth distribution object D27 for selecting distribution in a booth and the room distribution object D28 for selecting distribution in a room. The user can then select either a booth or a room as the distribution location. Details about these booths and rooms will be described later.

[0104] The title of the first video, which can be set in the title setting field D26, can be freely determined by the broadcaster within the allowed character limit.

[0105] The first user can freely decide whether or not other users can appear in the first video, which can be configured by selecting the collaboration setting button D23. If other users are allowed to appear, they can apply to appear in the first video; if other users are not allowed to appear, they cannot. In this specification, the state in which other users appear in the first user's video may be referred to as a "collaboration." Further details about collaborations will be described later.

[0106] The number of people who can appear in the first video can only be set if other users are allowed to appear in the first video as mentioned above, and the broadcaster can freely decide the number within the range of the maximum allowed number.

[0107] The password can be optionally set only if other users are allowed to appear in the first video mentioned above, and the broadcaster can freely choose a number of digits. When other users apply to appear in the first video, they will be required to enter this password. Alternatively, the password setting field may be configured to be active only when the "Anyone Can Collaborate" setting is turned OFF.

[0108] The distribution initiation unit distributes information about the first video to the viewer's second user terminal 200 based on the conditions set by the distribution settings unit.

[0109] The instruction to start such distribution is sent by selecting the distribution start button D21 shown in Figure 7. Note that the distribution start button D21 may be configured to become active only when the video title has been set.

[0110] As an example, the distribution start unit distributes information about a video (first video) containing the animation of the first user's character object to the second user's second user terminal 200 (avatar distribution).

[0111] The information related to the first video includes, for example, motion information showing the movement of character objects, audio information of the first user, and gift object information indicating gifts sent by other viewers. The gift object information includes, at a minimum, gift object identification information that identifies the type of gift object, and location information that indicates where the gift object is displayed.

[0112] The distribution starter can then live stream the video via the aforementioned video distribution platform.

[0113] Figure 8 shows the avatar distribution screen D30 displayed on the first user terminal 100.

[0114] The avatar streaming screen D30 displays the character object CO, as well as a comment input button D31 for the streaming user to enter comments, a photo button D32 for saving a still image of the screen, a play start button D33 for playing the game described later, an external service link button D34 for watching videos provided by external services, and a gacha button D62 for obtaining avatar parts.

[0115] Additionally, the top of the avatar streaming screen D30 can display the total number of viewers D35, the total number of likes D36, the number of collaborators D37, a share button to external social media D38, a guest details button D39, a ranking display button D40, a settings button D41, and an audio toggle button D42 to switch the audio on / off. An end button D43 to end the stream can also be displayed.

[0116] While a detailed explanation of these displays and buttons is omitted, selecting the settings button D41 allows you to change the distribution settings configured on the distribution settings screen D20.

[0117] Figure 8 shows an example where, in the distribution settings screen D20, other users are allowed to appear in the first video, and the number of people who can appear in the first video is set to 3. Therefore, the character object CO is displayed shifted to the lower left. Up to 3 other users' character objects can appear in the empty space.

[0118] The above is an explanation of the screen transitions when distributing avatars according to the invention in this disclosure.

[0119] Next, we will explain the screen transitions that occur when a streamer plays a game during a live stream.

[0120] One or more computer processors in this disclosure may include a game request receiving unit, a game video distribution unit, and a game display processing unit.

[0121] During avatar streaming, as shown in Figure 8, the streaming user can request to start playing the game by selecting the "Start Play" button D33.

[0122] Furthermore, the game displayed by selecting the play start button D33 is a dedicated game implemented in the application realized by the information processing system in this disclosure, and may be different from a general-purpose game provided by an external service. Therefore, the game distribution in this disclosure may be distinguished from the distribution of gameplay videos of a general-purpose game provided by an external service, along with the commentary of the distribution user.

[0123] Alternatively, the request to start playing may be sent from the first user terminal 100 to the server device 400 by selecting a "start playing" button located on a predetermined screen displayed on the first user terminal 100.

[0124] Figure 10 shows an example of screen G10, which is the predetermined screen described above, with the play start button G11 placed on it. The screen G10 shown in Figure 10 is the screen that has been accessed by selecting the game tab T15 from the top screen T10 (Figure 5) displayed on the user terminal that has launched the application realized by the information processing system in this disclosure.

[0125] Screen G10 displays at least a play start button G11 that can send a request to start playing a given game.

[0126] Then, when the game request reception unit receives a request to start playing a designated game, the game video distribution unit distributes information about the second video to the second user terminal 200.

[0127] Here, the second video is a gameplay video of a specified game. In this specification, the act of distributing such a video so that it is displayed on the screen of the second user terminal 200 is referred to as "game distribution".

[0128] Furthermore, after launching the application realized by the invention of this disclosure, the user can, as the first user, send a request to the information processing device 2400 to start the distribution of a second video by selecting a play start object placed on the game list screen and the game details screen.

[0129] These game list screens or game details screens are the first screens, which will be explained in detail below.

[0130] In other words, the game display processing unit performs display processing on a first screen that includes a distribution start object capable of sending a distribution start request, a play start object capable of sending a play start request for a predetermined game, and a thumbnail image of the video currently being streamed for the gameplay of the predetermined game.

[0131] Screen G10 shown in Figure 10 corresponds to the game list screen among the first screens. The first screen, which is the game list screen, is the screen that has been accessed by selecting the game tab T15 from the top screen T10.

[0132] This first screen includes a streaming preparation button T22 as the streaming start object, a play start button G11 as the play start object, and a thumbnail image indicating the video streaming channel.

[0133] The first screen displays, for each of the multiple playable games, a play start button G11, a game icon G12, the game name G13, the total number of viewers for the game's streaming channel G14, and a streaming list G15 that includes thumbnail images of the streaming channels currently broadcasting the game.

[0134] The order of thumbnail images displayed in the streaming list G15 can be customized for each user. For example, the order is prioritized by the number of times the user follows the stream and the number of views by that user, followed by the total number of viewers, and then by the oldest streaming start date. The thumbnail images in this streaming list G15 can be scrolled horizontally to change the displayed area.

[0135] Furthermore, the games displayed on this game list screen will be the top 10 titles according to the following priority order. For example, priority is determined by: games released within the last 48 hours, games played by viewers within the last 30 days (newest first), games with the highest priority period ID, and games with the lowest priority period ID (descending order).

[0136] This distribution list G15 will be updated when you return from another tab's screen and when you perform a refresh operation (pull-to-refresh).

[0137] Figure 11 corresponds to the game details screen of the first screen. The first screen, which is the game details screen, is G20, which is the screen accessed by selecting the game icon G12 or game name G13 displayed on the game list screen shown in Figure 10.

[0138] This first screen includes a streaming start object, the streaming preparation button T22, a play start object, the play start button G21, and a thumbnail image indicating the video's streaming channel.

[0139] The first screen also displays the game icon G22, the game name G23, the total number of viewers for the game's streaming channel G24, and a streaming list G25 that includes thumbnail images of the streaming channels currently broadcasting the game.

[0140] The order of thumbnail images displayed in the streaming list G25 shown here can be customized for each user. For example, the order is prioritized by the number of times the user follows the stream and the number of views by that user, followed by the total number of viewers, and then by the oldest streaming start date. The thumbnail images in this streaming list G25 can be scrolled vertically to change the displayed area.

[0141] This distribution list G25 will be updated when you return from another tab's screen and when you perform a refresh operation (pull-to-refresh).

[0142] As described above, the user who selects the "Start Streaming" object (Streaming Preparation Button T22) or the "Start Playing" object (Start Playing Buttons G11, G21) becomes the first user to request either the "Start Streaming" or "Start Playing" action.

[0143] Furthermore, the user who selects the thumbnail image becomes the second user who watches the second video.

[0144] Furthermore, the first screen includes a first area where scrolling is not possible and a second area where scrolling is possible.

[0145] The first screen referred to here is the first screen shown in Figure 11. The first screen includes a first region R1 and a second region R2. Specifically, the first region R1 displays the game title, and the second region R2 displays the aforementioned play start button G21, game icon G22, game name G23, number of viewers G24, and broadcast list G25.

[0146] The first region, R1, is a fixed portion of the display screen that cannot be scrolled, while the second region, R2, is a portion that can be scrolled by the user. By scrolling the second region, R2, the user can view thumbnail images that are hidden off-screen.

[0147] However, because scrolling in the second area may cause the play start button G21 to be hidden off-screen, the display processing unit in this disclosure can display the play start object (play start button G21) in the first area R1 depending on the display state of the play start object (play start button G21) displayed in the second area R2.

[0148] For example, in Figure 11, the play start button G21 is displayed in the second area R2, but in Figure 12, it is displayed in the first area R1. In other words, when part or all of the play start button G21 is no longer displayed in the second area R2, the play start button G21 will reappear in the first area.

[0149] Furthermore, the game display processing unit may display the play start object in the first area R1 in stages according to the display status of the play start object displayed in the second area R2.

[0150] This effect can be achieved by changing the transparency of the play-start object in accordance with the scroll amount of the second region, R2.

[0151] As an example, the scroll amount (in pixels) from 0 to 50 can be associated with the button's transparency from 0.0 (completely transparent) to 1.0 (completely opaque). In this case, the object is completely transparent and invisible in the initial display state, and becomes fully visible when scrolled 50 pixels or more. It is preferable to change the object's transparency linearly during that period (0 to 50). Note that the unit of the scroll amount is logical pixels and may differ from the actual pixels on the display.

[0152] Furthermore, the game request reception unit will be able to receive a request from the first user terminal 100 to end the game after the second video information has been distributed by the game video distribution unit.

[0153] A request to end the game can be sent by selecting the end button located on the game screen.

[0154] Then, when the game request reception unit receives a request to end the play of a specified game, the distribution start unit can terminate the distribution of information regarding the second video and begin distributing information regarding the first video.

[0155] In other words, what is being streamed here is not just a part of the information from the first video, but all of the information from the first video.

[0156] Furthermore, when the distribution start unit finishes distributing information about the second video and begins distributing information about the first video, the first video will be displayed on the second user terminal 200.

[0157] Next, we will explain the steps to begin watching the video.

[0158] One or more computer processors in this disclosure may further include a viewing reception unit.

[0159] The viewing reception department receives video viewing requests from users.

[0160] The above-mentioned distribution initiation unit distributes video and audio information as video information to the user's information processing terminal in response to a viewing request.

[0161] Figure 13 shows an example of the avatar video viewing screen V10 displayed on the second user terminal 200.

[0162] Viewers can post comments by entering text in the comment input field V11 and pressing the submit button V12.

[0163] Additionally, by pressing the gift button V13, the viewer will see a list of gifts (screen V30 in Figure 14), and can send a request to display the selected gift.

[0164] In this case, one or more computer processors in this disclosure may include a determination unit. The determination unit determines whether or not a gift display request has been received from the second user terminal 200.

[0165] A display request may include gift object information. Gift object information includes at least gift object identification information that identifies the type of gift object, and location information that indicates where the gift object will be displayed.

[0166] Furthermore, as shown in Figure 15, gifts can be displayed separately by category (free (paid) gifts, accessories, cheering goods, appeal items, variety items, etc.).

[0167] Here, paid gifts are gifts that can be purchased by viewers using coins they have bought (coin gifts), while free gifts are gifts that viewers can obtain by using points they have acquired for free, or without using points (point gifts).

[0168] Furthermore, the term "gift" as used in this application has the same meaning as the term "token." Therefore, it is possible to understand the technology described in this application by replacing the term "gift" with the term "token."

[0169] Additionally, viewers can post positive ratings by pressing the Like button V14. It is also possible to display buttons for posting negative ratings or other emotions in addition to / besides the Like button V14.

[0170] Furthermore, objects may be displayed on the video in response to such rating submissions. For example, when a positive rating is submitted, an object representing a heart or a thumbs-up symbol may be displayed.

[0171] Additionally, if the first user has enabled other users' appearances in their streaming settings, they can submit a request to appear in the video by selecting the collaboration request button V15.

[0172] Additionally, on the screen of a video streamed by a first user that the second user has not yet followed, a follow button V16 will be displayed for the second user to follow the streamer. This follow button will function as an unfollow button on the screen of a video streamed by a first user that the second user is already following.

[0173] Furthermore, this "following" may occur from one second user to another second user, from one first user to another second user, or from one first user to another first user. However, following will be managed as a one-way association only, and the reverse association will be managed separately as "followers".

[0174] Additionally, a photo button V25 for saving still images of the screen can also be displayed.

[0175] Additionally, the viewing screen V10 also displays the support ranking display button V17, the share button V18, and the ranking display button V19.

[0176] The support ranking displays the ranking of second-tier users who are supporting the first-tier user, and the ranking can be calculated based on the amount of gifts (points / coins), etc.

[0177] Furthermore, regarding video sharing, a second user can press the share button V18 to view a list of shareable SNS (Social Networking Services), and by selecting one, can send a permalink to a specified location on the specified SNS.

[0178] Additionally, by pressing the collaboration request button V15, you can request a collaborative stream from the first user. A collaborative stream means that the second user's character object appears in the first user's streamed video.

[0179] The top of the viewing screen V10 can display the streamer's icon V21, the streamer's name (character object name) V22, the total number of viewers V23, and the total number of likes V24.

[0180] Additionally, selecting the "End Viewing" button V20 will display a screen for ending viewing, allowing you to send a request to end viewing.

[0181] The screen used to end such viewing will be explained in detail. This screen is called "mini-window audio streaming" and is for viewing in a manner that plays only the audio without displaying the video.

[0182] The selection of the above-mentioned End Viewing button V20 is received by the viewing reception unit as a request to end video viewing.

[0183] At this time, the distribution start unit terminates the distribution of video information in response to a request to end viewing, but does not terminate the distribution of audio information.

[0184] Furthermore, when video and audio information is being distributed to the user's terminal, the video is displayed on the main screen of the user's terminal. When only audio information is being distributed, the video is not displayed on the user's terminal, and a secondary screen indicating that video is being watched is displayed.

[0185] Figure 15 shows an image of screen V50 with the sub-screen V51 displayed.

[0186] When this secondary screen V51 is displayed, the main screen shown in the background will revert to the screen that was displayed before the video was viewed. For example, if you move from the Recommended tab to the viewing area, it will return to the Recommended tab display, and if you move from the Follow tab to the viewing area, it will revert to the Follow tab.

[0187] When this sub-screen V51 is displayed, you can operate the main screen and navigate to other screens.

[0188] The secondary screen V51 displays the profile picture, name, title, and an audio icon that visually indicates that audio is playing.

[0189] Then, by selecting the end icon V52 displayed on the secondary screen V51, you can completely end the viewing experience.

[0190] Regarding the termination of video display, the server device may continue to transmit information but not display it on the terminal side, or the server device may stop transmitting information altogether.

[0191] With this configuration, users can search for other streams or enjoy chatting with other users while listening to audio only.

[0192] Next, I will explain "collaboration," where other users appear in the first user's video.

[0193] As described above, the second user can submit a request to participate in the above video after going through the confirmation screen for the collaborative streaming participation request that appears when they press the collaboration request button V15 shown in Figure 13.

[0194] The collaborative avatar display unit in one or more computer processors in this disclosure displays a character object in the video that is generated based on the movements of the viewer who made the participation request, in response to the participation request that was received.

[0195] Figure 16 shows, as an example, a viewing or streaming screen when a guest user's character object, the second avatar CO4, participates in a video displaying the first avatar CO3, which is the host user's character object. Note that in Figure 15, the display of objects other than avatars is omitted.

[0196] Furthermore, as shown in Figure 17, a third avatar CO1, which is a character object generated based on the movements of another viewer, may also participate in the video. In Figure 17, the third avatar CO1 is positioned behind the first avatars CO3 and CO4 (avatar A2), but the three may be positioned in a single row. The placement of the avatars may also be specified by the streaming user.

[0197] Figure 18 shows the list screen T30 of users who have a mutual follow relationship, which is displayed when the Follow tab T14 is selected on the top screen shown in Figure 5. Mutual follow refers to a relationship where both parties follow each other.

[0198] This list screen T30 displays the profile pictures and names of users who have a mutual following relationship.

[0199] As shown in Figure 18, the list screen T30 displays a first object T31 for each user with whom the user has a mutual following relationship. Alternatively, a chat object T32 may be displayed along with the first object T31. Selecting this chat object allows the user to transition to a separate chat screen with the second user.

[0200] The first object T31 sends a predetermined notification to the terminal of the user associated with the first object T31.

[0201] The prescribed notification may, for example, be a summons.

[0202] Next, we will describe in detail the flow for performing a video chat in the embodiments of this disclosure.

[0203] For example, users can initiate a video chat from an individual chat screen or a group chat screen.

[0204] These chat screens can be accessed, for example, from the chat list screen C10 (Figure 19), which is expanded by selecting the message button T21 on the top screen T10 (Figure 5).

[0205] The chat list screen C10 shown in Figure 19 displays the icons of users (character objects) or groups that have previously sent and / or received messages (chat), along with their names or titles. Note that the group icon may include the icons of the users (character objects) who are members of the group.

[0206] Then, the user can start a video chat by selecting a user or group on the chat list screen C10, opening the individual chat screen C20 (Figure 20) or the group chat screen, and selecting the video chat button C21.

[0207] Furthermore, by selecting the edit button C11 on the chat list screen C10 and then selecting the chat creation button C12 or group creation button C13 (Figure 21), it is possible to create a chat screen for a user or group that is not displayed on the chat list screen C10.

[0208] Figure 22 shows the user selection screen C30 that unfolds when the chat creation button C12 is selected. A chat screen is displayed / generated with a user found using the recommended user displayed or the search field C31. The structure of the generated chat screen is the same as the chat screen C20 shown in Figure 20, and a video chat can be started by selecting the video chat button C21.

[0209] Similarly, Figure 23 shows the group creation screen C40, which expands when the group creation button C13 is selected. Users can add other users as group members by selecting the add user button C41. The number of group members that can be added is limited to seven, as an example. The group name can also be set on this screen.

[0210] Once the group is created, the group's chat screen C50 is displayed (Figure 24). Video chat can also be started on the group's chat screen C50 by selecting the video chat button C51.

[0211] Note that the above chat screen C20 can also be accessed from the chat object T32 on the follow list screen T30 (Figure 18).

[0212] Additionally, chat icons can be placed on other users' profile screens, allowing users to transition to the chat screen from various pages and start video chats.

[0213] When a video chat begins, a notification will be sent to the other party, who can join the chat by responding to this notification. Users can configure whether or not they receive such notifications.

[0214] Alternatively, the system may be configured to allow video chats only with users who are mutually following each other. In this case, an icon indicating that a mutually following user is currently video chatting with another user may be displayed on the follower list screen, and the user may be able to join such an ongoing video chat by selecting this icon.

[0215] In this disclosure, the video chat function can be described as a feature that allows only specific users to view the aforementioned collaborative broadcast. Here, "specific users" refers to users participating in the video chat.

[0216] Next, we will explain the concept of the virtual space's extent in this disclosure, referring to Figure 25.

[0217] As shown in Figure 25 as an example, the virtual space in this embodiment is arranged so that disc-shaped islands (worlds) appear to be floating in mid-air. These islands are objects that resemble an inverted tower-shaped cake, and various objects can be placed on a disc-shaped ground. Note that these islands and ground are shown as examples, and their display configurations are not particularly limited.

[0218] The objects that can be displayed include, at a minimum, the first user's character object CO, the gift object G1 corresponding to the gift requested by the second user, and the object S1 controlled by the server device 400 (system side) for display position and timing.

[0219] The user can move and jump character objects within the world through user interaction, and such functionality can be provided, for example, as one of the games described above. In this disclosure, this is specifically referred to as "world distribution," and the above-described procedures for starting and ending game distribution apply.

[0220] Specifically, switching from a regular stream (avatar stream) to a world stream can be done by selecting the start game button D33 (Figure 8) displayed in the avatar stream video, or by selecting the play button G11 or G21 (Figures 10 and 11) for a game selected from the list of games displayed on the screen accessed by selecting the start game button D33.

[0221] Additionally, switching from world streaming to avatar streaming can be done by selecting the "End Play" button displayed on the world streaming video.

[0222] Next, various functions that can be executed in the information processing system 3000 according to the embodiment of this disclosure will be described with reference to the drawings.

[0223] The information processing system 3000 according to the embodiment of this disclosure includes a first user terminal 100 (first information processing device 100) for a first user and a server device 400.

[0224] The information processing system 3000 comprises one or more computer processors, as shown as an example in Figure 26, including a display control unit 410, a reception unit 420, an object placement unit 430, and an associated display unit 440.

[0225] The display control unit 410 controls the display of a video that displays a predetermined virtual space on the first display screen.

[0226] This first display screen is, for example, the display of a first information processing device 100 that can be operated by a first user.

[0227] The display control unit 410 then controls the display of the video on the first display screen.

[0228] In this case, the display control unit 410 may be provided by one or more computer processors provided by the server device 400 or the first information processing device 100.

[0229] Furthermore, the display control unit 410 may also control the display of the video on the second display screen of the second information processing device 200 for the second user.

[0230] In this case, the display control unit 410 may be provided by one or more computer processors provided by the server device 400.

[0231] The display control unit 410 controls the display of the video, making it viewable on the first information processing device 100 and the second information processing device 200.

[0232] In other words, the video may be displayable by the first information processing device 100 alone, or it may be displayable by both the first information processing device 100 and the second information processing device 200.

[0233] In the former case, for example, the first user is a non-distributing user who is using the system of the present invention but is not distributing videos, while in the latter case, the first user is a distributing user who is distributing videos.

[0234] Here, the specified virtual space can be the first virtual space associated with the first user.

[0235] This first virtual space is a space in which objects such as furniture and ornaments (hereinafter referred to as "furniture objects") can be placed, and can be a virtual space that mimics an indoor space (for example, a room, house, shop, and facility) or an outdoor space (for example, a garden, city, sky, underwater, and outer space).

[0236] The size of this first virtual space can be defined as the volume of the first virtual space, which is a three-dimensional space, or as the area of ​​the first virtual space in a plan view.

[0237] Furthermore, the size of the first virtual space may be determined individually for each user, or it may be common to all users.

[0238] Furthermore, the size of the first virtual space can be expanded according to the user's achievements in video distribution, video viewing, and / or actions on videos (such as posting gifts or positive ratings (likes)) within this system, game performance in games provided by this system, and / or billing status for this system.

[0239] Here, the furniture objects described above are not particularly limited in shape, function, etc., as long as they can be placed in a predetermined virtual space by the first user or other users, or by the system (operator).

[0240] Furniture objects can include, for example, objects that mimic shelves, desks, tables, chairs, sofas, beds, wallpaper, background screens, floor coverings, rugs, windows, plants, posters, clocks, musical instruments, food and beverages, electrical appliances, clothing, vehicles, mannequins, and so on.

[0241] The first user can obtain these furniture objects as prizes in a lottery, purchases from the shop, game rewards, items transferred from other users, and rewards for fulfilling certain conditions related to videos or games.

[0242] In this specification, the above-mentioned first virtual space shall be referred to as a "room".

[0243] In the distribution location setting screen D29 shown in Figure 9, if the first user selects "Room" as the distribution location (i.e., selects the Room distribution object D28), the first user's first character object CO will be displayed as movable in the first virtual space as shown in Figure 27, and video distribution will begin.

[0244] In this specification, the distribution of video in the first virtual space described above will be referred to as "room distribution."

[0245] On the other hand, the first user is also associated with a second virtual space, which is a virtual space in which the first character object cannot be moved.

[0246] This second virtual space can be a space where only furniture objects such as wallpaper and floor coverings can be placed (selected), or a space composed of objects such as wallpaper and floor coverings.

[0247] In this specification, the second virtual space described above will be referred to as the "booth."

[0248] In the distribution location setting screen D29 shown in Figure 9, if the first user selects "Booth" as the distribution location (i.e., selects the Booth distribution object D27), the first character object will be displayed in the second virtual space as shown in Figure 28, rendering it immobile, and video distribution will begin.

[0249] In this specification, the distribution of video in the second virtual space described above will be referred to as "booth distribution."

[0250] These first and second virtual spaces can be separate virtual spaces, or the second virtual space may be established as a part of the first virtual space.

[0251] Figure 29 shows an example in which a second virtual space is constructed by placing background screen and floor paper (rug) objects in the first virtual space.

[0252] By positioning the first character object CO in front of and / or above these objects, and adjusting the field of view of the virtual camera, it is possible to record a video that makes it appear as if the first character object CO is doing a "booth broadcast," even while a "room broadcast" is in progress.

[0253] Furthermore, even if the first user selects the room button D12 on the avatar setting screen D10 shown in Figure 6, the first character object CO will be displayed as movable in the first virtual space as shown in Figure 27, but no video will be streamed.

[0254] Thus, the first virtual space is assumed to have both a non-distribution state and a distribution state.

[0255] Furthermore, the first user may be able to rearrange (redecorate) furniture objects in the first virtual space, regardless of its state.

[0256] Furthermore, while room streaming and booth streaming are taking place, the primary display screen will show the video and various information superimposed on the video.

[0257] As an example of the information displayed on the first display screen D50 during room streaming and booth streaming, Figures 27 and 28 show the comment input button D51, audio switching button D52, photo button D53, switch button (switching object) D54, and menu button D55.

[0258] Similarly, as examples of information displayed on the first display screen D50 while room streaming and booth streaming are taking place, Figures 27 and 28 show the first character object's profile icon D56, name D57, total viewer count display D58, and total likes count display D59.

[0259] The comment input button D51, audio switching button D52, and photo button D53 mentioned above correspond to the comment input button D31, audio switching button D42, and photo button D32 shown in Figure 8, which is an example of the initial display screen during booth broadcasting, and provide similar functionality.

[0260] Furthermore, in Figure 27, which shows the screen during room streaming, if the user selects the menu button D55, the menu screen D60 shown in Figure 30 will be displayed. The menu screen D60 displays, as an example, the event button D61, gacha button D62, outfit button D63, redecorate button D64, world button D65, booth switch button D66, streaming board button D67, share button D68, and settings button D69.

[0261] Event button D61 is a button used to display a screen that shows various events.

[0262] The Gacha button D62 is used to display the lottery screen for obtaining avatar parts and furniture objects.

[0263] The coordinate button D63 is a button for displaying a closet screen.

[0264] The redecoration button D64 is a button for displaying a redecoration screen that allows redecoration of the first virtual space.

[0265] The world button D65 is a button for moving the first character object to various virtual spaces (worlds) different from the first virtual space and the second virtual space, or for displaying a screen (such as FIGS. 10 to 12) for a user to play a game.

[0266] The booth switching button D66 is a button for switching room distribution to booth distribution.

[0267] The distribution board button D67 is a button for displaying an information display board called a distribution board on a video.

[0268] The share button D68 is a button for sharing a video via SNS or the like.

[0269] The setting button D69 is a button for performing the above-described distribution settings (such as FIG. 7).

[0270] Furthermore, when the menu button D55 is selected by the user in FIG. 28, which is a screen during booth distribution, a room switching button is displayed in place of the booth switching button D66 shown in FIG. 30. Such a room switching button is a button for switching booth distribution to room distribution.

[0271] Furthermore, as an example of a video displayed on the first display screen D50 that displays the first virtual space in a non-distribution state and information displayed superimposed on the video, FIG. 31 displays the redecoration button D64, the gacha button D62, and the profile icon shooting button D70.

[0272] The details regarding the redecoration button D64 and the gacha button D62 are as described above.

[0273] The Profile Icon Capture Button D70 is a button used to capture a still image of the first character object in the first virtual space.

[0274] Note that displaying the first character object is not required in the first virtual space when it is not being streamed.

[0275] If the first character object is displayed in the first virtual space, whether in a non-distribution or distribution state, its movement shall be performed in accordance with the actions of the first user.

[0276] Furthermore, the movements of the first character object's face and head can reflect the movements of the first user. For example, if the first user tilts their head, the first character object's head will be displayed to tilt in the same way, and if the first user winks, the first character object will be displayed to wink in the same way.

[0277] Furthermore, the movements of the entire body, including the face and head of the first character object, can be controlled according to the command selection made by the first user.

[0278] Commands include, for example, those that apply a predetermined expression, pose, and movement (these predetermined expressions, poses, and movements are called "emotes") to the first character object, and those that apply movements to associate the first character object with furniture objects (movements such as sitting in a chair, lying in a bed, or holding a cup).

[0279] The above commands may be displayed as selectable options upon the first user's request or when commands are available for input.

[0280] Furthermore, the movement of the entire body of the first character object, including its face and head, may be performed automatically, independently of the first user's actions and command selections.

[0281] Furthermore, one or more computer processors of this disclosure may include an operation object display unit that displays operation objects superimposed on the video for receiving operations on a first display screen by a first user.

[0282] Figure 32 shows an example where the operation object 71 is displayed on the first display screen D50 during room streaming, as shown in Figure 27.

[0283] As an example, as shown in Figure 32, the first operation object 71 may consist of a first operation object 71A and / or a second operation object 71B.

[0284] The first operation object 71A is for receiving movement operations such as making the first character object walk or run horizontally in the virtual space, and the second operation object 71B is for receiving movement operations such as making the first character object jump vertically in the virtual space.

[0285] Assuming that the user holds the first information processing device 100 with both hands, the first operation object 71A may be positioned within a predetermined range from the lower left corner of the first display screen, and the second operation object 71B may be displayed within a predetermined range from the lower right corner of the first display screen. For example, the first operation object 71A may be positioned so as to be touchable by the left thumb on the first display screen, and the second operation object 71B may be displayed so as to be touchable by the right thumb on the first display screen, but this is not limited to this.

[0286] As an example, as shown in Figure 32, the first operation object 71 can be superimposed on the video and displayed at the bottom of the first display screen.

[0287] It should be noted that the operation object 71 is only required to be configured to accept an operation on the first display screen by the first user, and is not limited to the configuration that accepts the above-mentioned movement operation.

[0288] As an example, the operation on the first display screen by the first user may be an emote selection operation for changing the expression and / or motion of the first character object, or a room rearrangement operation.

[0289] Furthermore, one or more computer processors of the present disclosure may further comprise an information field display unit.

[0290] Said information field display unit may display an information field for displaying information related to reactions to a moving image by the first user and / or a second user different from the first user, in a manner superimposed on the moving image.

[0291] As an example, reactions to a moving image may be comment posting on the moving image by the first user and / or the second user, and / or posting of a gift or favorable evaluation (like) by the second user, etc. The second user is not particularly limited as long as it is a user different from the first user, and may be a viewing user of the moving image, as an example.

[0292] As an example, the information related to comment posting is the content of a comment posted on the moving image.

[0293] As an example, the information related to posting of a gift or favorable evaluation is a notification that informs that posting of a gift or favorable evaluation has been made. These are included in system comments automatically sent from the operation (system) side, and the system comments also include other information such as that the first user has started distribution (entered the room), that the distribution time has exceeded a predetermined time, and the like.

[0294] As an example, as shown in Figure 32, the information section 72 can be superimposed on the video and displayed at the top of the first display screen.

[0295] The reception unit 420 accepts operations from the first user.

[0296] The operations performed by the first user are not particularly limited to any operations performed by the first user, but include operations on other buttons and objects displayed on the first display screen, in addition to operations on the operation object 71 described above.

[0297] For example, the operation by the first user may be performed by touching the first display screen.

[0298] Furthermore, operations on the above-mentioned objects include specific movement operations on the first object, which will be described later. Operations on objects may also include, for example, selection operations, movement operations, rotation operations, etc., of any object, including the first object and the specific object, which will be described later.

[0299] Furthermore, the reception unit 420 can also receive voice messages from the first user.

[0300] The voice of the first user can be the user's spoken voice acquired by the voice acquisition unit of the first information processing device 100. The acquisition of such voice can be switched ON / OFF by selecting the voice switching button D52 described above.

[0301] The object placement unit 430 places the first object in a predetermined virtual space.

[0302] The first object is not particularly limited as long as it is an object that can be placed in a predetermined virtual space, especially the first virtual space described above. For example, it may be the furniture object described above, which is placed in response to the actions of the first user or other users, or automatically by the system. Furthermore, the first object may be a large furniture object (such as a vehicle) among the furniture objects described above.

[0303] Alternatively, the first object can be a 3D or 2D mannequin object modeled after the first user's character object. This character object can be equipped with various attachment parts (eyes, nose, mouth, hair, top, bottom, shoes, bag, etc.) as specified by the first user.

[0304] Alternatively, the first object may be an object whose display is requested by a second user who is different from the first user. The second user may be, for example, a friend or follower associated with the first user who can have their own character object visit the first virtual space, a viewer who watches the first user's videos, or a guest user who makes a collaborative appearance in the first user's videos.

[0305] The first object displayed in response to a viewing user's request can also be called a gift object.

[0306] Figure 33 shows an example of a redecoration screen when the first object is placed in a predetermined virtual space in response to the first user's actions.

[0307] Thus, when the first user places or moves the first object, the first display screen can show a plan view of the first virtual space, which is a three-dimensional space.

[0308] Furthermore, when the first user places or moves the first object, the first display screen may show a video of the first virtual space, which is a three-dimensional space, captured from above by a virtual camera.

[0309] In the screen shown in Figure 33, the first user can place a first object OB1, selected from a furniture list screen (not shown) displayed on the screen, at a specified location in a predetermined virtual space.

[0310] Specifically, when the first user selects an icon from among several icons displayed on the furniture list screen, the first object OB1 corresponding to the selected icon is displayed (placed) in a designated placeable location in the virtual space.

[0311] This position may be specified by the first user, or an initial position where it can be placed may be automatically determined.

[0312] The first user can then move and reposition the first object OB1, which is placed in a predetermined virtual space, to a different location by performing a move operation (e.g., dragging operation). However, this repositioning is usually limited to cases where no other objects are placed at the destination.

[0313] During this movement operation, as shown in Figure 33, guide bands corresponding to the vertical and horizontal dimensions of the first object OB1 may be displayed in the up, down, left, and right directions of the first object OB1.

[0314] This guide band may change its display mode (for example, change color) if the desired placement position of the first object specified by the movement operation falls within an area of ​​the virtual space where placement is not possible.

[0315] Here, we will explain an example of a determination flow for whether the first object can be placed at the specified location.

[0316] One or more computer processors of this disclosure may further include a configuration feasibility determination unit.

[0317] The placement feasibility determination unit determines whether the desired placement position of the first object specified by the movement operation belongs to a non-placement area in a predetermined virtual space.

[0318] Unplaceable areas can be areas where other objects are already placed, or areas at the edges of a given virtual space.

[0319] For example, the placement feasibility determination unit determines whether or not there is an overlap between the area occupied by the first object and the area where placement is not possible in a plan view of a predetermined virtual space.

[0320] Then, if the placement feasibility determination unit determines that the desired placement location does not belong to the area where placement is not permitted, the reception unit 420 accepts the above-mentioned movement operation.

[0321] On the other hand, if the placement feasibility determination unit determines that the desired placement location belongs to a non-placement area, and that non-placement area is an area where another object is already placed, the placement feasibility determination unit further determines whether the other object already placed permits the placement of the first object.

[0322] Thus, each object can be associated with and stored information indicating whether another object can be placed on it.

[0323] Then, if the placement feasibility determination unit determines that other already placed objects permit the placement of the first object, the reception unit 420 accepts the above-mentioned movement operation.

[0324] On the other hand, if the placement feasibility determination unit determines that other already placed objects do not permit the placement of the first object, the reception unit 420 will not accept the movement operation, and the first object will be returned to its initial placement position when the movement operation is completed (when the drag operation is touched off).

[0325] Other objects that permit the placement of the first object are, for example, objects on which the first object can be placed, such as tables and desks.

[0326] Herein, the term “placement” is used to mean placing the first object in a specified location without changing its size.

[0327] The first object whose movement operation has been received by the reception unit 420 will be placed at the specified position when the movement operation is completed (when the drag operation is touched off).

[0328] Here, the reception unit 420 can receive a specific movement operation that moves the first object to a specific location in a predetermined virtual space where a specific object is located.

[0329] A specific object is not particularly limited as long as it is an object that can be placed in a predetermined virtual space, especially the first virtual space, but it can be an object that can be displayed in association with a second object, as described later. Displaying a second object in association means displaying the second object as being contained within the specific object.

[0330] Herein, the term “storage” is used to mean adjusting the size of a particular object to accommodate a second object.

[0331] Furthermore, in this specification, "storage" may include not only placing a second object inside a specific object, but also attaching a second object to the outside of a specific object, mounting a second object onto a specific object, or decorating a specific object with a second object.

[0332] Certain objects can be objects that are placed in response to the actions of the first user or automatically by the system. These specific objects can be a type of furniture object as described above.

[0333] A specific object can be an object that can be associated with and displayed as a second object, such as a storage furniture (e.g., shelves or chests of drawers), a Christmas tree, a collection box, an advent calendar, a corkboard, or a mannequin.

[0334] Objects resembling storage furniture, collection boxes, and advent calendars can be designed to allow for the placement of second objects inside and outside them.

[0335] An object modeled after a Christmas tree can have its exterior decorated with a second object.

[0336] An object resembling a corkboard can be designed so that a second object can be attached to its surface.

[0337] Mannequin-like objects can be made capable of attaching secondary items, such as avatar parts, clothing, bags, and accessories, to character objects.

[0338] Furthermore, the object modeled after the mannequin mentioned above only needs to have a torso, and is not limited to having a face or limbs. However, if the object modeled after the mannequin has a face, the object modeled after the mannequin can be generated by miniaturizing the first user's character object.

[0339] In Figure 33, the shelf object is shown as a specific object OB2.

[0340] As an example, Figure 34 shows (a) a front view, (b) a rear view, (c) a top view, and (d) a side view of the shelf object in question.

[0341] As shown in Figure 34, as an example, the shelf object has two shelves, with three compartments each on the first, second, and third shelves where a second object can be placed. In Figure 34, these compartments are represented by dashed lines for illustrative purposes.

[0342] The illustration is merely an example, and the number of levels and compartments a particular object may have is not particularly limited.

[0343] Furthermore, the shelf object may also have three additional compartments set up on top of the top shelf, representing a fourth level.

[0344] Furthermore, the shelf object may also be provided with compartments on its sides and back to which a second object can be associated.

[0345] The above-mentioned specific location may be the location where a specific object is placed in a predetermined virtual space, or the area occupied by a specific object in a plan view of the predetermined virtual space.

[0346] Figure 35 shows an example of a screen display when the first object is moved to a specific location in response to the first user's actions.

[0347] Furthermore, the placement feasibility determination unit described above may determine whether the movement operation is a specific movement operation based on the desired placement position of the first object specified by the movement operation.

[0348] Specifically, if the placement feasibility determination unit determines that the desired placement location for the first object belongs to a non-placement area, and that non-placement area is an area where other objects are already placed, the placement feasibility determination unit further checks whether the other already placed object permits the placement of the second object (i.e., whether the other object is a specific object).

[0349] As a result, if it is confirmed that another object is a specific object, the above move operation can be determined to be a specific move operation; if it is confirmed that the other object is not a specific object, the above move operation can be determined to be a non-specific move operation.

[0350] Thus, each object can be associated with and store information indicating whether a second object can be stored within that object.

[0351] On the other hand, if the placement feasibility determination unit confirms that other already placed objects do not permit the placement of the second object (i.e., the other objects are not the specific object), the reception unit 420 will not accept the above-mentioned movement operation, and the first object will be returned to its initial placement position when the movement operation is completed (when the drag operation is touched off).

[0352] Furthermore, when the reception unit 420 receives a specific movement operation, the association display unit 440 displays a second object that meets specific size requirements, associating it with the specific object.

[0353] One specific size requirement for the second object is that it must be of a size that allows it to be associated with a particular object.

[0354] The size of the second object and specific objects can be defined as the volume of these objects, or as the area they occupy in at least one of the plan view, front view, and side view.

[0355] Furthermore, the size that can be associated with a specific object is at least the same size as or smaller than the specific object, and one example is the size that can be placed in the aforementioned area.

[0356] Figure 36 shows a front view of a specific object, a shelf object, illustrating an example where a second object, OB3, is associated with one of the compartments inside the shelf object.

[0357] Figure 37 shows a side view of a specific object, a shelf object, illustrating an example where a second object, OB3, is associated with a section of the shelf object's side. Thus, the second object OB3 associated with the side of the shelf object can be a flat object such as a photograph or poster.

[0358] Figure 38 shows a front view of a specific object, a corkboard, illustrating an example where a second object, OB3, is associated with one section. Thus, the second object OB3 associated with the corkboard object can be a flat object such as a photograph or poster.

[0359] The second object OB3 may be generated each time the reception unit 420 receives a movement operation, or it may be extracted from a pre-prepared object.

[0360] For example, when the reception unit 420 receives a movement operation, the size of the first object is adjusted to an appropriate size and a second object is generated.

[0361] Alternatively, when the reception unit 420 receives a move operation, a second object, which is a pre-prepared object and is of a different size from the first object, can be extracted in place of the first object.

[0362] In this way, a second object that meets specific size requirements can be automatically generated or extracted and displayed in association with a particular object.

[0363] With the above configuration, it is possible to provide a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above.

[0364] Specifically, with the above configuration, it is possible to relax the restrictions on the number of objects that can be placed and their placement locations based on their size within a given virtual space.

[0365] More specifically, with the above configuration, it is possible to increase the number of virtual objects that can be placed in a given virtual space by displaying a second object in association with a specific object at a specific location where a first object could not be placed in the conventional method, where a specific object is already placed.

[0366] Furthermore, with the above configuration, it becomes possible to provide variations in the display methods of objects placed in a predetermined virtual space.

[0367] Specifically, the first object, when placed in a location other than the specified position, will be displayed in its original form, while the first object, when moved to the specified position, will be displayed as a second object. This allows the first user to choose which form in which location the first object is placed.

[0368] Furthermore, with the above configuration, users can manage their owned items in a virtual space.

[0369] Managing owned items in a virtual space differs from managing a user's inventory list in a screen often referred to as a pocket, bag, or pouch. Instead, it involves placing owned items as objects in the virtual space, while maintaining a consistent size and arranging them in a way that makes them easy for the user to view.

[0370] In the present invention, in addition to being able to manage owned items on the inventory screen (furniture list screen, etc.), it also becomes possible to manage some of the owned items selected by the user in the virtual space.

[0371] One or more computer processors in this disclosure may further include a generation unit 450, as shown in Figure 39.

[0372] The generation unit 450 generates a second object by adjusting the size of the first object when the reception unit 420 receives a specific movement operation.

[0373] In this case, the association display unit 440 displays the second object generated by the generation unit 450 in association with a specific object.

[0374] In this case, the second object may be created each time a specific movement operation is received.

[0375] For example, when the reception unit 420 detects the end of a specific movement operation (detects a touch-off operation), the generation unit 450 can create a second object by reducing or enlarging the size of the first object to an appropriate size suitable for displaying it in association with a specific object.

[0376] An appropriate size is a size that can be associated with a specific object, for example, as mentioned above, a size that is at least the same as or smaller than a specific object, and one example is a size that can be placed in the area mentioned above.

[0377] One or more computer processors in this disclosure may further include a size comparison unit 470, as shown in Figure 39.

[0378] The size comparison unit 470 compares the size of a specific object's section with the size of the first object when the reception unit 420 receives a specific movement operation.

[0379] The generation unit 450 can adjust the size of the first object to an appropriate size that fits the area, based on the comparison results from the size comparison unit 470.

[0380] If the generation unit 450 determines, as a result of the comparison by the size comparison unit 470, that the size of the first object is larger than the size of the partition, it can generate a second object by reducing the size of the first object to a size that fits the partition.

[0381] Alternatively, if the generation unit 450 determines, as a result of the size comparison unit's comparison, that the size of the first object is the same as or smaller than the size of the partition, it can create the second object without adjusting the size of the first object.

[0382] Alternatively, if the generation unit 450 determines, as a result of the comparison by the size comparison unit 470, that the size of the first object is smaller than the size of the partition, it can enlarge the size of the first object to a size that fits the partition and generate a second object.

[0383] With this configuration, since the second object is created each time, the amount of data that needs to be prepared in advance can be reduced.

[0384] Furthermore, one or more computer processors in this disclosure may further include an extraction unit 460, as shown in Figure 39.

[0385] When the receiving unit 420 receives a specific movement operation, the extraction unit 460 extracts a second object from a pre-prepared set of objects, which differs from the first object only in size.

[0386] In this case, the association display unit 440 displays the second object extracted by the extraction unit 460 in association with a specific object.

[0387] This configuration reduces the processing load required to generate the second object.

[0388] The second object may be not only a different size of the first object, but may also possess at least some of the characteristics of the first object.

[0389] For example, if the first object is clothing, hair, accessories, etc., to be attached to a character object, then a mannequin (full body, head, torso, etc.) wearing the first object can be considered the second object.

[0390] Furthermore, if the first object is wallpaper or flooring, the canvas on which the pattern of the first object is drawn can be considered the second object.

[0391] The video displayed on the first screen may also include a first character object of the first user that can move within a predetermined virtual space.

[0392] In this case, one or more computer processors in this disclosure further include a virtual camera control unit 480, as shown in Figure 39.

[0393] The virtual camera control unit 480 controls the operation of a virtual camera that captures images of a predetermined virtual space.

[0394] Specifically, the virtual camera control unit 480 controls the operation of the virtual camera in a first mode, a second mode, or a third mode.

[0395] The first mode is a control mode for the virtual camera when it is in a state where it can accept movement operations for the first character object.

[0396] For example, the first mode can be a mode in which the operation of the virtual camera can be changed according to the operation of the first user.

[0397] Figures 27, 29, and 31-32 show examples of videos captured by a virtual camera controlled in the first mode. In the first mode, the virtual camera basically follows the movement of the first character object, and its position, orientation, etc., can be controlled in response to the operations of the first user.

[0398] The second mode is a control mode for the virtual camera when it is in a state where it can accept movement operations on the first object.

[0399] For example, the second mode can be a mode that photographs a predetermined virtual space from above (a redecoration mode).

[0400] Figures 33 and 35 show examples of videos captured by a virtual camera controlled in the second mode, in which the virtual camera is controlled to capture a predetermined virtual space from an overhead, bird's-eye view.

[0401] Then, when the virtual camera's operation is controlled in the second mode, if the reception unit 420 receives a specific movement operation, the virtual camera control unit 480 changes the control of the virtual camera's operation from the second mode to the third mode.

[0402] For example, the third mode could be a mode that photographs a specific object from the front.

[0403] Figures 36 and 38 show examples of videos captured by a virtual camera controlled in the third mode, in which the virtual camera is controlled to capture a specific object from a frontal direction.

[0404] However, if the second object is associated with the side of a particular object, in the third mode, the virtual camera shall be controlled to photograph the particular object from the side, as shown in Figure 37.

[0405] In other words, the locations to which the second object can be associated will be displayed in a more prominent way.

[0406] Furthermore, when the virtual camera is being controlled in the first mode, if the reception unit 420 receives a selection operation for a specific object placed in a predetermined virtual space, the virtual camera control unit 480 can change the control of the virtual camera's operation from the first mode to the third mode.

[0407] Furthermore, after the above storage operation, the virtual camera control unit 480 can change the control of the virtual camera's operation from the third mode to the first mode or the second mode.

[0408] Furthermore, if the virtual camera's operation is switched back from the third mode to the first mode, it is possible to configure the character object to move next to a specific object (within a predetermined distance from the specific object), regardless of where the character object was located in the first mode before switching to the third mode.

[0409] Specifically, when a selection operation is performed on a particular object in the screens shown in Figures 27, 29, 31-32, etc., the screen transitions to the screen shown in Figure 36-38.

[0410] Furthermore, the object placement unit 430 can, in response to an operation by the first user, release the association between a specific object and a second object, and reposition the first object in a predetermined virtual space.

[0411] Such operations may be performed when the virtual camera's operation is controlled in third mode. The first user can change the placement of the second object within a specific object, or reposition the first object in a given virtual space, by performing operations on the second object.

[0412] The above rearrangement can be performed by long-pressing the second object, which is displayed in association with a specific object, and then dragging it outside of that specific object.

[0413] As a result, the second object that was associated with a specific object is restored and displayed as the first object at the specified location in the first virtual space.

[0414] Furthermore, as mentioned above, a particular object may have at least one compartment on which a second object can be placed.

[0415] By creating designated areas, it becomes possible to arrange second objects in a more visually appealing and organized manner than simply placing them freely.

[0416] Furthermore, the object placement unit 430 can rearrange a second object to a different section of a specific object in response to an operation by the first user.

[0417] The above operation can be performed by dragging a second object, which is placed in one section, to another section.

[0418] In this case, if another second object is already displayed in the destination area, the movement can be made impossible, or it can be configured to replace the other second object in the destination area.

[0419] Alternatively, if another second object is already displayed at the destination, the configuration can be set up to display both second objects in the destination area. In this case, the size of both second objects may be further reduced.

[0420] Here, if another second object is of the same type as the second object placed in one section, only one second object may be displayed, and a mark or the like may be added to indicate that multiple second objects are placed in the same section.

[0421] Furthermore, if another second object is of a different type from the second object already placed in the same section, the second object can be displayed by associating it with the already placed second object.

[0422] For example, if the second object already placed is a mannequin object, it can be made to appear as if another second object, an attachment object, is attached to that mannequin.

[0423] Furthermore, if another second object is moved into a section where a mannequin object wearing yet another second object is placed, the mannequin object may be displayed with yet another second object attached.

[0424] Furthermore, the number of compartments owned by a particular object can be increased or decreased in response to specific operations performed by the first user.

[0425] A specific operation is, for example, the operation of purchasing a section. In the case of a shelf object, you can expand that section upwards.

[0426] Furthermore, the reception unit 420 can also accept adjustment operations on the second object by the first user.

[0427] The above adjustment operations include, for example, resizing and / or orienting the second object.

[0428] However, with respect to the size adjustments described above, the range of adjustable sizes shall be defined as a predetermined range of sizes that can be associated with a specific object.

[0429] With this configuration, the first user will be able to fine-tune the size of the second object.

[0430] One or more computer processors in this disclosure may further include an attribute determination unit 490, as shown in Figure 39.

[0431] The attribute determination unit 490 determines, in response to an operation by the first user, whether there is a predetermined relationship between the attributes set on the first object and the attributes set on a specific object.

[0432] The first object is assumed to have at least one attribute, such as food, drink, vehicle, ornament, or wearable item, based on the type of the first object.

[0433] Similarly, assume that a specific object also has at least one attribute set for the first object it can be associated with.

[0434] Furthermore, when the first user specifies a specific location of a specific object as the destination for the first object, the attribute determination unit 490 can determine whether the attribute of the first object is an attribute that can be associated with the specific object.

[0435] The reception unit 420 accepts a specific movement operation when the attribute determination unit 490 determines that a predetermined relationship exists.

[0436] For example, if a particular object is modeled after a refrigerator, it is possible to associate it with objects that model food or drinks, but not with objects that model ornaments or vehicles.

[0437] This configuration allows for a sense of unity among the objects associated with a particular object, and because a specific object is required for each attribute, it increases the desire to acquire various specific objects.

[0438] Furthermore, the object placement unit 430 can place a specific object in a predetermined virtual space, either visible or invisible to the second user, based on operations performed by the first user.

[0439] Whether a particular object is visible to a second user or not, any second object associated with that particular object may be displayed in a way that is visible to the second user.

[0440] Taking the shelf object shown in Figure 36 as an example, positioning a specific object OB2 so that it is visible to a second user means that both the shelf object and the second object positioned next to it are displayed on the second user's screen.

[0441] On the other hand, placing a specific object in a way that makes it invisible to a second user means that the shelf object portion shown in Figure 36 is not displayed on the second user's screen (it becomes transparent), and only the second object, which is aligned with the shelf object, is displayed on the second user's screen.

[0442] In either case, the specific object may be displayed visibly on the first user's screen, or it may be displayed visibly on the first user's screen only on the redecoration screen.

[0443] Furthermore, the system may be configured to allow switching between making specific objects visible to a second user and not, depending on the first user's actions.

[0444] The association display unit 440 can, based on an operation by the first user, arrange a second object in association with a specific object, making it visible or invisible to the second user.

[0445] Placing a second object in a way that makes it visible to a second user means, for example, that the second object is placed on a shelf object that has no door or has an open door, as shown in Figure 36.

[0446] On the other hand, placing a second object in a manner that makes it invisible to a second user means that the associated second object is placed inside a specific object in a manner that makes it invisible (for example, a storage unit with doors or drawers (shelves, chests of drawers, safes, refrigerators, shrines, etc.)).

[0447] In the latter case, the specific object may be configured such that the second object becomes visible to the second user in response to an operation performed by the first user to make the second object visible to the second user (for example, an operation to open a door).

[0448] Furthermore, the operation to make the second object visible to the second user may be performed by a user other than the first user, in which case the door may be configured to require a key (such as possession of a key object or entry of a password) to unlock.

[0449] A specific object associated with a second object may be made capable of being moved within a predetermined virtual space in response to operations performed by the first user.

[0450] In other words, both specific objects associated with a second object and specific objects not associated with a second object can be moved, rotated, removed, etc., in the virtual space in response to operations by the first user, just like the first object described above.

[0451] Furthermore, if a specific object is removed from the virtual space, any second object that was associated with that specific object will have its association terminated.

[0452] The object placement unit 430 can place a first object in a predetermined virtual space based on instructions from a second user who is different from the first user.

[0453] In this case, as described above, the second user could be, for example, a friend or follower associated with the first user who can have their character object visit the first virtual space, a viewer who watches the first user's videos, or a guest user who makes a collaborative appearance in the first user's videos.

[0454] For example, the first object displayed in response to a viewing user's request is a gift object.

[0455] The first user can then associate the gift object submitted by the second user with a specific object and place it accordingly.

[0456] Normally, gift objects placed by a second user have a display time set based on their type and the second user's information. However, it is possible to configure the system so that the display time restriction is removed only for gift objects placed in association with a specific object.

[0457] With this configuration, for example, by placing a specific object in a position visible on the streaming screen and associating the thrown gift objects with that specific object, it becomes possible to display the gifts in an orderly manner and extend their display time.

[0458] As described above, the structure of this disclosure provides a technical improvement that solves or mitigates at least some of the problems of the prior art described above.

[0459] Specifically, with the above configuration, it is possible to relax the restrictions on the number of objects that can be placed and their placement locations based on their size within a given virtual space.

[0460] Furthermore, with the above configuration, it becomes possible to provide variations in the display methods of objects placed in a predetermined virtual space.

[0461] Traditionally, the size of furniture placed in virtual spaces such as rooms was determined by default. In recent years, however, larger furniture has been released, leading to the problem that placing large furniture in a room would prevent other furniture from being placed.

[0462] Therefore, the technology disclosed herein allows for the effective use of limited personal space by storing furniture in storage furniture.

[0463] Furthermore, the system is designed to automatically adjust the size of furniture when it is stored in storage units, making it easy for users to operate.

[0464] The virtual spaces described above are not limited to spaces for video streaming using avatars (rooms, booths, worlds, etc.) or metaverse spaces where avatars move around; they can also be applied to game spaces for playing games using character objects that users can control.

[0465] In this case, the first object may include items acquired on the game field, items given as rewards, items obtained through lotteries or purchases, and supply items provided by allies.

[0466] Next, an example of an information processing method in an embodiment of this disclosure will be described.

[0467] The information processing method in the embodiment of this disclosure is the information processing method in the information processing system 3000 shown in Figure 3. The information processing system 3000 comprises at least a first user terminal (first information processing device) 100 and a server device 400.

[0468] The information processing method in this disclosure is characterized by causing one or more computer processors in the information processing system 3000 to execute a display control step S410, an object placement step S420, a reception step S430, a determination step S440, and an associated display step S450, as shown as an example in Figure 40.

[0469] The display control step S410 controls the display of a video that displays a predetermined virtual space on the first display screen. This display control step S410 can be performed by the display control unit 410 described above.

[0470] Furthermore, the display control step S410 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0471] The object placement step S420 places a first object in a predetermined virtual space. This object placement step S420 can be performed by the object placement unit 430 described above.

[0472] Furthermore, the object placement step S420 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0473] The reception step S430 accepts an operation from the first user. This reception step S430 can be performed by the reception unit 420 described above.

[0474] Furthermore, the reception step S430 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0475] The determination step S440 determines whether the operation received in the reception step S430 is a specific movement operation that moves the first object to a specific location in a predetermined virtual space where a specific object is located.

[0476] The determination step S440 may be performed on the server side (server device 400) or on the client side (user terminal 100).

[0477] The association display step S450, if the determination step S440 determines that the operation is a specific movement operation, displays a second object that satisfies specific size conditions in association with the specific object. This association display step S450 can be performed by the association display unit 440 described above.

[0478] Furthermore, the association display step S450 may be executed on the server side (server device 400) or on the client side (user terminal 100).

[0479] With the above configuration, it is possible to provide a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above.

[0480] Next, a computer program in an embodiment of this disclosure will be described.

[0481] The computer program in the embodiments of this disclosure is a computer program executed in the information processing system 3000 shown in Figure 3. The information processing system 3000 comprises at least a user terminal 100 and a server device 400.

[0482] The computer program in this disclosure is characterized by enabling one or more computer processors of the information processing system 3000 to implement display control functions, object placement functions, reception functions, and associated display functions.

[0483] The display control function controls the display of a video that shows a predetermined virtual space on the primary display screen.

[0484] The object placement function places the first object in a designated virtual space.

[0485] The reception function accepts operations from the first user.

[0486] The association display function, when the reception function receives a specific move operation that moves the first object to a specific location in a predetermined virtual space where a specific object is placed, displays a second object that meets specific size requirements, associating it with the specific object.

[0487] The above functions can be realized by the circuits 1410 to 1440 shown in Figure 41. The display control circuit 1410, object placement circuit 1420, reception circuit 1430, and associated display circuit 1440 are realized by the display control unit 410, object placement unit 430, reception unit 420, and associated display unit 440 described above, respectively. Details of each unit are as described above.

[0488] With the above configuration, it is possible to provide a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above.

[0489] Finally, the information processing device in the embodiment of this disclosure will be described. The information processing device corresponds to the user terminal 100 in the information processing system 3000 described above.

[0490] As shown in Figure 42, the information processing device comprises a display control unit 110, a reception unit 120, an object placement unit 130, and an association display unit 140.

[0491] The display control unit 110 controls the display of a video that displays a predetermined virtual space on the first display screen. This display control unit 110 can have the same configuration as the display control unit 410 described above.

[0492] The reception unit 120 accepts operations from the first user. This reception unit 120 can have the same configuration as the reception unit 420 described above.

[0493] The object placement unit 130 places the first object in a predetermined virtual space. This object placement unit 130 can have the same configuration as the object placement unit 430 described above.

[0494] When the reception unit 120 receives a specific movement operation that moves the first object to a specific location in a predetermined virtual space where a specific object is located, the association display unit 140 displays a second object that satisfies specific size conditions, associating it with the specific object. The association display unit 140 can have the same configuration as the association display unit 440 described above.

[0495] With the above configuration, it is possible to provide a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above.

[0496] Furthermore, a computer or mobile phone or other information processing device can be suitably used to function as a server or terminal device according to the above-described embodiment. Such an information processing device can be realized by storing a program describing the processing content that realizes each function of the server or terminal device according to the embodiment in the storage unit of the information processing device, and having the CPU of the information processing device read and execute the program.

[0497] Figure 43 is a block diagram of a processing circuit that performs computer-based operation in accordance with this disclosure. Figure 43 shows the processing circuit 600, which corresponds to the CPU of the terminal and device in this disclosure.

[0498] The processing circuit 600 is used to control any computer-based and cloud-based control processes, and the flowchart description or block can be understood as representing a module, segment, or portion of code containing one or more executable instructions for implementing a particular logical function or step in the process, and alternative implementations are included within the scope of exemplary embodiments of this advance in which the function can be performed. The order from those illustrated or discussed is included substantially concurrently or in reverse order depending on the functionality involved, as will be understood by those skilled in the art. The functionality of the elements disclosed herein can be implemented using circuits or processing circuits which may include general-purpose processors, special-purpose processors, integrated circuits, ASICs ("Application-Specific Integrated Circuits"), conventional circuits configured or programmed to perform the disclosed functions and / or combinations thereof. A processor processes a circuit or circuit so as to include transistors and other circuits within them. A processor may be a programmed processor that executes a program stored in memory. In this disclosure, a processing circuit, unit, or means is hardware that performs or is programmed to perform the enumerated functions. Hardware may be any hardware disclosed herein, or any other hardware known in any other way that is programmed or configured to perform the enumerated functions.

[0499] In Figure 43, the processing circuit 600 includes a CPU 601 that executes one or more control processes discussed in this disclosure. Process data and instructions may be stored in memory 602. These processes and instructions may also be stored in a storage medium disk 604, such as a hard drive (HDD) or portable storage medium, or may be stored remotely. Furthermore, the claimed advances are not limited to the form of the computer-readable medium in which the process instructions of the present invention are stored. For example, instructions may be stored in a CD, DVD, flash memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk, or any other non-temporary computer-readable medium of an information processing device with which the processing circuit 600 communicates, such as a server or computer. The processes may also be stored executablely by the processing circuit 600 in network-based storage, cloud-based storage, or other mobile-accessible storage.

[0500] Furthermore, the advances of the claims may be provided as a utility application, a background daemon, or a component of an operating system, or a combination thereof, and run together with the CPU 601 and an operating system, such as Microsoft Windows, UNIX, Solaris, LINUX, Apple MAC-OS, Apple iOS, and other systems known to those skilled in the art.

[0501] Hardware elements for realizing the processing circuit 600 can be realized by various circuit elements. Furthermore, each function of the above-described embodiment may be realized by a circuit including one or more processing circuits. The processing circuit includes a particularly programmed processor, for example, a processor (CPU) 601 as shown in Figure 43. The processing circuit also includes devices such as application-specific integrated circuits (ASICs) and conventional circuit components arranged to perform the enumerated functions.

[0502] Alternatively, or additionally, the CPU 601 may be implemented on an FPGA, ASIC, PLD, or using discrete logic circuits in a manner recognizable to those skilled in the art. Furthermore, the CPU 601 may be implemented as multiple processors operating in parallel and cooperatively to execute the instructions of the present invention described above.

[0503] The processing circuit 600 in Figure 43 also includes a network controller 606, such as an Ethernet PRO network interface card, for interfacing with the network 700. To understand this, the network 700 can be a public network such as the Internet, or a private network such as a local area network (LAN) or wide area network (WAN), or any combination thereof, and may also include a public switched telephone network (PSTN) or Integrated Services Digital Network (ISDN) subnetwork. The network 700 can also be wired, such as an Ethernet network or a Universal Serial Bus (USB) cable, or wireless, such as a cellular network including EDGE, 3G and 4G wireless cellular systems. The wireless network can also be Wi-Fi, wireless LAN, Bluetooth, or any other known form of wireless communication. Furthermore, the network controller 606 may comply with other direct communication standards such as Bluetooth, Near Field Communication (NFC), infrared, or others.

[0504] The processing circuit 600 further includes a display controller 608, such as a graphics card or graphics adapter, for interface with a display 609, such as a monitor. The I / O interface 612 interfaces with a keyboard and / or mouse 614, as well as a touchscreen panel 616 on or separate from the display 609. The I / O interface 612 also connects to various peripherals 618.

[0505] The storage controller 624 connects the storage medium disk 604 to a communication bus 626 which may be ISA, EISA, VESA, PCI, or similar, and interconnects all components of the processing circuit 600. A general description of the features and functionality of the display 609, keyboard and / or mouse 614, as well as the display controller 608, storage controller 624, network controller 606, and I / O interface 612, is omitted herein for brevity, as these features are publicly known.

[0506] The exemplary circuit elements described in the context of this disclosure may be replaced by other elements and may have different structures from the embodiments provided herein. Furthermore, the circuits configured to perform the functions described herein may be implemented in multiple circuit units (e.g., chips), or the features may be combined in a circuit on a single chipset.

[0507] The functions and features described herein may also be performed by various distributed components of the system. For example, one or more processors may perform these system functions, where the processors are distributed among multiple components communicating within a network. The distributed components may include one or more client and server machines that can share processing, in addition to various human interfaces and communication devices (e.g., display monitors, smartphones, tablets, personal digital assistants (PDAs)). The network may be a private network such as a LAN or WAN, or a public network such as the Internet. Inputs to the system may be received directly via user input, in real time, or remotely as a batch process. Furthermore, some implementations may run on modules or hardware that are not identical to those described. Thus, other implementations are within the scope of what is claimed.

[0508] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents.

[0509] Furthermore, the methods described in the embodiments can be distributed by storing the program, which can be executed by a computer, on recording media such as magnetic disks (floppy disks, hard disks, etc.), optical disks (CD-ROMs, DVDs, MOs, etc.), and semiconductor memory (ROMs, RAMs, flash memory, etc.), and by transmitting them via communication media. The program stored on the media also includes a configuration program that configures the software means (including not only the executable program but also tables and data structures) to be executed by the computer. The computer implementing this device reads the program recorded on the recording media and, if necessary, constructs the software means using the configuration program, and executes the above-described process by controlling its operation with this software means. The recording media referred to in this specification are not limited to those for distribution, but also include storage media such as magnetic disks and semiconductor memory provided inside the computer or in devices connected via a network. The storage unit may function as, for example, main memory, auxiliary memory, or cache memory. [Explanation of symbols]

[0510] 100 First Information Processing System 400 Server Devices 410 Display Control Unit 420 Reception Department 430 Object Placement Section 440 Related Display Section

Claims

1. An information processing system comprising one or more computer processors, The one or more computer processors described above are: A display control unit that controls the display of a video showing a predetermined virtual space on a first display screen of a first information processing device, wherein the video displays a first character object that can move within the predetermined virtual space, A reception area that accepts operations from the first user, An object placement unit that places a first object in the predetermined virtual space, The system includes a virtual camera control unit that controls the operation of a virtual camera that captures images of the predetermined virtual space, The virtual camera control unit controls the operation of the virtual camera. The first character object is controlled in first mode while in a state where it can accept movement operations, The first object is controlled in second mode while in a state where it is capable of accepting movement operations. An information processing system in which, when the operation of the virtual camera is controlled in the second mode, the reception unit receives a specific movement operation, and the virtual camera control unit changes the control of the virtual camera's operation from the second mode to the third mode.

2. The aforementioned specific movement operation is an operation to move the first object to a specific location in the predetermined virtual space where a specific object is located. The one or more computer processors mentioned above are: The information processing system according to claim 1, further comprising an association display unit that, when the reception unit receives the specific movement operation, displays a second object that satisfies specific size conditions in association with the specific object.

3. The one or more computer processors mentioned above further include: When the receiving unit receives the specific movement operation, the generation unit generates the second object by adjusting the size of the first object, The information processing system according to claim 2, characterized in that the association display unit displays the second object generated by the generation unit in association with the specific object.

4. The one or more computer processors mentioned above further include: When the receiving unit receives the specific movement operation, it includes an extraction unit that extracts a second object from a pre-prepared set of objects, the second object being different from the first object only in size. The information processing system according to claim 2, characterized in that the association display unit displays the second object extracted by the extraction unit in association with the specific object.

5. The information processing system according to claim 2, characterized in that the object placement unit, in response to an operation by the first user, releases the association between the specific object and the second object, and rearranges the first object in the predetermined virtual space.

6. The information processing system according to claim 2, characterized in that the specific object has at least one section on which the second object can be placed.

7. The information processing system according to claim 6, characterized in that the object placement unit rearranges the second object to another section of the specific object in response to an operation by the first user.

8. The information processing system according to claim 6, characterized in that the number of partitions of the particular object can be increased or decreased in response to a specific operation by the first user.

9. The one or more computer processors mentioned above further include: When the receiving unit receives the specific movement operation, it is equipped with a size comparison unit that compares the size of the section of the specific object with the size of the first object. The information processing system according to claim 3, characterized in that the generation unit adjusts the size of the first object to an appropriate size that fits the section based on the results of the comparison by the size comparison unit.

10. The information processing system according to claim 9, characterized in that, if the generation unit determines, as a result of the comparison by the size comparison unit, that the size of the first object is larger than the size of the partition, it generates a second object by reducing the size of the first object to a size that fits the partition.

11. The information processing system according to claim 9, characterized in that, if the generation unit determines, as a result of the comparison by the size comparison unit, that the size of the first object is the same as or smaller than the size of the partition, the first object is made into a second object without adjusting its size.

12. The reception unit further receives adjustment operations on the second object by the first user, The information processing system according to claim 2, characterized in that the adjustment operation is size adjustment and / or orientation adjustment of the second object.

13. The information processing system according to claim 1, characterized in that the first mode is a mode in which the operation of the virtual camera can be changed in accordance with the operation of the first user.

14. The information processing system according to claim 1, characterized in that the second mode is a mode in which the predetermined virtual space is photographed from above.

15. The information processing system according to claim 2, characterized in that the third mode is a mode in which the specific object is photographed from the front.

16. When the operation of the virtual camera is controlled in the first mode, if the receiving unit receives a selection operation for the specific object placed in the predetermined virtual space, The information processing system according to claim 2, characterized in that the virtual camera control unit changes the control of the operation of the virtual camera from the first mode to the third mode.

17. The one or more computer processors mentioned above further include: The system includes an attribute determination unit that determines whether there is a predetermined relationship between the attributes set on the first object and the attributes set on the specific object, in response to an operation by the first user. The information processing system according to claim 2, characterized in that the reception unit accepts the specific movement operation when the attribute determination unit determines that the predetermined relationship exists.

18. The information processing system according to claim 2, characterized in that the object placement unit places the specific object in the predetermined virtual space in a manner that is visible or invisible to the second user, based on the operation of the first user.

19. The information processing system according to claim 2, characterized in that the association display unit displays the second object in association with the specific object in a manner that is visible or invisible to the second user, based on the operation of the first user.

20. The information processing system according to claim 2, characterized in that the object placement unit places the specific object at a different location in the predetermined virtual space in response to an operation by the first user.

21. The information processing system according to claim 1, characterized in that the object placement unit places the first object in the predetermined virtual space based on instructions from a second user different from the first user.

22. One or more computer processors, A display control step for controlling the display of a video that displays a predetermined virtual space on a first display screen, wherein the video displays a first character object that can move within the predetermined virtual space; An object placement step of placing a first object in the predetermined virtual space, A reception step that accepts operations from the first user, The system performs a virtual camera control step that controls the operation of a virtual camera that captures the predetermined virtual space, In the virtual camera control step, the operation of the virtual camera is controlled as follows: The first character object is controlled in first mode while in a state where it can accept movement operations, The first object is controlled in second mode while in a state where it is capable of accepting movement operations. An information processing method for changing the control of the virtual camera's operation from the second mode to the third mode when a specific movement operation is received while the virtual camera's operation is being controlled in the second mode.

23. One or more computer processors A display control function that controls the display of a video showing a predetermined virtual space on a first display screen, wherein the video displays a first character object that can move within the predetermined virtual space; An object placement function for placing a first object in the predetermined virtual space, A reception function that accepts operations from the first user, A virtual camera control function is implemented that controls the operation of a virtual camera that captures the predetermined virtual space. The virtual camera control function controls the operation of the virtual camera. The first character object is controlled in first mode while in a state where it can accept movement operations, The first object is controlled in second mode while in a state where it is capable of accepting movement operations. When the operation of the virtual camera is controlled in the second mode, if the reception function receives a specific movement operation, the virtual camera control function is a computer program that changes the control of the virtual camera's operation from the second mode to the third mode.

Images