Information processing system, information processing method, and computer program
The information processing system addresses the limitation of object placement in virtual spaces by adjusting object sizes and positions, enhancing the number of objects that can be placed and utilized within the space.
Patent Information
- Application Number
- JP2024071188
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-25
- Publication Date
- 2025-11-07
AI Technical Summary
The finite size of virtual spaces limits the number and placement positions of objects due to their size constraints.
An information processing system that includes a display control unit for managing virtual spaces, an object placement unit for adjusting object sizes and positions, and an association display unit for displaying objects meeting specific size conditions, allowing for flexible placement and rearrangement of objects within the virtual space.
This system enhances the capacity to place objects in virtual spaces by optimizing their size and position, thereby increasing the utilization of available space.
Smart Images

Figure 2025166974000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing system, an information processing method, and a computer program. [Background technology]
[0002] BACKGROUND ART There is known an information processing system that generates animation of a character object based on the movement of a user and distributes a moving image including the animation of the character object (see, for example, Patent Document 1).
[0003] Furthermore, technology has been developed that provides each user with a virtual space in which objects can be placed, regardless of whether video is being distributed or not. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-184689 Summary of the Invention [Problem to be solved by the invention]
[0005] Since the size of the virtual space provided to each user is finite, there has been a problem in that the number of objects that can be placed in the virtual space and their placement positions are limited depending on the size of the virtual objects.
[0006] Therefore, it is an object of the present disclosure to provide technical improvements that solve or alleviate at least some of the problems of the prior art mentioned above.
[0007] Furthermore, one of the more specific objects of the present disclosure is to provide a technology that alleviates restrictions on the number of objects that can be placed and their placement positions in a virtual space due to their size. [Means for solving the problem]
[0008] The information processing system of the present disclosure is an information processing system including one or more computer processors, and the one or more computer processors are characterized by including a display control unit that controls the display of a video displaying a predetermined virtual space on a first display screen of a first information processing device, a reception unit that receives operations by a first user, an object placement unit that places a first object in the predetermined virtual space, and an association display unit that, when the reception unit receives a specific movement operation that moves the first object to a specific position where a specific object is placed in the predetermined virtual space, associates a second object that meets specific size conditions with the specific object and displays it.
[0009] The one or more computer processors in the present disclosure further include a generation unit that generates a second object by adjusting the size of the first object when the receiving unit receives a specific movement operation, and the associated display unit can display the second object generated by the generation unit in association with the specific object.
[0010] The one or more computer processors in the present disclosure further include an extraction unit that, when the receiving unit receives a specific movement operation, extracts a second object from pre-prepared objects, the second object differing only in size from the first object, and the associated display unit can display the second object extracted by the extraction unit in association with the specific object.
[0011] The object placement unit can release the association between the specific object and the second object in response to an operation by the first user, and place the first object again in a predetermined virtual space.
[0012] A particular object may have at least one compartment in which a second object may be placed.
[0013] The object placement unit can rearrange the second object to another section of the specific object in response to an operation by the first user.
[0014] The number of compartments that a particular object has can be increased or decreased in response to a particular operation by the first user.
[0015] The one or more computer processors in the present disclosure further include a size comparison unit that, when the receiving unit receives a specific movement operation, compares the size of the partition of the specific object with the size of the first object, and the generation unit can adjust the size of the first object to an appropriate size that fits the partition based on the result of the comparison by the size comparison unit.
[0016] When the size comparison unit determines that the size of the first object is larger than the size of the partition as a result of the comparison, the generation unit can generate a second object by reducing the size of the first object to a size that fits the partition.
[0017] When the size comparison unit determines that the size of the first object is the same as or smaller than the size of the partition as a result of the comparison, the generation unit can make the first object the second object without adjusting the size of the first object.
[0018] The receiving unit may further receive an adjustment operation on the second object by the first user, and the adjustment operation may be a size adjustment and / or an orientation adjustment of the second object.
[0019] The video further displays a first character object that is movable within a predetermined virtual space, and the one or more computer processors further: The virtual camera control unit controls the operation of a virtual camera that captures a predetermined virtual space, and the virtual camera control unit controls the operation of the virtual camera in a first mode when a movement operation for a first character object can be accepted, and in a second mode when a movement operation for the first object can be accepted.When the operation of the virtual camera is controlled in the second mode, if the accepting unit accepts a specific movement operation, the virtual camera control unit can change the control of the operation of the virtual camera from the second mode to a third mode.
[0020] The first mode can be a mode in which the operation of the virtual camera can be changed in response to an operation by the first user.
[0021] The second mode can be a mode in which a predetermined virtual space is photographed from above.
[0022] The third mode can be a mode in which a specific object is photographed from the front.
[0023] When the operation of the virtual camera is controlled in the first mode, if the reception unit receives a selection operation for a specific object placed in a specified virtual space, the virtual camera control unit can change the control of the operation of the virtual camera from the first mode to the third mode.
[0024] The one or more computer processors in the present disclosure further include an attribute determination unit that determines, in accordance with an operation by the first user, whether there is a specified relationship between an attribute set for the first object and an attribute set for a specific object, and the receiving unit can accept a specific movement operation when the attribute determination unit determines that there is a specified relationship.
[0025] The object placement unit can place a specific object in a predetermined virtual space so that it is visible or invisible to the second user, based on an operation by the first user.
[0026] The association display unit can display the second object in association with a specific object in a manner that is visible or invisible to the second user, based on an operation by the first user.
[0027] The object placement unit can place a specific object at a different position in a predetermined virtual space in response to an operation by the first user.
[0028] The object placement unit can place a first object in a predetermined virtual space based on an instruction from a second user who is different from the first user.
[0029] The information processing method of the present disclosure is characterized in that one or more computer processors execute a display control step of controlling the display of a video displaying a predetermined virtual space on a first display screen, an object placement step of placing a first object in the predetermined virtual space, a reception step of accepting an operation by a first user, a determination step of determining whether the operation accepted in the reception step is a specific movement operation that moves the first object to a specific position where a specific object is placed in the predetermined virtual space, and an associated display step of displaying a second object that satisfies specific size conditions in association with the specific object if the operation is determined to be a specific movement operation in the determination step.
[0030] The computer program of the present disclosure is characterized in that it causes one or more computer processors to realize a display control function that controls the display of a video that displays a predetermined virtual space on a first display screen, an object placement function that places a first object in the predetermined virtual space, a reception function that accepts operations by a first user, and an associated display function that, when the reception function accepts a specific movement operation that moves the first object to a specific position in the predetermined virtual space where a specific object is placed, associates and displays a second object that meets specific size conditions with the specific object. [Effects of the Invention]
[0031] The present disclosure provides technical improvements that solve or mitigate at least some of the problems of the prior art discussed above.
[0032] More specifically, according to the present disclosure, it is possible to provide a technology that can increase the number of objects that can be placed in a virtual space by effectively utilizing the space in the virtual space. [Brief explanation of the drawings]
[0033] [Figure 1] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 2] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 3] 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. [Figure 4] FIG. 2 is a configuration diagram illustrating an example of a hardware configuration of a server device, a first user terminal, and a second user terminal according to the present disclosure. [Figure 5] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 6] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 7] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 8] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 9] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 10] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 11] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 12] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 13]FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 14] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 15] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 16] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 17] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 18] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 19] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 20] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 21] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 22] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 23] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 24] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 25] FIG. 1 is a conceptual diagram illustrating an image of a virtual space described in the present disclosure. [Figure 26] FIG. 2 is a configuration diagram illustrating an example of a functional configuration of a server device according to the present disclosure. [Figure 27] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 28] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 29] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 30] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 31]FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 32] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 33] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 34] FIG. 1 is a conceptual diagram illustrating an image of a specific object in the present disclosure. [Figure 35] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 36] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 37] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 38] FIG. 10 is a conceptual diagram showing an image of a screen displayed on a user terminal. [Figure 39] FIG. 10 is a configuration diagram illustrating another example of the functional configuration of the server device according to the present disclosure. [Figure 40] FIG. 1 is a flow diagram illustrating an example of the flow of an information processing method according to the present disclosure. [Figure 41] FIG. 1 is a circuit configuration diagram showing an example of a circuit configuration for realizing a computer program according to the present disclosure. [Figure 42] FIG. 2 is a configuration diagram illustrating an example of a functional configuration of a user terminal according to the present disclosure. [Figure 43] FIG. 1 is a block diagram of processing circuitry for performing computer-based operations in the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0034] First, an overview of an information processing system according to an embodiment of the present disclosure will be described with reference to the drawings.
[0035] The information processing system in the present disclosure is an information processing system including one or more client devices and a server device, and includes one or more computer processors.
[0036] The video displayed on each client device will be described as including animation of 3D or 2D character objects generated based on the broadcaster's movements, but is not limited to this and may include animation of character objects generated in response to the broadcaster's operations, or may include an image of the broadcaster himself / herself.Furthermore, these character objects and the broadcaster may not be displayed, and only the broadcaster's voice may be included.
[0037] Here, a broadcasting user refers to a user who transmits information about video and / or audio. For example, a broadcasting user may be a user who hosts or organizes a solo video broadcast (solo broadcast), a collaborative broadcast in which multiple people can participate, a video chat or voice chat in which multiple people can participate and / or watch, or an event (such as a party) in a virtual space in which multiple people can participate and / or watch, that is, a user who mainly carries out these activities. Therefore, a broadcasting user in this disclosure may also be referred to as a user, host user, organizer user, or organizer user.
[0038] On the other hand, a viewing user refers to a user who receives information about video and / or audio. However, a viewing user can be a user who not only receives the information but also reacts to it. For example, a viewing user may be a user who watches video streaming or collaborative streaming, or a user who participates in and / or watches video chats, voice chats, or events. Therefore, viewing users in the present disclosure can also be referred to as users, guest users, participating users, listeners, spectator users, support users, etc.
[0039] Furthermore, the information processing system in an embodiment of the present disclosure can be used to provide a next-generation internet space (metaverse) in which many people can participate simultaneously in a digital world where they can interact, work, play, and engage in other activities freely through character objects (avatars) at a level similar to that of the real world, transcending the gap between reality and virtuality and enabling social activities.
[0040] In such a space, users' avatars can freely move around within the virtual world and communicate with each other.
[0041] One of the avatars in the virtual space may be configured to broadcast a video as a character object of the broadcasting user. In other words, one-to-many video broadcasting may be possible in a many-to-many metaverse virtual space.
[0042] In such a space, there is no particular distinction between broadcast users and viewing users.
[0043] The space depicted in the video may be a virtual space, a real space, or an augmented reality space that combines these. The video may be something like a karaoke video or a game commentary video that plays back at least a predetermined image and the broadcast user's voice, or may be a display in which a character object or an actual image of the broadcast user is superimposed on these.
[0044] Furthermore, if the broadcasting user is included in the real space, a character object generated based on the broadcasting user's movements may be superimposed on an actual image of the broadcasting user. Also, an animation of a gift object or the like may be superimposed on a captured image of the real space.
[0045] <System configuration> As shown as an example in FIG. 1, the information processing system 1000 according to the present disclosure may include one or more viewing user terminals 1100 and an information processing device (support computer) 1300 located in a video distribution studio or the like, which is connected to these viewing user terminals 1100 via a network 1200.
[0046] Furthermore, the information processing device 1300 may be connected to a predetermined server device via the Internet, and some or all of the processing that should be performed by the information processing device 1300 may be performed by the server device. Note that such a server device may be the information processing device 2400 shown in FIG. 2.
[0047] In this specification, such distribution by the information processing system 1000 is referred to as studio distribution.
[0048] In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.
[0049] Furthermore, the information processing system 1000 of the present invention can cooperate with another information processing system 2000 shown as an example in Fig. 2. The information processing system 2000 shown in Fig. 2 can include a broadcaster user terminal 2100, one or more viewer user terminals 2200, and an information processing device (server device) 2400 connected to the broadcaster user terminal 2100 and the viewer user terminal 2200 via a network 2300.
[0050] In the above example, the broadcaster user terminal 2100 can be an information processing terminal such as a smartphone. In this specification, broadcasting by the information processing system 2000 is referred to as mobile broadcasting.
[0051] In mobile distribution, the broadcaster user's facial movements are captured by a camera on the broadcaster user terminal 2100, and are reflected on the character's face in real time using known face tracking technology.
[0052] In mobile distribution, there is no particular distinction between distributor users and viewing users; viewing users can use mobile distribution at any time, and distributor users can become viewing users when viewing videos of other distributor users.
[0053] The moving images generated by the information processing system 1000 and the information processing system 2000 can be distributed to viewing users from one moving image distribution platform, for example.
[0054] In addition, in any distribution, the process of generating animation by reflecting motion on a character and the process of displaying gifts, which will be described later, may be shared and performed by the distribution user terminal, the viewing user terminal, the information processing device, and other devices.
[0055] In other words, "distribution" here refers to sending information that enables the video to be viewed on the viewing user's terminal, and the rendering of the video may be performed on the information processing device 1300, 2400 side, or on the distribution user terminal 2100 or viewing user terminal 1100, 2200 side.
[0056] Specifically, facial motion data and voice data of the broadcasting user are transmitted from the broadcasting user terminal or information processing device to a terminal or device that generates (renders) animation of the character object. Body motion may also be transmitted in addition to facial motion.
[0057] In the present disclosure, the process of generating animation will be described as being performed by each of the broadcasting user terminal and the viewing user terminal, but this is not limited to this.
[0058] The information processing system according to the present disclosure can be applied to either of the examples shown in Fig. 1 and Fig. 2. Therefore, an information processing system 3000 according to an embodiment of the present disclosure will be described as including a first user terminal 100, a second user terminal 200, and a server device 400 connectable to the first user terminal 100 and the second user terminal 200 via a network 300, as shown in Fig. 3.
[0059] The first user terminal 100 and the second user terminal 200 are connected to the server device 400 via, for example, a base station, a mobile communication network, a gateway, and the Internet. Communication between the first user terminal 100, the second user terminal 200, and the server device 400 is performed based on a communication protocol such as Hypertext Transfer Protocol (HTTP). Alternatively, a connection may be established between the first user terminal 100, the second user terminal 200, and the server device 400 initially via HTTP communication, and thereafter communication may be performed based on WebSocket, which provides bidirectional communication with lower costs (lower communication loads and processing loads) than HTTP communication. Note that the communication method between the first user terminal 100, the second user terminal 200, and the server device 400 is not limited to the above-described method, and any communication method technology may be used as long as it can realize this embodiment.
[0060] The first user terminal 100 functions at least as the above-mentioned information processing device 1300, viewing user terminal 1100, broadcasting user terminal 2100 or viewing user terminal 2200, the second user terminal 200 functions at least as the above-mentioned information processing device 1300, viewing user terminal 1100, broadcasting user terminal 2100 or viewing user terminal 2200, and the server device 400 functions at least as the above-mentioned specified server device or information processing device 2400.
[0061] In the present disclosure, the first user terminal 100 and the second user terminal 200 may be a smartphone (multifunction phone terminal), a tablet terminal, a personal computer, a console game machine, a head-mounted display (HMD), a wearable computer such as an eyeglass-type wearable terminal (AR glasses, etc.), or an information processing device other than these devices that can play videos. Furthermore, these terminals may be standalone devices that operate independently, or may be composed of multiple devices connected to each other so that various data can be transmitted and received.
[0062] <Hardware configuration> 4, the hardware configuration of the first user terminal 100 will be described. The first user terminal 100 includes a processor 101, a memory 102, a storage 103, an input / output interface (input / output I / F) 104, and a communication interface (communication I / F) 105. The components are connected to each other via a bus B.
[0063] The first user terminal 100 can realize the functions and methods described in this embodiment through cooperation between the processor 101, memory 102, storage 103, input / output I / F 104, and communication I / F 105.
[0064] The processor 101 executes functions and / or methods implemented by codes or instructions included in a program stored in the storage 103. The processor 101 may include, for example, a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may implement each process disclosed in each embodiment using a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large-scale integration (LSI)), etc. Furthermore, these circuits may be implemented using one or more integrated circuits, and multiple processes described in each embodiment may be implemented using a single integrated circuit. Furthermore, an LSI may also be referred to as a VLSI, a super LSI, an ultra LSI, etc. depending on the degree of integration.
[0065] The memory 102 temporarily stores programs loaded from the storage 103 and provides a working area for the processor 101. The memory 102 also temporarily stores various data generated while the processor 101 is executing the programs. The memory 102 includes, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.
[0066] The storage 103 stores programs and includes, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, and the like.
[0067] The communication I / F 105 is implemented as hardware such as a network adapter, communication software, or a combination thereof, and transmits and receives various data via the network 300. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication is possible. The communication I / F 105 communicates with other information processing devices via the network 300. The communication I / F 105 transmits various data to other information processing devices in accordance with instructions from the processor 101. The communication I / F 105 also receives various data transmitted from other information processing devices and transmits the data to the processor 101.
[0068] The input / output I / F 104 includes an input device for inputting various operations to the first user terminal 100, and an output device for outputting processing results processed by the first user terminal 100. The input / output I / F 104 may be an integrated input device and output device, or may be separate input device and output device.
[0069] The input device is realized by any one or combination of all types of devices that can receive input from a user and transmit information related to the input to the processor 101. Examples of the input device include hardware keys such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (for inputting operations via images), and a microphone (for inputting operations via voice).
[0070] The input device may include a sensor unit. The sensor unit includes one or more sensors that detect facial motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body relative to the sensor unit. Facial motions include blinking, opening and closing of the mouth, and other movements. A known sensor unit may be used. One example of the sensor unit includes a ToF sensor that measures the time of flight (TOF) of light irradiated toward the user and reflected from the user's face, a camera that captures the user's face, and an image processing unit that processes the data captured by the camera. The sensor unit may also include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. The RGB camera and the near-infrared camera may be, for example, the True Depth sensor in the iPhone X (registered trademark), the LiDAR sensor in the iPad Pro (registered trademark), or other ToF sensors installed in smartphones. Specifically, this camera uses a dot projector to project tens of thousands of invisible dots onto the user's face, etc. The sensor unit then detects and analyzes the reflected light from the dot pattern to form a depth map of the face, and captures an infrared image of the face, etc., thereby capturing accurate facial data. The sensor unit's processing unit generates various information based on the depth map and the infrared image, and compares this information with registered reference data to calculate the depth of each point on the face (the distance between each point and the near-infrared camera) and positional deviations other than depth.
[0071] The sensor unit may also have a function of tracking not only the user's face but also their hands (hand tracking). The sensor unit may further include sensors other than the above-mentioned sensors, such as an acceleration sensor or a gyro sensor. The sensor unit may have a spatial mapping function of recognizing objects in the real space where the user exists based on the detection results of the above-mentioned ToF sensor or other known sensors, and mapping the recognized objects on a spatial map. Hereinafter, when face motion detection data and body motion detection data are described without any particular distinction, they will simply be referred to as "tracking data." The image processing unit of the sensor unit may be included in a control unit that can be included in the information processing system of the present invention.
[0072] The operation unit serving as an input device can be one that corresponds to the type of user terminal. Examples of the operation unit include a touch panel integrated with a display, operation buttons provided on the housing of the user terminal, a keyboard, a mouse, and a controller operated by the user's hand. The controller may incorporate various known sensors, such as an acceleration sensor, a gyroscope, or an inertial measurement unit (IMU). Another example of the operation unit may be a tracking device that identifies the user's hand movements, eye movements, head movements, and gaze direction. In this embodiment, for example, the user's instructions can be determined based on the user's hand movements, and various operations can be performed, such as starting or ending video distribution, rating a message or video, or requesting the display of a predetermined object (e.g., a gift, as described below). Note that if the sensor unit also has an input interface function, such as a hand truck function, the operation unit can be omitted.
[0073] The output device outputs the processing results obtained by the processor 101. The output device includes, for example, a touch panel, a speaker, and the like.
[0074] It should be noted that the functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. A processor may also be a programmed processor that executes a program stored in a memory.
[0075] In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions.
[0076] If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.
[0077] Furthermore, the second user terminal 200 and the server device 400 in the present disclosure can also be configured with the same hardware configuration as that shown in FIG. 4, unless otherwise noted.
[0078] Next, various functions that can be executed on a user terminal that has launched an application realized by the information processing system according to an embodiment of the present disclosure, and transitions of displayed screens will be described with reference to the drawings.
[0079] FIG. 5 shows the top screen T10 that is displayed on the user terminal (it is not yet specified here whether the user will be viewing / distributing) when a video distribution / viewing application is launched.
[0080] As shown in Figure 5, a user can watch a video being played on a distribution channel by selecting one of the thumbnail images of one or more distribution channels T12 (also called a distribution slot, distribution program, distribution video, etc.) from among the thumbnail images of one or more distribution channels T12 proposed on the top screen T10, which can be switched using each tab T11, T14-17.
[0081] Alternatively, a user can view a video played on a specific distribution channel by accessing a fixed link for the specific distribution channel. Such a fixed link can be obtained through a notification from a first user who the user is following, a share notification sent by another user, or the like.
[0082] Here, the user who watches the video is the viewing user, and the terminal that watches the video is the second user terminal 200.
[0083] 5, the top screen T10 may display a display field T13 for announcements such as campaigns and events. This announcement display field T13 can be switched to display other announcements by sliding the display field.
[0084] The top screen T10 displays a recommendation tab T11, a follow tab T14, a game tab T15 for displaying game categories, a collaboration waiting tab T16 for displaying distribution channels waiting for collaboration, and a beginner tab T17 for displaying distribution channels for beginners. By selecting these (by switching tabs), the top screen T10 transitions to each of the different screens.
[0085] The service name display T18 and search button T19 in the upper frame of the top screen T10 may remain fixed and displayed on the transition destination screen.
[0086] Similarly, the home button T20, chat button T21, distribution preparation button T22, gacha / shop button T23, and profile button T24 in the bottom frame of the top screen T10 may also be fixed and remain displayed on the screen to which the transition is made.
[0087] On the top screen T10 shown in Figure 5, for example, a user who selects a displayed thumbnail image T12 can become a viewing user (second user) who watches the video as described above, and a user who selects the distribution preparation button T22 can become a distribution user (first user) who distributes the video.
[0088] As an example, when the distribution preparation button T22 is selected on the top screen T10 shown in Fig. 5, the screen transitions to the avatar setting screen D10 shown in Fig. 6. Then, when the distribution button D11 is selected on the avatar setting screen D10, the screen transitions to the distribution setting screen D20 shown in Fig. 7. Then, when the distribution start button D21 is selected on the distribution setting screen D20, the screen transitions to the avatar distribution screen D30 shown in Fig. 8.
[0089] Next, we will explain the details of the flow up to the start of video distribution.
[0090] The one or more computer processors in the present disclosure may include a distribution start request receiving unit, a distribution setting unit, and a distribution start unit.
[0091] The distribution start request receiving unit receives a request to start distribution of a first moving image including animation of a character object from a first user terminal of a first user.
[0092] Here, the first moving image refers to a moving image including animation of a character object. In this specification, a character object may also be called an "avatar."
[0093] The distribution start request can be transmitted from the user terminal (later to become the first user terminal) to the server device 400 by selecting a distribution button D11 located on an avatar setting screen D10 or the like, which is transitioned from the top screen described above, displayed on the user terminal that has launched a dedicated application (video distribution / viewing application) for accessing the video distribution platform.
[0094] 6 shows an example of an avatar setting screen D10. The avatar setting screen D10 can display a character object CO, a distribution button D11, a room button D12, a change of clothes button D13, a photo button D14, and the like.
[0095] When the user selects the change clothes button D13, a closet screen appears for selecting various avatar parts such as eyes, nose, mouth, hair, accessories, clothes, and background for the character object CO. The closet screen also displays a button for transitioning to a lottery screen for obtaining avatar parts.
[0096] When the user selects the room button D12, a screen of the user's room (a first virtual space, which will be described later) is displayed. Details of the room screen will be described later.
[0097] When the user selects the photo button D14, a photography screen for taking a still image of the character object appears.
[0098] When the user selects the distribution button D11, a distribution start request is sent to the server device 400.
[0099] The distribution setting unit sets distribution settings for the first moving image based on instructions from the first user terminal 100 in response to the distribution start request for the first moving image received by the distribution start request receiving unit.
[0100] As an example, when the distribution button D11 is selected, the screen displayed on the first user terminal 100 transitions from the avatar setting screen D10 shown in FIG. 6 to the distribution setting screen D20 shown in FIG.
[0101] The distribution settings can include at least one of settings related to the distribution location, settings related to collaboration, settings related to the distribution topic, settings related to the public range, and settings related to the title.
[0102] These distribution settings can be set in the distribution location setting button D22, collaboration setting button D23, distribution topic setting button D24, disclosure range setting button D25, and title setting field D26 in FIG. 7, respectively.
[0103] When the distribution location setting button D22 is selected, a distribution location setting screen D29 is displayed, which displays a booth distribution object D27 for selecting a booth distribution and a room distribution object D28 for selecting a room distribution, as shown in Fig. 9, and the user can select a booth or a room as the distribution location. Details of the booth and room will be described later.
[0104] The title of the first moving image that can be set in the title setting field D26 can be freely determined by the distributor user within the range of the maximum number of characters allowed.
[0105] The first user can freely decide whether or not other users can appear in the first video, which can be set by selecting the collaboration setting button D23. If yes, other users can make an appearance request to the distribution user, and if no, other users cannot make an appearance request to the distribution user. The state in which other users appear in the first user's video is sometimes referred to as "collaboration" in this specification. Details of collaboration will be described later.
[0106] The number of people who can appear in the first video can only be set if other users are allowed to appear in the first video as described above, and can be freely determined by the distribution user within the range of the maximum number of people allowed.
[0107] The password can be set arbitrarily only if other users are allowed to appear in the first video, and the distributor can freely set a number with a specified number of digits. When other users request to appear in the first video, they are required to enter the password. Note that the password setting field may be configured to be active only when the collaboration setting for anyone is OFF.
[0108] The distribution starting unit distributes information about the first moving image to the second user terminal 200 of the viewing user based on the conditions set by the distribution setting unit.
[0109] Such a distribution start instruction is sent by selecting the distribution start button D21 shown in Fig. 7. The distribution start button D21 may be configured to become active only when the title of the video has been set.
[0110] As an example, the distribution starting unit distributes information about a moving image (first moving image) including animation of a character object of the first user to the second user terminal 200 of the second user (avatar distribution).
[0111] The information about the first video includes, for example, motion information indicating the movement of the character object, voice information of the first user, gift object information indicating gifts sent by other viewing users, etc. The gift object information includes at least gift object identification information that identifies the type of gift object and position information that indicates the position where the gift object is displayed.
[0112] The distribution starting unit can then live-distribute the video via the video distribution platform described above.
[0113] FIG. 8 shows an avatar distribution screen D30 displayed on the first user terminal 100.
[0114] The avatar distribution screen D30 displays a character object CO, as well as a comment input button D31 for the distribution user to enter a comment, a photo button D32 for saving a still image of the screen, a start play button D33 for playing the game described below, an external service linkage button D34 for watching videos provided by an external service, and a gacha button D62 for obtaining avatar parts.
[0115] Also, at the top of the avatar distribution screen D30, a cumulative viewer count display D35, a cumulative like count display D36, a collaborator count display D37, a share button D38 for external SNS, a guest details button D39, a ranking display button D40, a settings button D41, and an audio switch button D42 for switching audio on / off can be displayed. An end button D43 for ending the distribution is also displayed.
[0116] Detailed description of these displays and buttons will be omitted, but by selecting the setting button D41, it is possible to change the distribution settings made on the distribution setting screen D20.
[0117] 8 shows an example in which distribution has been started on distribution setting screen D20 with other users allowed to appear in the first video and the maximum number of people who can appear in the first video set to three, so character object CO is displayed in a position shifted to the bottom left. Up to three character objects of other users can appear in the empty space.
[0118] This concludes the description of the screen transitions when delivering an avatar according to the invention of the present disclosure.
[0119] Next, the screen transitions that occur when a broadcaster user plays a game during broadcasting will be described.
[0120] The one or more computer processors in the present disclosure may include a game request receiving unit, a game video distribution unit, and a game display processing unit.
[0121] During avatar distribution as shown in FIG. 8, the broadcasting user can request to start playing the game by selecting the start play button D33.
[0122] Note that the game displayed upon selection of the start play button D33 is a dedicated game implemented in an application realized by the information processing system of the present disclosure, and may be different from general-purpose games provided by external services. Therefore, game distribution in the present disclosure may be distinguished from distribution of gameplay videos of general-purpose games provided by external services along with commentary by the distributor user.
[0123] Alternatively, the request to start playing can be sent from the first user terminal 100 to the server device 400 by selecting a start play button located on a specified screen displayed on the first user terminal 100 of the first user.
[0124] Fig. 10 shows an example of a screen G10 on which a play start button G11 is arranged as the predetermined screen. The screen G10 shown in Fig. 10 is a screen transitioned to by selecting a game tab T15 from a top screen T10 (Fig. 5) displayed on a user terminal that has started an application realized by the information processing system of the present disclosure.
[0125] The screen G10 displays at least a play start button G11 that can send a request to start playing a predetermined game.
[0126] Then, when the game request receiving unit receives a request to start playing a predetermined game, the game moving image distribution unit distributes information about the second moving image to the second user terminal 200.
[0127] Here, the second video is a video of a game being played. In this specification, the delivery of such a video so that it is displayed on the screen of the second user terminal 200 is referred to as "game delivery."
[0128] Furthermore, after launching the application realized by the invention of the present disclosure, the user can, as the first user, send a request to start distribution of the second video to the information processing device 2400 by selecting a play start object placed on the game list screen and the game details screen.
[0129] The game list screen or game details screen is the first screen, which will be described in detail next.
[0130] That is, the game display processing unit performs display processing of a first screen including a distribution start object capable of sending a distribution start request, a play start object capable of sending a request to start playing a specified game, and a thumbnail image of a video of a gameplay video of a specified game currently being distributed.
[0131] 10 corresponds to the game list screen of the first screen. The first screen, which is the game list screen, is a screen transitioned to by selecting the game tab T15 from the top screen T10.
[0132] The first screen includes a distribution preparation button T22 as a distribution start object, a play start button G11 as a play start object, and thumbnail images indicating distribution channels for the video.
[0133] The first screen displays, for each of the multiple playable games, a start play button G11, a game icon G12, the game name G13, the total number of viewers of the game's distribution channel G14, and a distribution list G15 including thumbnail images of the distribution channels currently distributing the game.
[0134] The order of thumbnail images displayed in the distribution list G15 can be different for each viewing user. As an example, the order is arranged in descending order of priority, such as the number of views by the viewing user who follows the images, the cumulative number of viewers, or the oldest distribution start date. The display range of the thumbnail images in this distribution list G15 can be changed by scrolling horizontally.
[0135] The games displayed on this game list screen are the top 10 titles with the following priorities: For example, the priorities are determined by the most recent date the viewing user last played within 48 hours of the game distribution start date and time within the last 30 days, the highest priority period ID, and the lowest priority period ID.
[0136] This distribution list G15 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.
[0137] 11 corresponds to the game details screen of the first screen. The first screen, which is the game details screen, is G20, which is the screen transitioned to by selecting the game icon G12 or game name G13 displayed on the game list screen shown in FIG.
[0138] The first screen includes a distribution preparation button T22 which is a distribution start object, a play start button G21 which is a play start object, and thumbnail images which indicate distribution channels for the video.
[0139] The first screen also displays a game icon G22, a game name G23, the total number of viewers of the game's distribution channel G24, and a distribution list G25 including thumbnail images of distribution channels currently distributing the game.
[0140] The order of thumbnail images displayed in the distribution list G25 can be different for each viewing user. For example, the order is arranged in descending order of priority, such as the number of views by the viewing user who follows the images, the number of cumulative viewers, or the oldest distribution start date. The display range of the thumbnail images in this distribution list G25 can be changed by vertical scrolling.
[0141] This distribution list G25 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.
[0142] As described above, a user who selects the distribution start object (distribution preparation button T22) or the play start object (play start button G11, G21) becomes the first user who makes a distribution start request or a play start request.
[0143] Furthermore, the user who selects the thumbnail image becomes the second user who views the second moving image.
[0144] The first screen also includes a first area where scrolling is not possible and a second area where scrolling is possible.
[0145] The first screen here refers to the first screen shown in Fig. 11. The first screen includes a first area R1 and a second area R2. Specifically, the first area R1 displays the game title, and the second area R2 displays the above-mentioned start play button G21, game icon G22, game name G23, viewer count G24, and distribution list G25.
[0146] The first area R1 is a fixed area on the display screen that cannot be scrolled, while the second area R2 is an area that can be scrolled by the user. By scrolling the second area R2, the user can view thumbnail images that are hidden off-screen.
[0147] However, since there is a risk that the play start button G21 will be hidden off the screen when the second area is scrolled, the display processing unit in the present disclosure can display the play start object (play start button G21) in the first area R1 depending on the display state of the play start object (play start button G21) displayed in the second area R2.
[0148] As an example, the play start button G21 is displayed in the second area R2 in Fig. 11, but is displayed in the first area R1 in Fig. 12. In other words, when part or all of the play start button G21 is no longer displayed in the second area R2, the play start button G21 appears in the first area.
[0149] The game display processing unit may also display the play start object in the first area R1 in stages according to the display state of the play start object displayed in the second area R2.
[0150] Such an expression can be realized by changing the transparency of the play start object in accordance with the amount of scrolling of the second region R2.
[0151] As an example, the scroll amount (unit: pixels) 0 to 50 corresponds to the button transparency from 0.0 (completely transparent) to 1.0 (completely opaque). In this case, the object is completely transparent in the initial display state and is therefore invisible, but when scrolled 50 pixels or more, the object becomes completely visible. It is preferable to change the object's transparency linearly in this range (0 to 50). Note that the unit of the scroll amount is logical pixels, which may differ from the actual pixels on the display.
[0152] Furthermore, the game request receiving unit is capable of receiving a request to end play of a predetermined game from the first user terminal 100 after the game video distribution unit has distributed information about the second video.
[0153] A request to end play can be sent by selecting the end button located on the game screen.
[0154] Then, when the game request receiving unit receives a request to end play of a predetermined game, the distribution starting unit can end the distribution of information about the second moving image and distribute information about the first moving image.
[0155] In other words, what is distributed here is not just a portion of the information about the first moving image, but the entire information about the first moving image.
[0156] Then, when the distribution starting unit finishes distributing information about the second moving image and distributes information about the first moving image, it is assumed that the first moving image is displayed on the second user terminal 200.
[0157] Next, the flow for starting to watch a video will be explained.
[0158] The one or more computer processors in the present disclosure may further include a viewing acceptance unit.
[0159] The viewing acceptance unit accepts a request to view a video from a user.
[0160] In response to a viewing request, the distribution starting unit distributes information relating to video and audio as moving image information to the information processing terminal of the user.
[0161] FIG. 13 shows an example of a viewing screen V10 of an avatar video displayed on the second user terminal 200.
[0162] A viewing user can post a comment by entering text in a comment input field V11 and pressing a send button V12.
[0163] Furthermore, by pressing the gift button V13, a list of gifts (screen V30 in FIG. 14) is displayed to the viewing user, and a display request for a specified gift can be sent by selection.
[0164] In this case, one or more computer processors in the present disclosure may include a determination unit that determines whether or not a gift display request has been made from the second user terminal 200.
[0165] The display request may include gift object information, which includes at least gift object identification information that identifies the type of the gift object and location information that indicates the location where the gift object is to be displayed.
[0166] As shown in FIG. 15, gifts can be displayed by classification (free (paid) gifts, accessories, support goods, appeals, variety, etc.).
[0167] Here, a paid gift is a gift (coin gift) that can be purchased by consuming coins purchased by the viewing user, and a free gift is a gift (point gift) that can be obtained by consuming points obtained for free or without consuming them.
[0168] It should be noted that the term "gift" used in this application has the same concept as the term "token." Therefore, the technology described in this application can be understood by replacing the term "gift" with the term "token."
[0169] Furthermore, the viewing user can post a favorable evaluation by pressing the like button V14. Note that in addition to / instead of the like button V14, it is also possible to display a button for posting a negative evaluation or other emotions.
[0170] Note that an object may be displayed on the video in response to such a rating post. For example, when a positive rating is posted, an object such as a heart mark or a thumbs-up mark may be displayed.
[0171] In addition, if the first user has set the permission for other users to appear in the video in the distribution settings, the first user can send a request to appear in the video by selecting the collaboration request button V15.
[0172] Additionally, a follow button V16 is displayed on the screen of a video distributed by a first user who is not yet followed by a second user, allowing the second user to follow the distributor. This follow button functions as an unfollow button on the screen of a video distributed by a first user who is already being followed by the second user.
[0173] This "following" may be from a second user to another second user, from a first user to a second user, or from a first user to another first user. However, following is managed as a one-way association, and associations in the reverse direction are managed separately as followers.
[0174] A photo button V25 for saving a still image of the screen may also be displayed.
[0175] Additionally, the viewing screen V10 also displays a support ranking display button V17, a share button V18, and a ranking display button V19.
[0176] The support ranking displays the ranking of second users who are supporting the first user, and the ranking can be calculated according to the amount of the gift (points / coins), etc.
[0177] Regarding sharing the video, the second user can press the share button V18 to check the list of SNS (social networking services) on which the video can be shared, and by selecting it, send a fixed link to a specified location on the specified SNS.
[0178] In addition, by pressing the collaboration request button V15, a collaboration broadcast can be requested from the first user. Collaborative broadcasting refers to having a character object of the second user appear in the video broadcast by the first user.
[0179] At the top of the viewing screen V10, a broadcasting user icon V21, a broadcasting user name (character object name) V22, a cumulative viewer count display V23, and a cumulative like count display V24 can be displayed.
[0180] Furthermore, when the viewing end button V20 is selected, a screen for ending viewing appears, allowing a viewing end request to be sent.
[0181] The screen for ending such viewing will be explained in detail below. This screen is called "small window audio distribution" and is used for viewing in a mode where only the audio is played back without displaying the video image.
[0182] Selection of the above-mentioned viewing end button V20 is accepted by the viewing acceptance unit as a request to end viewing of the video.
[0183] At this time, the distribution starting unit ends the distribution of information relating to the video in response to the viewing end request, but does not end the distribution of information relating to the audio.
[0184] When information about video and audio is distributed to the user terminal, the video is displayed on the main screen of the user terminal, and when information about audio only is distributed, the video is not displayed on the user terminal but a sub-screen indicating that a video is being viewed is displayed.
[0185] FIG. 15 shows an image of the screen V50 on which the sub-screen V51 is displayed.
[0186] When this sub-screen V51 is displayed, the main screen displayed in the background transitions to the screen before watching the video. For example, if you move from the recommendation tab to the viewing frame, it will return to the recommendation tab display, and if you move from the follow tab to the viewing frame, it will transition to the follow tab.
[0187] When this sub-screen V51 is displayed, operations on the main screen are possible, and transitions to other screens are possible.
[0188] The sub-screen V51 displays a profile picture, name, title, and an audio icon that visually indicates that audio is being played.
[0189] Then, by selecting the end icon V52 displayed on the sub-screen V51, the viewing can be completely ended.
[0190] Regarding the termination of the video display, the server device may transmit information but not display it on the terminal side, or the server device may stop transmitting information altogether.
[0191] With this configuration, it becomes possible to search for other broadcasts and enjoy chatting with other users while listening to only the audio.
[0192] Next, we will explain "collaboration," in which another user appears in a video of a first user.
[0193] As described above, the second user can transmit a request to participate in the video via the collaboration distribution participation request confirmation screen that is displayed by pressing the collaboration request button V15 shown in FIG.
[0194] In accordance with the received participation request, the collaboration avatar display unit included in one or more computer processors in the present disclosure displays, in a video, a character object generated based on the movement of the viewing user who has made the participation request.
[0195] 16 shows an example of a viewing or distribution screen in which a second avatar CO4, a character object of a guest user, is participating in a video in which a first avatar CO3, a character object of a host user, is displayed. Note that in FIG. 15, the display of objects other than the avatars is omitted.
[0196] Furthermore, as shown in Fig. 17, a third avatar CO1, which is a character object generated based on the movements of another viewing user, may also participate in the video. Note that in Fig. 17, the third avatar CO1 is placed behind the avatar A2 of the first avatars CO3 and CO4, but the three may also be placed in a horizontal line. The placement position of the avatar may also be specified by the distribution user.
[0197] Fig. 18 shows a list screen T30 of users who have mutual follow relationships, which is displayed by selecting the follow tab T14 on the top screen shown in Fig. 5. Mutual follow refers to a relationship in which two users follow each other.
[0198] This list screen T30 displays the profile images and names of users with whom a user has a mutual follow relationship.
[0199] 18, the list screen T30 displays a first object T31 for each user who has a mutual follow relationship. A chat object T32 may also be displayed together with the first object T31. By selecting this chat object, the user can transition to an individual chat screen with the second user.
[0200] The first object T31 transmits a predetermined notification to the terminal of the user associated with the first object T31.
[0201] The predetermined notification may be, for example, a call notification.
[0202] Next, a detailed description will be given of a flow for performing a video chat according to an embodiment of the present disclosure.
[0203] As an example, users can conduct video chats from individual chat screens or group chat screens.
[0204] These chat screens can be transitioned from the chat list screen C10 (FIG. 19) that is expanded by selecting the message button T21 on the top screen T10 (FIG. 5), for example.
[0205] 19, icons of users (character objects) or groups who have sent and / or received messages (chats) in the past are displayed together with their names or titles. Note that the group icons may include icons of users (character objects) who will join the group.
[0206] The user can then select a user or group on the chat list screen C10, open the personal chat screen C20 (FIG. 20) or the group chat screen, and start a video chat by selecting the video chat button C21.
[0207] In addition, by selecting the edit button C11 on the chat list screen C10 and then selecting the chat creation button C12 or group creation button C13 (Figure 21), a chat screen for a user or group that is not displayed on the chat list screen C10 can be created.
[0208] 22 shows the user selection screen C30 that appears when the chat creation button C12 is selected, and displays / generates a chat screen with the displayed recommended users or users searched for using the search field C31. The configuration of the generated chat screen is the same as the chat screen C20 shown in FIG. 20, and a video chat can be started by selecting the video chat button C21.
[0209] Similarly, Figure 23 shows the group creation screen C40 that opens when the group creation button C13 is selected. The user can add other users as group members by selecting the user addition button C41. As an example, the number of group members that can be added is up to seven. The group name can also be set on this screen.
[0210] Once a group is created, a group chat screen C50 is displayed (FIG. 24). On the group chat screen C50, a video chat can also be started by selecting the video chat button C51.
[0211] The chat screen C20 can also be transitioned to from the chat object T32 on the follow list screen T30 (FIG. 18).
[0212] Chat icons can also be placed on other users' profile pages, allowing users to transition from various pages to the chat screen and start a video chat.
[0213] When a video chat is started, a notification is sent to the other party, who can join the video chat by responding to the notification. Users can set whether or not to receive such notifications.
[0214] Alternatively, a configuration may be adopted in which only video chats can be conducted with users in a mutual follow relationship. In this case, an icon indicating that a user in a mutual follow relationship is currently video chatting with another user may be displayed on the follow list screen, and a user may be able to participate in the ongoing video chat by selecting the icon.
[0215] The video chat in the present disclosure can be said to be a function that allows only specific users to view the above-mentioned collaborative distribution. The specific users here refer to users who are participating in the video chat.
[0216] Next, an image of the expansion of the virtual space in this disclosure will be described with reference to FIG.
[0217] As shown as an example in Figure 25, the virtual space in this embodiment is arranged with a disk-shaped island (world) floating in the air. This island is an object that resembles an upside-down tower-shaped cake, and various objects can be arranged on the disk-shaped ground. Note that this island and ground are shown as examples, and their display modes are not particularly limited.
[0218] The objects that can be displayed include at least the first user's character object CO, a gift object G1 corresponding to a gift requested for display by the second user, and an object S1 whose display position and display timing are controlled by the server device 400 (system side).
[0219] A user can operate a character object to move, jump, and so on within the world, and such a function can be provided as one of the games described above, for example. In this disclosure, this is specifically referred to as "world distribution," and the above-described game distribution start and end procedures apply.
[0220] Specifically, switching from normal streaming (avatar streaming) to world streaming can be done by selecting the play button D33 (Figure 8) of the game displayed in the avatar streaming video, or by selecting the play button G11, G21 (Figures 10, 11) of one of the games selected from the list of games displayed on the screen to which you are transitioned by selecting the play button D33.
[0221] Additionally, switching from world streaming to avatar streaming can be done by selecting the end play button displayed on the world streaming video.
[0222] Next, various functions that can be executed in the information processing system 3000 according to the embodiment of the present disclosure will be described with reference to the drawings.
[0223] The information processing system 3000 according to the embodiment of the present disclosure includes a first user terminal 100 (first information processing device 100) of a first user and a server device 400.
[0224] The one or more computer processors included in the information processing system 3000 include a display control unit 410, a reception unit 420, an object placement unit 430, and an association display unit 440, as shown as an example in FIG.
[0225] The display control unit 410 controls the display of a video that displays a predetermined virtual space on the first display screen.
[0226] As an example, the first display screen is a display provided in the first information processing device 100 that can be operated by the first user.
[0227] Then, display control unit 410 controls the display of the video on at least the first display screen.
[0228] In this case, the display control unit 410 may be provided in one or more computer processors provided in the server device 400 or the first information processing device 100.
[0229] Furthermore, the display control unit 410 may control the display of moving images on the second display screen of the second information processing device 200 of the second user.
[0230] In this case, the display control unit 410 may be provided in one or more computer processors provided in the server device 400.
[0231] The display control unit 410 controls the display of the video, so that the video can be viewed on the first information processing device 100 and the second information processing device 200.
[0232] That is, the video may be displayable only on the first information processing device 100, or may be displayable on both the first information processing device 100 and the second information processing device 200.
[0233] In the former case, for example, the first user is a non-distribution user who is not distributing videos but is using the system of the present invention, and in the latter case, the first user is a distribution user who is currently distributing videos.
[0234] Here, the predetermined virtual space may be a first virtual space associated with a first user.
[0235] This first virtual space is a space in which objects such as furniture and ornaments (hereinafter referred to as "furniture objects") can be placed, and can be a virtual space that imitates indoor spaces (for example, rooms, houses, shops, facilities, etc.) or outdoor spaces (for example, gardens, cities, the sky, underwater, and space, etc.).
[0236] The size of the first virtual space can be defined as the volume of the first virtual space, which is a three-dimensional space, or as the area of the first virtual space in a plan view.
[0237] The size of the first virtual space may be determined for each user or may be common to all users.
[0238] In addition, the size of the first virtual space can be expanded depending on the user's achievements regarding video distribution behavior, video viewing behavior, and / or actions on videos (such as posting gifts or favorable reviews (likes)) in the system, performance in games provided by the system, and / or billing status for the system.
[0239] Here, the furniture object is not particularly limited in shape, function, etc., as long as it can be placed in a predetermined virtual space by selection by the first user or another user, or by the system (administrator).
[0240] Furniture objects may be objects that resemble, for example, shelves, desks, tables, chairs, sofas, beds, wallpaper, background screens, flooring, rugs, windows, plants, posters, clocks, musical instruments, food and drink, electrical appliances, clothing, vehicles, mannequins, etc.
[0241] The first user can obtain these furniture objects as prizes in lotteries, purchases from shops, rewards for playing games, transfers from other users, and rewards for fulfilling certain conditions related to videos or games.
[0242] In this specification, the first virtual space is referred to as a "room."
[0243] When the first user selects "room" as the distribution location on the distribution location setting screen D29 shown in Figure 9 (when the room distribution object D28 is selected), the first user's first character object CO is displayed movably in the first virtual space as shown in Figure 27, and video distribution begins.
[0244] In this specification, the distribution of video in the first virtual space is referred to as "room distribution."
[0245] On the other hand, the first user is also associated with a second virtual space as a virtual space in which the first character object cannot move.
[0246] This second virtual space can be a space in which only furniture objects such as wallpaper and floor paper can be placed (selected), or a space made up of objects such as wallpaper and floor paper.
[0247] In this specification, the second virtual space is referred to as a "booth."
[0248] When the first user selects "booth" as the distribution location on the distribution location setting screen D29 shown in Figure 9 (when the booth distribution object D27 is selected), the first character object is displayed immovably in the second virtual space as shown in Figure 28, and video distribution begins.
[0249] In this specification, the distribution of video in the second virtual space is referred to as "booth distribution."
[0250] The first virtual space and the second virtual space may be separate virtual spaces, or the second virtual space may be provided as part of the first virtual space.
[0251] FIG. 29 shows an example in which a background screen and floor paper (rug) objects are placed in the first virtual space to form a second virtual space.
[0252] By placing the first character object CO in front of and / or above these objects and adjusting the angle of view of the virtual camera, it is possible to shoot a video in which the first character object CO is performing a "booth broadcast" even during a "room broadcast."
[0253] Also, when the first user selects the room button D12 on the avatar setting screen D10 shown in FIG. 6, the first character object CO is displayed movable in the first virtual space as shown in FIG. 27, but no video is distributed.
[0254] In this way, the first virtual space is assumed to have a non-distribution state and a distribution state.
[0255] The first user can then rearrange (rearrange) the furniture objects in either state of the first virtual space.
[0256] Furthermore, while room streaming and booth streaming are being performed, video and various pieces of information are displayed superimposed on the video on the first display screen.
[0257] As examples of information that may be displayed on the first display screen D50 while room streaming and booth streaming are being performed, Figures 27 and 28 show a comment input button D51, an audio switching button D52, a photo button D53, a switching button (switching object) D54, and a menu button D55.
[0258] Similarly, as examples of information displayed on the first display screen D50 while room streaming and booth streaming are taking place, Figures 27 and 28 show the profile icon D56, name D57, cumulative viewer count display D58, and cumulative like count display D59 of the first character object.
[0259] The comment input button D51, audio switch button D52, and photo button D53 correspond to the comment input button D31, audio switch button D42, and photo button D32 shown in Figure 8, which is an example of the first display screen during booth distribution, and provide similar functions.
[0260] Furthermore, when the user selects the menu button D55 on the screen in Fig. 27 during room distribution, a menu screen D60 such as that shown in Fig. 30 is displayed. On the menu screen D60, for example, an event button D61, a gacha button D62, a coordinate button D63, a rearrange button D64, a world button D65, a booth switch button D66, a distribution board button D67, a share button D68, and a settings button D69 are displayed.
[0261] The event button D61 is a button for displaying a screen that displays various events.
[0262] The gacha button D62 is a button for displaying a lottery screen for obtaining avatar parts and furniture objects.
[0263] The outfit button D63 is a button for displaying a closet screen.
[0264] The rearrange button D64 is a button for displaying a rearrange screen that allows rearrangement of the first virtual space.
[0265] The world button D65 is a button for moving the first character object to various virtual spaces (worlds) different from the first virtual space and the second virtual space, or for displaying a screen (such as Figure 10-12) for the user to play the game.
[0266] The booth switching button D66 is a button for switching from room distribution to booth distribution.
[0267] The distribution board button D67 is a button for displaying an information display board called a distribution board on the video.
[0268] The share button D68 is a button for sharing the video on social media or the like.
[0269] The setting button D69 is a button for making the above-mentioned distribution settings (FIG. 7, etc.).
[0270] Furthermore, when the user selects the menu button D55 on the booth broadcast screen in Fig. 28, a room switching button is displayed instead of the booth switching button D66 shown in Fig. 30. This room switching button is a button for switching from booth broadcast to room broadcast.
[0271] In addition, as examples of videos displayed on the first display screen D50 that displays the first virtual space in a non-distribution state and information superimposed on the videos, Figure 31 displays a rearrangement button D64, a gacha button D62, and a profile icon photo button D70.
[0272] The rearrange button D64 and the gacha button D62 are as described above.
[0273] The profile icon photograph button D70 is a button for photographing a still image of the first character object in the first virtual space.
[0274] It should be noted that in the first virtual space in the non-distribution state, it is not essential to display the first character object.
[0275] When a first character object is displayed in the first virtual space in the non-distribution state or the distribution state, the movement of the first character object is performed in response to an operation by the first user.
[0276] Furthermore, the facial and head movements of at least the first character object may reflect the movements of the first user, for example, when the first user tilts their head, the first character object's head is displayed to tilt in the same manner, and when the first user winks, the first character object is displayed to wink in the same manner.
[0277] Furthermore, the movement of the entire body of the first character object, including the face and head, may be performed in response to a command selected by the first user.
[0278] Commands include, for example, commands that apply predetermined facial expressions, poses, and movements (these predetermined facial expressions, poses, and movements are called "emotes") to the first character object, and commands that apply movements (such as sitting in a chair, lying down on a bed, holding a cup, etc.) that cause the first character object to be displayed in association with furniture objects.
[0279] The command may be displayed as selectable in response to a request from the first user or when the command is available for input.
[0280] Furthermore, the movement of the entire body of the first character object, including the face and head, may be performed automatically, without depending on the first user's movement and command selection operation.
[0281] Furthermore, one or more computer processors of the present disclosure may further include an operation object display unit that displays an operation object for accepting an operation on the first display screen by the first user, superimposed on the video.
[0282] FIG. 32 shows an example in which a control object 71 is displayed on the first display screen D50 during room distribution shown in FIG.
[0283] As an example, as shown in FIG. 32, the first control object 71 can be configured to include a first control object 71A and / or a second control object 71B.
[0284] The first control object 71A is for accepting movement operations to make the first character object walk or run horizontally in the virtual space, and the second control object 71B is for accepting movement operations to make the first character object jump vertically in the virtual space.
[0285] Assuming that the user holds the first information processing device 100 with both hands, the first operation object 71A can be arranged within a predetermined range from the lower left corner of the first display screen, and the second operation object 71B can be displayed within a predetermined range from the lower right corner of the first display screen. For example, the first operation object 71A can be arranged at a position on the first display screen that can be touched with the thumb of the left hand, and the second operation object 71B can be displayed at a position on the first display screen that can be touched with the thumb of the right hand, but this is not limiting.
[0286] As an example, as shown in FIG. 32, a first operation object 71 can be displayed at the bottom of the first display screen, superimposed on a moving image.
[0287] The operation object 71 may be any object that accepts an operation on the first display screen by the first user, and is not limited to the configuration that accepts the above-described movement operation.
[0288] As an example, the operation performed by the first user on the first display screen may be an emote selection operation for changing the facial expression and / or movement of the first character object, or an operation for rearranging the room.
[0289] Additionally, the one or more computer processors of the present disclosure may further include an information column display unit.
[0290] The information column display unit can superimpose an information column on the video for displaying information about reactions to the video by the first user and / or a second user different from the first user.
[0291] A reaction to a video can be, for example, a comment posted by the first user and / or the second user on the video, and / or a gift or a positive rating (like) posted by the second user, etc. The second user is not particularly limited as long as it is a user different from the first user, but can be, for example, a user watching the video.
[0292] The information about the comment posting is, for example, the content of the comment posted on the video.
[0293] The information about the posting of a gift or a favorable review is, for example, a notification informing the user that a gift or a favorable review has been posted. This information is included in the system comment automatically sent by the management (system), and the system comment also includes information such as the first user starting a broadcast (entering a room) and the broadcast time having passed a predetermined time.
[0294] As an example, as shown in FIG. 32, an information column 72 can be displayed at the top of the first display screen, superimposed on the moving image.
[0295] The reception unit 420 receives an operation by the first user.
[0296] The operation by the first user is not particularly limited as long as it is an operation performed by the first user, but it is also intended to include operations on the above-mentioned operation object 71 as well as operations on other buttons and objects displayed on the first display screen.
[0297] For example, the operation by the first user can be performed by a touch operation on the first display screen.
[0298] The operations on the objects include a specific movement operation on a first object, which will be described later. The operations on the objects may also include, for example, a selection operation, a movement operation, a rotation operation, etc. of any object including the first object and the specific object, which will be described later.
[0299] The receiving unit 420 can also receive the voice of the first user.
[0300] The voice of the first user may be the user's spoken voice acquired by a voice acquisition unit of the first information processing device 100. Acquisition of such voice can be switched ON / OFF by selecting the above-mentioned voice switching button D52.
[0301] The object placement unit 430 places a first object in a predetermined virtual space.
[0302] The first object is not particularly limited as long as it is an object that can be placed in a predetermined virtual space, particularly the first virtual space described above, but as an example, it can be the above-mentioned furniture object that is placed in response to an operation by the first user or another user, or automatically by the system. Furthermore, the first object can be particularly a large furniture object (such as a vehicle) among the above-mentioned furniture objects.
[0303] Alternatively, the first object may be a 3D or 2D mannequin object that resembles the first user's character object, and various attachment parts (eyes, nose, mouth, hair, tops, bottoms, shoes, bag, etc.) may be set on this character object as specified by the first user.
[0304] Alternatively, the first object may be an object requested to be displayed by a second user different from the first user. The second user may be, for example, a friend or follower associated with the first user who can have their own character object visit the first virtual space, a viewing user who watches the first user's video, or a guest user who appears in the first user's video in collaboration.
[0305] The first object displayed in response to a display request from the viewing user can also be called a gift object.
[0306] FIG. 33 shows an example of a rearrangement screen when a first object is placed in a predetermined virtual space in response to an operation by the first user.
[0307] In this way, when the first user places and moves the first object, a plan view of the first virtual space, which is a three-dimensional space, can be displayed on the first display screen.
[0308] Furthermore, when the first user places or moves the first object, a video captured from above by a virtual camera of the first virtual space, which is a three-dimensional space, can be displayed on the first display screen.
[0309] On the screen shown in FIG. 33, the first user can place one first object OB1 selected from a furniture list screen (not shown) displayed on the screen at a specified position in a predetermined virtual space.
[0310] Specifically, when a first user selects an icon from among multiple icons displayed on the furniture list screen, a first object OB1 corresponding to the selected icon is displayed (placed) in a position in a specified virtual space where it can be placed.
[0311] This position may be specified by the first user, or an initial position where placement is possible may be automatically specified.
[0312] The first user can then move and rearrange the first object OB1 placed in a specified virtual space to another position by performing a movement operation (e.g., a drag operation) on the first object OB1, but this rearrangement is usually limited to cases where no other objects are placed at the destination.
[0313] During this movement operation, guide bands according to the vertical and horizontal widths of the first object OB1 can be displayed in the up, down, left and right directions of the first object OB1, as shown in FIG.
[0314] The display mode of this guide band can change (for example, change color) when the desired placement position of the first object specified by the movement operation belongs to an area in the predetermined virtual space where placement is not possible.
[0315] Here, an example of a flow for determining whether or not the first object can be placed at the specified position will be described.
[0316] The one or more computer processors of the present disclosure may further include a placement feasibility determination unit.
[0317] The placement possibility determining unit determines whether or not the desired placement position of the first object specified by the move operation belongs to an area in which placement is not permitted in the predetermined virtual space.
[0318] The area where placement is not permitted may be an area where other objects have already been placed, or an area at the edge of a predetermined virtual space.
[0319] For example, the placement possibility determining unit determines whether or not there is an overlap between the area occupied by the first object and the placement impossible area in the plan view of the predetermined virtual space.
[0320] Then, if the placement possibility determining unit determines that the desired placement position does not belong to the placement impossible area, the receiving unit 420 receives the move operation.
[0321] On the other hand, if the placement possibility determination unit determines that the desired placement position belongs to an area where placement is not possible, and the area where placement is not possible is an area where another object is already placed, the placement possibility determination unit further determines whether the other object that has already been placed allows the first object to be placed on it.
[0322] In this way, each object can be stored in association with information indicating whether another object can be placed on that object.
[0323] Then, if the placement permission determining unit determines that the other placed object permits the placement of the first object, the receiving unit 420 receives the move operation.
[0324] On the other hand, if the placement possibility determination unit determines that the other placed objects do not permit the placement of the first object, the reception unit 420 will not accept the above-mentioned move operation, and the first object will be returned to its initial placement position when the move operation ends (when the drag operation is touched off).
[0325] The other object on which the first object is permitted to be placed is, for example, an object on which the first object can be placed, such as a table or a desk.
[0326] In this specification, the term "place" is used to mean placing a first object at a specified position without changing its size.
[0327] The first object, for which the move operation has been accepted by the accepting unit 420, is assumed to be placed at the designated position when the move operation ends (when the touch-off of the drag operation occurs).
[0328] Here, the receiving unit 420 can receive a specific movement operation for moving the first object to a specific position where a specific object is placed in a predetermined virtual space.
[0329] The specific object is not particularly limited as long as it is an object that can be placed in a predetermined virtual space, particularly a first virtual space, but it can be an object that can be displayed in association with a second object (described later). "Able to display in association with a second object" means that the second object is displayed as if it were contained within the specific object.
[0330] Here, the term "storing" is used herein to mean adjusting the size of a particular object and placing a second object on it.
[0331] In this specification, "storing" may include not only placing a second object inside a specific object, but also attaching a second object to the outside of a specific object, or attaching a second object to a specific object, and decorating the specific object with the second object.
[0332] The specific object may be an object that is placed in response to an operation by the first user or automatically by the system, and may be a type of furniture object described above.
[0333] The specific object may be an object that can be displayed in association with a second object, such as a storage furniture (e.g., a shelf or a chest of drawers), a Christmas tree, a collection box, an advent calendar, a cork board, or a mannequin.
[0334] The objects resembling storage furniture, collection boxes, and advent calendars can be designed so that second objects can be placed inside and outside them.
[0335] The Christmas tree-like object can be decorated on the outside with a second object.
[0336] The corkboard-like object can have a second object attached to its surface.
[0337] The mannequin-like object can be configured to be able to wear second items such as avatar parts, clothes, bags, accessories, and the like that can be attached to the character object.
[0338] The mannequin-like object only needs to have at least a torso, and there is no restriction on whether it has a face or limbs. However, if the mannequin-like object has a face, the mannequin-like object can be generated by miniaturizing the first user's character object.
[0339] In FIG. 33, a shelf object is shown as a specific object OB2.
[0340] As an example, FIG. 34 shows (a) a front view, (b) a rear view, (c) a plan view, and (d) a side view of the shelf object.
[0341] As an example, as shown in Fig. 34, a shelf object has two shelves, and the first, second, and third shelves each have three sections in which second objects can be placed. In Fig. 34, the sections are represented by dashed lines for the sake of explanation.
[0342] Note that the illustrated example is merely an example, and the number of rows and sections that a particular object has is not particularly limited.
[0343] Furthermore, the shelf object may have three more compartments set on the top board as a fourth tier.
[0344] Furthermore, compartments with which second objects can be associated can also be provided on the side and rear surfaces of the shelf object.
[0345] The specific position can be a position where a specific object is placed in a predetermined virtual space, or an area occupied by a specific object in a plan view of the predetermined virtual space.
[0346] FIG. 35 shows an example of a screen when the first object is moved to a specific position in response to an operation by the first user.
[0347] The above-described placement possibility determining unit may determine whether or not the move operation is a specific move operation based on the desired placement position of the first object designated by the move operation.
[0348] Specifically, if the placement possibility determination unit determines that the desired placement position of the first object belongs to an area where placement is not possible, and if the area where placement is not possible is an area where another object is already placed, the placement possibility determination unit further checks whether the other object that has already been placed allows the second object to be stored (whether the other object is a specific object).
[0349] As a result, if the other object is confirmed to be a specific object, it can be determined that the above-mentioned moving operation is a specific moving operation, and if the other object is confirmed to not be a specific object, it can be determined that the above-mentioned moving operation is not a specific moving operation.
[0350] In this way, each object can be stored in association with information indicating whether the object can store a second object.
[0351] On the other hand, if the placement possibility determination unit confirms that the other placed object does not allow the second object to be stored (the other object is not a specific object), the reception unit 420 will not accept the above-mentioned move operation, and the first object will be returned to its initial placement position when the move operation ends (when the drag operation is touched off).
[0352] When the receiving unit 420 receives a specific movement operation, the association display unit 440 displays a second object that satisfies a specific condition regarding size in association with the specific object.
[0353] An example of a specific condition regarding the size that the second object must satisfy is that the second object must be a size that can be associated with a specific object.
[0354] The size of the second object and the particular object may be defined as the volume of these objects or as the area they occupy in at least one of a top view, a front view, and a side view.
[0355] A size that can be associated with a specific object is at least the same size as or smaller than the specific object, and as an example, is a size that can be placed in the above-mentioned section.
[0356] FIG. 36 shows an example of a screen in which a shelf object, which is a specific object, is viewed from the front, and in which a second object OB3 is displayed in association with one section inside the shelf object.
[0357] 37 shows an example of a screen showing a shelf object, which is a specific object, viewed from the side, in which a second object OB3 is displayed in association with one section of the side of the shelf object. In this way, the second object OB3 associated with the side of the shelf object can be a flat object such as a photograph or a poster.
[0358] 38 shows an example of a screen showing a specific object, a corkboard, viewed from the front, with a second object OB3 associated with one section. In this way, the second object OB3 associated with the corkboard object can be a flat object such as a photo or a poster.
[0359] The second object OB3 may be generated each time the receiving unit 420 receives a move operation, or may be extracted from a prepared object.
[0360] For example, when the receiving unit 420 receives a move operation, the size of the first object is adjusted to an appropriate size and a second object is generated.
[0361] Alternatively, when the receiving unit 420 receives a move operation, a second object that is a prepared object and has a different size from the first object can be extracted in place of the first object.
[0362] In this way, a second object that meets a specific size condition can be automatically generated or extracted and displayed in association with a specific object.
[0363] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.
[0364] Specifically, with the above configuration, it is possible to ease the restrictions on the number and positions of objects that can be placed in a predetermined virtual space due to their size.
[0365] More specifically, according to the above configuration, by displaying a second object in association with a specific object at a specific position where a specific object has been placed, where a first object could not previously be placed, it is possible to increase the number of virtual objects that can be placed in a specified virtual space.
[0366] Furthermore, with the above configuration, it becomes possible to provide variations in the display mode of objects placed in a predetermined virtual space.
[0367] Specifically, a first object placed at a position other than the specific position is displayed in the same manner, while a first object moved to the specific position is displayed as a second object, allowing the first user to select in which manner the first object is placed.
[0368] Furthermore, with the above configuration, the user can manage the items he or she owns in the virtual space.
[0369] Managing owned items in a virtual space means arranging owned items as objects in the virtual space, with a uniform size and arrangement that makes them easier for the user to check, rather than managing a list of the user's possessions on an inventory screen that displays items such as pockets, bags, or pouches.
[0370] In the present invention, owned items can be managed on an inventory screen (furniture list screen, etc.), and further, some owned items selected by the user can be managed in the virtual space.
[0371] The one or more computer processors in the present disclosure may further include a generating unit 450, as shown in FIG.
[0372] When the receiving unit 420 receives a specific movement operation, the generating unit 450 generates a second object by adjusting the size of the first object.
[0373] At this time, the association display unit 440 displays the second object generated by the generation unit 450 in association with a specific object.
[0374] In this case, the second object may be generated each time a specific movement operation is received.
[0375] For example, when the receiving unit 420 detects the end of a specific movement operation (detects a touch-off operation), the generating unit 450 can reduce or enlarge the size of the first object to an appropriate size that is appropriate for displaying in association with the specific object, thereby making it into a second object.
[0376] The appropriate size is a size that can be associated with a specific object, for example, as described above, a size that is at least the same as or smaller than the specific object, and as an example, a size that can be placed in the above-mentioned section.
[0377] One or more computer processors in the present disclosure may further include a size comparison unit 470, as shown in FIG.
[0378] When the receiving unit 420 receives a specific movement operation, the size comparing unit 470 compares the size of the partition of the specific object with the size of the first object.
[0379] Based on the result of the comparison by the size comparison unit 470, the generation unit 450 can adjust the size of the first object to an appropriate size that fits into the partition.
[0380] If the size comparison unit 470 determines that the size of the first object is larger than the size of the partition as a result of the comparison, the generation unit 450 can generate a second object by reducing the size of the first object to a size that fits the partition.
[0381] Alternatively, if the comparison by the size comparison unit determines that the size of the first object is the same as or smaller than the size of the partition, the generation unit 450 can make the first object the second object without adjusting its size.
[0382] Alternatively, if the size comparison unit 470 determines that the size of the first object is smaller than the size of the partition as a result of the comparison, the generation unit 450 can enlarge the size of the first object to a size that fits the partition and generate a second object.
[0383] According to these configurations, the second object is generated each time, so the amount of data that needs to be prepared in advance can be reduced.
[0384] Furthermore, one or more computer processors in the present disclosure may further include an extraction unit 460 as shown in FIG.
[0385] When the receiving unit 420 receives a specific movement operation, the extracting unit 460 extracts, from among objects prepared in advance, a second object that differs from the first object only in size.
[0386] At this time, the association display unit 440 displays the second object extracted by the extraction unit 460 in association with a specific object.
[0387] According to this configuration, the processing load for generating the second object can be reduced.
[0388] The second object may not only be a different size of the first object, but may also have at least some of the characteristics of the first object.
[0389] For example, if the first object is clothes, hair, accessories, etc. to be worn by a character object, the second object can be a mannequin (whole body, head, torso, etc.) wearing the first object.
[0390] Furthermore, if the first object is wallpaper or flooring, a canvas on which the pattern of the first object is drawn can be used as the second object.
[0391] The video displayed on the first display screen may further display a first character object of the first user that is movable within a predetermined virtual space.
[0392] In this case, one or more computer processors in the present disclosure further include a virtual camera control unit 480 as shown in FIG.
[0393] The virtual camera control unit 480 controls the operation of a virtual camera that captures an image of a predetermined virtual space.
[0394] Specifically, virtual camera control unit 480 controls the operation of the virtual camera in a first mode, a second mode, or a third mode.
[0395] The first mode is a control mode of the virtual camera in a state in which a movement operation on the first character object can be accepted.
[0396] For example, the first mode can be a mode in which the operation of the virtual camera can be changed in response to an operation by the first user.
[0397] Figures 27, 29, 31-32 are examples of videos captured by a virtual camera controlled in the first mode, in which the virtual camera basically follows the movement of the first character object, and its position, orientation, etc. can be controlled in accordance with the operation of the first user.
[0398] The second mode is a control mode of the virtual camera in a state in which a movement operation on the first object can be accepted.
[0399] For example, the second mode can be a mode in which a predetermined virtual space is photographed from above (redecoration mode).
[0400] 33 and 35 are examples of moving images captured by a virtual camera controlled in the second mode. In the second mode, the virtual camera is controlled to capture an overhead view of a predetermined virtual space.
[0401] Then, when the operation of the virtual camera is controlled in the second mode, if the reception unit 420 receives a specific movement operation, the virtual camera control unit 480 changes the control of the operation of the virtual camera from the second mode to the third mode.
[0402] For example, the third mode may be a mode in which a specific object is photographed from the front.
[0403] 36 and 38 are examples of moving images captured by a virtual camera controlled in the third mode, in which the virtual camera is controlled to capture an image of a specific object from the front.
[0404] However, if the second object is associated with the side of the particular object, in the third mode, the virtual camera is controlled to photograph the particular object from the side, as shown in Figure 37.
[0405] That is, the location to which the second object can be associated is displayed in an up-close manner.
[0406] Furthermore, when the operation of the virtual camera is controlled in the first mode, if the reception unit 420 receives a selection operation for a specific object placed in a specified virtual space, the virtual camera control unit 480 can change the control of the operation of the virtual camera from the first mode to the third mode.
[0407] After the above-described retraction operation, virtual camera control unit 480 can change the control of the operation of the virtual camera from the third mode to the first mode or the second mode.
[0408] Furthermore, when the control of the virtual camera operation is returned from the third mode to the first mode, it is also possible to configure the character object to move near a specific object (within a predetermined distance from the specific object) regardless of the location of the character object in the first mode before changing to the third mode.
[0409] Specifically, when a selection operation is performed on a specific object on the screens shown in FIGS. 27, 29, 31-32, etc., the screens transition to the screens shown in FIGS. 36-38.
[0410] Furthermore, the object placement unit 430 can release the association between a specific object and a second object in response to an operation by the first user, and rearrange the first object in a predetermined virtual space.
[0411] The first user may perform such an operation when the operation of the virtual camera is controlled in the third mode. By performing an operation on the second object, the first user may change the position of the second object within a specific object or rearrange the first object in a predetermined virtual space.
[0412] The rearrangement can be performed by long pressing a second object displayed in association with a specific object and then dragging it outside the specific object.
[0413] As a result, the second object associated with the specific object is restored and displayed as the first object at the specified position in the first virtual space.
[0414] Also, as mentioned above, a particular object may have at least one compartment in which a second object may be placed.
[0415] By providing the partition, the second object can be arranged in an orderly and visually pleasing manner rather than being arranged freely.
[0416] Furthermore, the object placement unit 430 can rearrange the second object in another section of the specific object in response to an operation by the first user.
[0417] The above operation can be performed by dragging a second object placed in one section to another section.
[0418] At this time, if another second object is already displayed in the destination section, the object may be made non-movable, or may be configured to be replaced with the other second object at the destination.
[0419] Alternatively, if another second object is already displayed at the destination, both second objects may be displayed in the destination section, and the sizes of both second objects may be further reduced.
[0420] Here, if the other second object is of the same type as the second object placed in one section, only one second object may be displayed, and a mark or the like may be added to indicate that multiple second objects are placed.
[0421] Furthermore, if another second object is of a different type from the second object placed in one section, the second object can be displayed in association with the second object already placed.
[0422] For example, if the second object already placed is a mannequin object, the mannequin may be displayed wearing a different second object, that is, an attachment object.
[0423] Furthermore, when a mannequin object wearing another second object is moved into a section in which another second object is placed, the mannequin object can be displayed wearing the still further second object.
[0424] Furthermore, the number of sections that a particular object has can be increased or decreased in response to a particular operation by the first user.
[0425] An example of a specific operation is an operation to purchase a section, or in the case of a shelf object, to extend the section upward.
[0426] Furthermore, the receiving unit 420 can also receive an adjustment operation on the second object by the first user.
[0427] The adjustment operation is, for example, adjusting the size and / or orientation of the second object.
[0428] However, at least for the size adjustment, the range of sizes that can be adjusted is set to a predetermined range that is a size that can be associated with a specific object.
[0429] According to this configuration, the first user can fine-tune the size of the second object.
[0430] The one or more computer processors in the present disclosure may further include an attribute determining unit 490, as shown in FIG.
[0431] The attribute determination unit 490 determines whether there is a predetermined relationship between the attribute set for the first object and the attribute set for the specific object in response to an operation by the first user.
[0432] The first object is assumed to have at least one attribute set, such as food, drink, vehicle, ornament, or accessory, based on the type of the first object.
[0433] Similarly, it is assumed that at least one attribute of the first object that can be associated with the specific object is set.
[0434] Then, when the first user specifies a specific position of a specific object as the destination of the first object, the attribute determination unit 490 can determine whether the attribute of the first object is an attribute with which the specific object can be associated.
[0435] Then, when the attribute determination unit 490 determines that there is a predetermined relationship, the reception unit 420 receives a specific movement operation.
[0436] For example, if the specific object is an object that resembles a refrigerator, it can be associated with objects that resemble food or drinks, but it cannot be associated with objects that resemble ornaments or vehicles.
[0437] According to this configuration, it is possible to create a sense of unity among the objects associated with a specific object, and since a specific object is required for each attribute, it is possible to increase the desire to acquire various specific objects.
[0438] Furthermore, the object placement unit 430 can place a specific object in a predetermined virtual space so that it is visible or invisible to the second user, based on an operation by the first user.
[0439] In both cases where a particular object is visible and invisible to the second user, a second object associated with the particular object can be displayed so as to be visible to the second user.
[0440] Taking the shelf object shown in Figure 36 as an example, arranging a specific object OB2 so that it is visible to the second user means that both the shelf object and a second object aligned with the shelf object are displayed on the second user's screen.
[0441] On the other hand, placing a specific object so that it is not visible to the second user means that the shelf object portion shown in Figure 36 will not be displayed on the second user's screen (will be transparent), and only the second object aligned with the shelf object will be displayed on the second user's screen.
[0442] In either case, the specific object may be displayed visibly on the first user's screen, or may be displayed visibly on the first user's screen only on the redecorating screen.
[0443] Furthermore, whether or not a particular object is visible to the second user may be switchable in response to an operation by the first user.
[0444] The association display unit 440 can arrange the second object in association with a specific object in a manner that is visible or invisible to the second user based on an operation by the first user.
[0445] Placing the second object so that it is visible to the second user means, for example, placing the second object on a shelf object that has no door or has the door open, as shown in Figure 36.
[0446] On the other hand, placing the second object so that it is not visible to the second user means that the second object is placed on a specific object (for example, storage furniture with doors and drawers (shelf, chest of drawers, safe, refrigerator, Shinto altar, etc.)) in such a manner that the associated second object is not visible.
[0447] In the latter case, the particular object may be configured so that the second object is visible to the second user in response to an operation by the first user to make the second object visible to the second user (e.g., an operation to open a door).
[0448] In addition, the operation to make the second object visible to the second user can be performed by a user other than the first user, in which case a key (possession of a key object or entry of a password, etc.) can be required to unlock the door.
[0449] The specific object associated with the second object may be capable of being moved in a predetermined virtual space in response to an operation by the first user.
[0450] In other words, specific objects associated with a second object and specific objects not associated with a second object can be moved, rotated, removed, etc. in the virtual space in response to operations by the first user, just like the first object described above.
[0451] When a specific object is removed from the virtual space, the second object associated with the specific object is released from its association.
[0452] The object placement unit 430 can place a first object in a predetermined virtual space based on an instruction from a second user different from the first user.
[0453] In this case, as described above, the second user may be, for example, a friend or follower associated with the first user who can have their own character object visit the first virtual space, a viewing user who watches the first user's video, or a guest user who appears in the first user's video in collaboration.
[0454] For example, the first object displayed in response to a display request by a viewing user is a gift object.
[0455] The first user can then place the gift object thrown by the second user in association with a specific object.
[0456] Normally, a display time is set for a gift object thrown by a second user based on its type and information about the second user, but the display time restriction can be lifted only for gift objects placed in association with a specific object.
[0457] According to this configuration, for example, by placing a specific object at a position that will be displayed on the distribution screen and associating a thrown gift object with the specific object, it becomes possible to align and display the gifts and extend the display time.
[0458] As described above, the configuration of the present disclosure can provide technical improvements that solve or alleviate at least some of the problems of the conventional techniques described above.
[0459] Specifically, with the above configuration, it is possible to ease the restrictions on the number and positions of objects that can be placed in a predetermined virtual space due to their size.
[0460] Furthermore, with the above configuration, it becomes possible to provide variations in the display mode of objects placed in a predetermined virtual space.
[0461] Previously, the size of furniture placed in a virtual space such as a room was determined by default. In recent years, large furniture has been released, and there was a problem that placing large furniture in a room would make it impossible to place other furniture.
[0462] Therefore, the technology disclosed herein allows furniture to be stored in storage furniture, making it possible to make effective use of limited personal space.
[0463] In addition, the size of the furniture is automatically adjusted when storing the furniture in the storage furniture, making it easy for the user to operate.
[0464] The above-mentioned virtual space is not limited to spaces for video distribution by avatars (rooms, booths, worlds, etc.) or metaverse spaces where avatars move around, but can also be applied to game spaces for progressing games using character objects that users can control.
[0465] In this case, the first object may include an item acquired on the game field, an item given as a reward, an item acquired by lottery or purchase, a material item provided by a teammate, etc.
[0466] Next, an example of an information processing method according to an embodiment of the present disclosure will be described.
[0467] The information processing method according to the embodiment of the present disclosure is an information processing method in an information processing system 3000 shown in Fig. 3. The information processing system 3000 includes at least a first user terminal (first information processing device) 100 and a server device 400.
[0468] The information processing method of the present disclosure is characterized in that, as shown as an example in FIG. 40, one or more computer processors provided in an information processing system 3000 execute a display control step S410, an object placement step S420, a reception step S430, a determination step S440, and an associated display step S450.
[0469] The display control step S410 controls the display of a moving image showing a predetermined virtual space on the first display screen. The display control step S410 can be executed by the display control unit 410 described above.
[0470] Moreover, the display control step S410 may be executed on the server side (server device 400) or on the client side (user terminal 100).
[0471] The object placement step S420 places a first object in a predetermined virtual space. This object placement step S420 can be executed by the object placement unit 430 described above.
[0472] Furthermore, the object placement step S420 may be executed on the server side (server device 400) or on the client side (user terminal 100).
[0473] The receiving step S430 receives an operation by the first user. The receiving step S430 can be executed by the receiving unit 420 described above.
[0474] Furthermore, the receiving step S430 may be executed on the server side (server device 400) or on the client side (user terminal 100).
[0475] In a determining step S440, it is determined whether the operation received in the receiving step S430 is a specific movement operation for moving the first object to a specific position where a specific object is placed in a predetermined virtual space.
[0476] The determination step S440 may be executed on the server side (server device 400) or on the client side (user terminal 100).
[0477] In the association display step S450, when it is determined in the determination step S440 that the operation is a specific movement operation, a second object that satisfies a specific condition regarding size is displayed in association with the specific object. Such association display step S450 can be executed by the association display unit 440 described above.
[0478] Furthermore, the associated display step S450 may be executed on the server side (server device 400) or on the client side (user terminal 100).
[0479] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.
[0480] Next, a computer program according to an embodiment of the present disclosure will be described.
[0481] The computer program according to the embodiment of the present disclosure is a computer program executed in the information processing system 3000 shown in Fig. 3. The information processing system 3000 includes at least a user terminal 100 and a server device 400.
[0482] The computer program in the present disclosure is characterized by causing one or more computer processors included in the information processing system 3000 to realize a display control function, an object placement function, a reception function, and an association display function.
[0483] The display control function controls the display of a moving image that displays a predetermined virtual space on the first display screen.
[0484] The object placement function places a first object in a predetermined virtual space.
[0485] The reception function receives an operation by the first user.
[0486] When the reception function receives a specific movement operation to move a first object to a specific position where a specific object is placed in a predetermined virtual space, the associated display function displays a second object that satisfies specific size conditions in association with the specific object.
[0487] The above functions can be realized by circuits 1410 to 1440 shown in Fig. 41. The display control circuit 1410, object arrangement circuit 1420, reception circuit 1430, and association display circuit 1440 are realized by the above-mentioned display control unit 410, object arrangement unit 430, reception unit 420, and association display unit 440, respectively. Details of each unit are as described above.
[0488] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.
[0489] Finally, an information processing device according to an embodiment of the present disclosure will be described. The information processing device corresponds to the user terminal 100 in the information processing system 3000 described above.
[0490] As shown in FIG. 42, the information processing device includes a display control unit 110, a reception unit 120, an object placement unit 130, and an association display unit 140.
[0491] The display control unit 110 controls the display of a video that displays a predetermined virtual space on the first display screen. The display control unit 110 can have the same configuration as the display control unit 410 described above.
[0492] The receiving unit 120 receives an operation by the first user. The receiving unit 120 can have the same configuration as the receiving unit 420 described above.
[0493] The object placement unit 130 places a first object in a predetermined virtual space. The object placement unit 130 can have the same configuration as the object placement unit 430 described above.
[0494] When the receiving unit 120 receives a specific movement operation for moving a first object to a specific position where a specific object is placed in a predetermined virtual space, the association display unit 140 displays a second object that satisfies specific size conditions in association with the specific object. The association display unit 140 can have a configuration similar to that of the association display unit 440 described above.
[0495] The above configuration can provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.
[0496] Furthermore, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-described embodiments. Such an information processing device can be realized by storing a program describing the processing content for realizing each function of the server device or terminal device according to the embodiments in a storage unit of the information processing device, and reading and executing the program by a CPU of the information processing device.
[0497] 43 is a block diagram of a processing circuit for performing computer-based operations in accordance with the present disclosure. FIG. 43 shows a processing circuit 600, which corresponds to the CPU of the terminals and devices of the present disclosure.
[0498] The processing circuit 600 can be used to control any computer-based or cloud-based control process. Flowchart descriptions or blocks can be understood as representing modules, segments, or portions of code containing one or more executable instructions for implementing specific logical functions or steps within a process. Alternative implementations are within the scope of the exemplary embodiments of this advancement in which functions may be performed. The order from that shown or discussed includes substantially simultaneous or reverse order, depending on the functionality involved, as will be understood by those skilled in the art. The functionality of the elements disclosed herein can be implemented using circuits or processing circuits that may include general-purpose processors, special-purpose processors, integrated circuits, ASICs ("application-specific integrated circuits"), conventional circuits configured or programmed to perform the disclosed functions, and / or combinations thereof. A processor processes circuits or circuits, such as transistors and other circuits therein. A processor may also be a programmed processor that executes a program stored in memory. In this disclosure, a processing circuit, unit, or means is hardware that performs or is programmed to perform the recited functions. The hardware can be any hardware disclosed herein or any otherwise known hardware that is programmed or configured to perform the recited functions.
[0499] In FIG. 43, processing circuit 600 includes CPU 601, which executes one or more control processes discussed in this disclosure. Process data and instructions may be stored in memory 602. These process and instructions may also be stored on a storage medium disk 604, such as a hard drive (HDD) or portable storage medium, or may be stored remotely. Furthermore, the claimed advancement is not limited by the form of computer-readable medium on which the instructions for the processes of the present invention are stored. For example, the instructions may be stored on a CD, DVD, flash memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk, or any other non-transitory computer-readable medium of an information processing device with which processing circuit 600 communicates, such as a server or computer. The processes may also be stored in network-based storage, cloud-based storage, or other mobile-accessible storage and executable by processing circuit 600.
[0500] Additionally, the claimed developments may be provided as a utility application, a background daemon, or an operating system component, or a combination thereof, and execute in conjunction with CPU 601 and an operating system such as Microsoft Windows, UNIX, Solaris, LINUX, Apple MAC-OS, Apple iOS, and other systems known to those skilled in the art.
[0501] The hardware elements for implementing the processing circuit 600 may be realized by various circuit elements. Furthermore, each function of the above-described embodiments may be realized by a circuit including one or more processing circuits. The processing circuit includes a specially programmed processor, for example, a processor (CPU) 601 as shown in FIG. 43. The processing circuit also includes devices such as application-specific integrated circuits (ASICs) and conventional circuit components arranged to perform the enumerated functions.
[0502] Alternatively, or additionally, CPU 601 may be implemented on an FPGA, an ASIC, a PLD, or using discrete logic circuitry, as will be appreciated by those skilled in the art. CPU 601 may also be realized as multiple processors operating in parallel and in coordination to execute instructions for the inventive process described above.
[0503] The processing circuit 600 of FIG. 43 also includes a network controller 606, such as an Ethernet PRO network interface card, for interfacing with a network 700. As can be appreciated, the network 700 can be a public network, such as the Internet, or a private network, such as a local area network (LAN) or wide area network (WAN), or any combination thereof, and can also include a public switched telephone network (PSTN) or an integrated services digital network (ISDN) subnetwork. The network 700 can also be wired, such as an Ethernet network, a universal serial bus (USB) cable, or wireless, such as a cellular network, including EDGE, 3G, and 4G wireless cellular systems. The wireless network can also be Wi-Fi, wireless LAN, Bluetooth, or any other known form of wireless communication. Additionally, the network controller 606 may be compliant with other direct communication standards, such as Bluetooth, near field communication (NFC), infrared, or others.
[0504] The processing circuit 600 further includes a display controller 608, such as a graphics card or graphics adapter, for interfacing with a display 609, such as a monitor. The I / O interface 612 interfaces with a keyboard and / or mouse 614, and a touchscreen panel 616 on or separate from the display 609. The I / O interface 612 also connects to various peripheral devices 618.
[0505] Storage controller 624 connects storage media disks 604 to a communication bus 626, which may be ISA, EISA, VESA, PCI, or the like, and interconnects all components of processing circuit 600. A description of the display 609, keyboard and / or mouse 614, and the general features and functionality of display controller 608, storage controller 624, network controller 606, and I / O interface 612 will be omitted herein for the sake of brevity, as these features are well known.
[0506] Example circuit elements described in the context of this disclosure may be substituted with other elements or may be structured differently from the examples provided herein. Furthermore, circuits configured to perform the functions described herein may be implemented in multiple circuit units (e.g., chips), or features may be combined in circuits on a single chipset.
[0507] The functions and features described herein may also be performed by various distributed components of a system. For example, one or more processors may perform these system functions, where the processors are distributed across multiple components communicating within a network. The distributed components may include one or more client and server machines that may share processing, as well as various human interface and communication devices (e.g., display monitors, smartphones, tablets, personal digital assistants (PDAs)). The network may be a private network such as a LAN or WAN, or a public network such as the Internet. Input to the system may be received via direct user input, remotely in real time, or as a batch process. Furthermore, some implementations may be performed on modules or hardware that are not identical to those described. Accordingly, other implementations are within the scope that may be claimed.
[0508] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims.
[0509] Furthermore, the methods described in the embodiments can be stored as a program executable by a computer on a recording medium such as a magnetic disk (e.g., a floppy disk, a hard disk, etc.), an optical disk (e.g., a CD-ROM, a DVD, an MO, etc.), or a semiconductor memory (e.g., a ROM, a RAM, a flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium also includes a configuration program for configuring software means (including not only execution programs but also tables and data structures) within the computer to be executed by the computer. The computer implementing this device reads the program stored on the recording medium and, in some cases, configures the software means using the configuration program, and executes the above-described processing by controlling the operation of this software means. The term "recording medium" as used herein is not limited to a storage medium for distribution, but also includes storage media such as a magnetic disk or semiconductor memory installed within the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. [Explanation of symbols]
[0510] 100 First information processing device 400 Server device 410 Display control unit 420 Reception 430 Object Placement Section 440 Related display section
Claims
1. 1. An information processing system comprising one or more computer processors, the one or more computer processors: a display control unit that controls display of a video displaying a predetermined virtual space on a first display screen of the first information processing device; a reception unit that receives an operation by a first user; an object placement unit that places a first object in the predetermined virtual space; an association display unit that, when the receiving unit receives a specific movement operation for moving the first object to a specific position where a specific object is placed in the predetermined virtual space, displays a second object that satisfies a specific condition regarding size in association with the specific object; An information processing system comprising:
2. The one or more computer processors further: a generating unit that generates the second object by adjusting a size of the first object when the receiving unit receives the specific move operation; 2. The information processing system according to claim 1, wherein the association display unit displays the second object generated by the generation unit in association with the specific object.
3. The one or more computer processors further: an extraction unit that extracts, when the reception unit receives the specific movement operation, the second object that differs from the first object only in size from among objects prepared in advance; 2. The information processing system according to claim 1, wherein the association display unit displays the second object extracted by the extraction unit in association with the specific object.
4. The information processing system according to claim 1, characterized in that the object placement unit disassociates the specific object from the second object in response to an operation by the first user, and relocates the first object in the specified virtual space.
5. 2. The information processing system according to claim 1, wherein the specific object has at least one section in which the second object can be placed.
6. 6. The information processing system according to claim 5, wherein the object placement unit relocates the second object to another section of the specific object in response to an operation by the first user.
7. 6. The information processing system according to claim 5, wherein the number of partitions included in the specific object can be increased or decreased in response to a specific operation by the first user.
8. The one or more computer processors further: a size comparison unit that, when the reception unit receives the specific move operation, compares a size of a partition of the specific object with a size of the first object; 3. The information processing system according to claim 2, wherein the generation unit adjusts the size of the first object to an appropriate size that fits into the partition based on the result of the comparison by the size comparison unit.
9. The information processing system according to claim 8, characterized in that, when the comparison by the size comparison unit determines that the size of the first object is larger than the size of the partition, the generation unit generates a second object by reducing the size of the first object to a size that fits the partition.
10. The information processing system according to claim 8, characterized in that, when the comparison by the size comparison unit determines that the size of the first object is the same as or smaller than the size of the partition, the generation unit generates the second object without adjusting the size of the first object.
11. the receiving unit further receives an adjustment operation on the second object by the first user; 2. The information processing system according to claim 1, wherein the adjustment operation is a size adjustment and / or a direction adjustment of the second object.
12. The video further displays a first character object that is movable within the predetermined virtual space, The one or more computer processors further: a virtual camera control unit that controls an operation of a virtual camera that captures an image of the predetermined virtual space; The virtual camera control unit controls the operation of the virtual camera as follows: controlling the first character object in a first mode in a state in which a movement operation on the first character object can be accepted; controlling the first object in a second mode in a state in which a movement operation on the first object can be accepted; The information processing system described in claim 1, characterized in that when the operation of the virtual camera is controlled in the second mode and the receiving unit receives the specific movement operation, the virtual camera control unit changes the control of the operation of the virtual camera from the second mode to a third mode.
13. 13. The information processing system according to claim 12, wherein the first mode is a mode in which the operation of the virtual camera can be changed in response to an operation by the first user.
14. 13. The information processing system according to claim 12, wherein the second mode is a mode in which the predetermined virtual space is photographed from above.
15. 13. The information processing system according to claim 12, wherein the third mode is a mode in which the specific object is photographed from the front.
16. When the operation of the virtual camera is controlled in the first mode, if the reception unit receives a selection operation for the specific object arranged in the predetermined virtual space, 13. The information processing system according to claim 12, wherein the virtual camera control unit changes control of the operation of the virtual camera from the first mode to the third mode.
17. The one or more computer processors further: an attribute determination unit that determines whether there is a predetermined relationship between an attribute set in the first object and an attribute set in the specific object in response to an operation by the first user; The information processing system according to claim 1 , wherein the accepting unit accepts the specific movement operation when the attribute determining unit determines that the predetermined relationship exists.
18. The information processing system according to claim 1, characterized in that the object placement unit places the specific object in the specified virtual space so that it is visible or invisible to the second user based on an operation by the first user.
19. The information processing system according to claim 1, characterized in that the association display unit displays the second object in association with the specific object so that it is visible or invisible to the second user based on an operation by the first user.
20. 2. The information processing system according to claim 1, wherein the object placement unit places the specific object at a different position in the predetermined virtual space in response to an operation by the first user.
21. 2. The information processing system according to claim 1, wherein the object placement unit places the first object in the predetermined virtual space based on an instruction from a second user different from the first user.
22. one or more computer processors, a display control step of controlling display of a moving image showing a predetermined virtual space on a first display screen; an object placement step of placing a first object in the predetermined virtual space; a receiving step of receiving an operation by a first user; a determination step of determining whether the operation received in the receiving step is a specific movement operation for moving the first object to a specific position where a specific object is placed in the predetermined virtual space; an associated display step of displaying a second object that satisfies a specific condition regarding size in association with the specific object when the operation is determined to be the specific move operation in the determining step; An information processing method for executing the above.
23. one or more computer processors, a display control function that controls the display of a video displaying a predetermined virtual space on the first display screen; an object placement function for placing a first object in the predetermined virtual space; a reception function for receiving an operation by a first user; an association display function that, when the reception function receives a specific movement operation for moving the first object to a specific position where a specific object is placed in the predetermined virtual space, displays a second object that satisfies a specific condition regarding size in association with the specific object; A computer program that makes this happen.
Citation Information
Patent Citations
Technique for controlling display images of objects
JP2009104482A
Virtual object display system
JP2019212041A
Automatic placement of virtual objects in 3D space
JP2019532382A
Virtual space providing system, virtual space providing method, and program
JP2021002318A
Virtual camera placement system
US20190351325A1