Program and Information Processing System

Abstract

To provide a program capable of preventing a work of another people from clearly reflecting in a virtual space image, and an information processing system.SOLUTION: A program executed by a computer causes the computer to function as means for generating a virtual space 501, means for arranging a virtual camera, a user object 502, and a specific object in the virtual space 501, and means for generating a virtual space image, which is an image in the virtual space 501, on the basis of the virtual camera. The program also causes the computer to switch the virtual space image between a first-person viewpoint image of the user object 502 and a third-person viewpoint image containing at least a part of the user object 502 when prescribed conditions are met as the means for generating the virtual space image and to display a specific object in a prescribed display mode if the specific object is included in the virtual space image when a first-person viewpoint image is generated as the virtual space image.SELECTED DRAWING: Figure 17

Description

Technical Field

[0001] The present disclosure relates to a program and an information processing system.

Background Art

[0002] There is known a technique for moving a user object in a virtual space based on a user's operation input, and generating a virtual space image based on a virtual camera that moves according to the movement of the user object. Non-Patent Document 1 discloses a game that generates such a virtual space image from the first-person perspective, which is the perspective of the user object. Non-Patent Document 2 also discloses a game that generates a virtual space image from the third-person perspective including the user object.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Non-Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, when it is possible to switch a virtual space image between a third-person perspective image and a first-person perspective image, when switching the virtual space image from a third-person perspective image to a first-person perspective image, the entire virtual space image is enlarged. Thus, when the entire virtual space image is enlarged, there is a possibility that the works of others are clearly reflected in the virtual space image, and a technology capable of preventing such clear reflection of the works of others is desired.

[0005] The present disclosure aims to prevent the works of others from being clearly reflected in a virtual space image.

Means for Solving the Problem

[0006] According to one embodiment shown in the present disclosure, A program executed by a computer, The program causes the computer to Function as means for generating a virtual space, Means for arranging a virtual camera, a user object, and a specific object in the virtual space, Function as means for generating a virtual space image, which is an image of the virtual space, based on the virtual camera, As the means for generating the virtual space image, When a predetermined condition is satisfied, switch the virtual space image between an image from the first-person perspective of the user object and an image from the third-person perspective including at least a part of the user object, When generating the image from the first-person perspective as the virtual space image, when the specific object is included in the virtual space image, display the specific object in a predetermined display mode, A program is provided.

[0007] According to another embodiment shown in the present disclosure, An information processing system including one or more information processing devices, A process for generating a virtual space, A process of arranging a virtual camera, a user object, and a specific object in the virtual space, A process of generating a virtual space image, which is an image of the virtual space, based on the virtual camera, and In the process of generating the virtual space image, When a predetermined condition is satisfied, switch the virtual space image between a first-person perspective image of the user object and a third-person perspective image including at least a part of the user object, When generating the first-person perspective image as the virtual space image, when the specific object is included in the virtual space image, display the specific object in a predetermined display mode, An information processing system is provided.

Advantages of the Invention

[0008] According to an embodiment shown in the present disclosure, it is possible to prevent the clear reflection of the works of others in the virtual space image.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of this technical idea will be described in detail with reference to the drawings. In the following description, the same components and the like are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated. In one or more embodiments disclosed herein, elements included in each embodiment can be combined with each other, and the resulting combination is also part of the embodiments disclosed herein.

[0011] [First Embodiment] (System Configuration) Hereinafter, as a first embodiment according to the present disclosure, a system that moves a user object in a virtual space based on a user's operation input and provides a user with a virtual space image generated based on a virtual camera that moves in response to the movement of the user object will be exemplified and described.

[0012] The virtual space may be common to a plurality of users, or may be different for each of the plurality of users. That is, a plurality of user objects may exist in one virtual space, or one user object may exist in one virtual space. Further, the virtual space may be generated using an XR technology such as VR (Virtual Reality).

[0013] FIG. 1 is a diagram showing a configuration example of a system (information processing system) 1 according to the first embodiment of the present disclosure. As shown in FIG. 1, the system 1 includes user terminals 10A, 10B, and 10C used by a plurality of users respectively, and a server 20, and these devices are communicably connected to each other by a network 30.

[0014] The user terminal 10A and the user terminal 10B are connected to the network 30 by communicating with a radio base station 31. The user terminal 10C is connected to the network 30 by communicating with a wireless router 32 installed in a facility such as a house. Hereinafter, user terminals such as the user terminals 10A, 10B, and 10C are also collectively referred to as "user terminal 10".

[0015] The user terminal 10 is a computer (information processing device) used by the user. The user terminal 10 may be a portable information terminal, or may be an installed information terminal such as a PC (Personal Computer) or a game console. The user terminal 10 may or may not be provided with a touch screen. Further, the user terminal 10 may be a head-mounted device (HMD) including AR goggles and AR glasses, or may be a contact-type device that can be worn on the eyes like contact lenses. Hereinafter, the user terminal 10 is a portable terminal provided with a touch screen, and specifically, it will be described as being a smartphone, a tablet, a tablet computer, or the like.

[0016] The user terminal 10 executes a program including, for example, an application program installed via a platform that distributes apps or the like, or software for web browsing pre-installed in advance. Note that the user terminal 10 may execute a program obtained via software for web browsing, that is, a web browser, instead of executing an application program.

[0017] By executing a program such as an application program, the user terminal 10 can generate a virtual space image and output the virtual space image to the display unit. When generating the virtual space image, the user terminal 10 can transmit and receive various data to and from the server 20 as necessary.

[0018] The server 20 appropriately transmits data necessary for generating the virtual space image to the user terminal 10. The server 20 manages various data related to the user. The server 20, for example, receives information regarding the user's operation input from the user terminal 10 and executes processing according to the received information.

[0019] As a hardware configuration, the server 20 includes a communication IF (Interface) 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29, which are connected to each other via a communication bus.

[0020] The communication IF 22 is compatible with various communication standards such as the LAN (Local Area Network) standard, and functions as an interface for transmitting and receiving data to and from external communication devices such as the user terminal 10.

[0021] The input / output IF 23 functions as an interface for receiving input of information to the server 20 and outputting information to the outside of the server 20. The input / output IF 23 includes an input reception unit that receives connections of information input devices such as a mouse and a keyboard, and an output unit that receives connections of information output devices such as a display for displaying images and the like.

[0022] The memory 25 is a storage device for storing data and the like used in the processing in the server 20. The memory 25 provides, for example, a work area for temporary use by the processor 29 when the processor 29 performs processing. The memory 25 is configured to include storage devices such as a ROM (Read Only Memory) and a RAM (Random Access Memory).

[0023] The storage 26 is a storage device for storing various programs and data to be read and executed by the processor 29. The storage 26 is configured to include storage devices such as an HDD (Hard Disk Drive) and a flash memory.

[0024] The processor 29 controls the operation of the server 20 by reading and executing the programs stored in the storage 26. The processor 29 is configured to include, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and the like.

[0025] (Configuration of User Terminal) FIG. 2 is a block diagram showing the functional configuration of the user terminal 10 shown in FIG. 1. As shown in FIG. 2, the user terminal 10 includes an antenna 110, a wireless communication IF 120, a touch screen 130, an input / output IF 140, a storage unit 150, an audio processing unit 160, a microphone 170, a speaker 180, and a control unit 190.

[0026] The antenna 110 radiates the signal emitted by the user terminal 10 into space as radio waves. Also, the antenna 110 receives radio waves from space and supplies the received signal to the wireless communication IF 120.

[0027] The wireless communication IF 120 performs modulation / demodulation processing and the like for transmitting and receiving signals via the antenna 110 and the like in order for the user terminal 10 to communicate with other communication devices. The wireless communication IF 120 is a communication module for wireless communication including a tuner, a high-frequency circuit, etc., performs modulation / demodulation and frequency conversion of the wireless signal transmitted and received by the user terminal 10, and supplies the received signal to the control unit 190.

[0028] The touch screen 130 receives an input from the user and outputs information to the user on the display 132. The touch screen 130 includes a touch panel 131 for receiving an input operation of the user and a display 132 for displaying a menu screen, a virtual space image, etc. on the screen. The touch panel 131 can detect, for example, the approach of the user's finger or the like by using a capacitance type. The display 132 is realized by, for example, an LCD (Liquid Crystal Display), an organic EL (Electroluminescence), or other display devices.

[0029] The input / output IF 140 functions as an interface for receiving an input of information to the user terminal 10 and outputting information to the outside of the user terminal 10.

[0030] The storage unit 150 is composed of a flash memory, a RAM, etc. The storage unit 150 can store various data received by the user terminal 10 from the server 20. The storage unit 150 stores a program 151 that can provide a virtual space image to the user, virtual space information 152, and user information 153.

[0031] The virtual space information 152 includes, for example, information for generating a virtual space. Also, the virtual space information 152 includes, for example, information for generating various virtual objects such as a virtual camera and user objects arranged in the virtual space. Further, the virtual space information 152 includes, for example, arrangement information for arranging various virtual objects in the virtual space. The user information 153 includes, for example, a terminal ID (Identification) for identifying the user terminal 10, user ID information for identifying the user, and the like.

[0032] The audio processing unit 160 performs modulation and demodulation of audio signals. The audio processing unit 160 modulates the signal given from the microphone 170 and gives the modulated signal to the control unit 190. Also, the audio processing unit 160 gives an audio signal to the speaker 180. The audio processing unit 160 is realized by, for example, a processor for audio processing. The microphone 170 functions as an audio input unit for receiving an input of an audio signal and outputting it to the control unit 190. The speaker 180 functions as an audio output unit for outputting an audio signal to the outside of the user terminal 10.

[0033] The control unit 190 controls the operation of the user terminal 10 by reading and executing the program stored in the storage unit 150. The control unit 190 is realized by, for example, a processor such as an application processor.

[0034] The control unit 190 exhibits the functions of an input operation reception unit 191, a transmission / reception unit 192, a space generation unit 193, an arrangement unit 194, a movement control unit 195, an image generation unit 196, and a reproduction unit 197 by reading and executing the program 151. In a certain aspect, the control unit 190 generates a virtual space image while transmitting and receiving various information to and from the server 20.

[0035] Based on the output of the touch screen 130, the input operation reception unit 191 receives the user's input operation. Specifically, the input operation reception unit 191 detects that the user's finger or the like has approached the touch panel 131 as coordinates in the coordinate system composed of the horizontal axis and the vertical axis of the surface constituting the touch screen 130.

[0036] The input operation reception unit 191 discriminates the user's operation on the touch screen 130. Specifically, the input operation reception unit 191 discriminates the user's operations such as so-called "approach operation", "release operation", "tap operation", "double-tap operation", "long-press operation (long-touch operation)", "drag operation (swipe operation)", "move operation", and "flick operation". The user's operations discriminated by the input operation reception unit 191 are not limited to the above. For example, when the touch panel 131 has a mechanism capable of detecting the magnitude of the pressure applied by the user to the touch panel 131, the input operation reception unit 191 discriminates the magnitude of the pressure applied by the user.

[0037] The transmission / reception unit 192 receives various information from the server 20 and also transmits various information to the server 20. The transmission / reception unit 192 receives, for example, at least a part of the virtual space information 252 from the server 20. As an example, the transmission / reception unit 192 receives other user object information regarding other user objects operated by other users from the server 20. The transmission / reception unit 192 transmits, for example, information regarding the movement and other actions of the user object to the server 20.

[0038] The space generation unit 193 refers to the virtual space information 152 and generates a virtual space. The space generation unit 193 also generates virtual objects such as a virtual camera and user objects arranged in the virtual space. The virtual objects generated by the space generation unit 193 may include other user objects operated by other users and screen objects as video playback areas for displaying videos.

[0039] The arrangement unit 194 refers to the arrangement information included in the virtual space information 152 and arranges various virtual objects such as virtual cameras and user objects in the virtual space. The arrangement unit 194 arranges other user objects in the virtual space based on, for example, other user object information. Also, when the arrangement unit 194 arranges a screen object in the virtual space, a trigger area for starting video playback may be set on the screen object in the virtual space. Further, the arrangement unit 194 moves other user objects and other virtual objects based on information transmitted from the server 20 and the like.

[0040] The movement control unit 195 moves the user object in the virtual space based on the performance of a movement operation (hereinafter also simply referred to as "movement operation") for moving the user object. The movement control unit 195 interprets the instruction content of the user based on, for example, the coordinates of the input position of the input operation received by the input operation reception unit 191 and the type of the operation, and moves the user object based on the interpretation.

[0041] The image generation unit 196 generates a virtual space image, which is an image of the virtual space captured from the virtual camera based on the virtual camera. The virtual space image generated by the image generation unit 196 is output to the touch screen 130 and displayed on the display 132.

[0042] When no movement operation is being performed, the virtual camera is controlled in position so that the virtual space image is an image from the first-person perspective of the user object. Therefore, when no movement operation is being performed, the virtual space image generated by the image generation unit 196 is an image from the first-person perspective of the user object. Here, the "first-person perspective" is a perspective for the user to take the position of the user object, and is, for example, the position of the perspective of the user object or a perspective from the vicinity of the position. The image from the first-person perspective may include, for example, a part of the body excluding the head of the user object (such as an arm or a leg) or possessions of the user object.

[0043] On the other hand, when a movement operation is being performed, the virtual camera is controlled in position such that the virtual space image becomes an image from a third-person perspective that includes at least a part of the user object. Thus, when a movement operation is being performed, the virtual space image generated by the image generation unit 196 is an image from a third-person perspective of the user object. Here, the "third-person perspective" means a perspective at a position away from the user object. Preferably, the third-person perspective is a perspective at a position that includes at least the head of the user object within the field of view. When the user object is riding on another virtual object such as a vehicle, etc., the head of the user object may not be included in the image from the third-person perspective.

[0044] When no movement operation is being performed, the image generation unit 196 preferably generates a virtual space image with at least a part of the user object hidden. That is, when no movement operation is being performed, it is preferable to generate a virtual space image after performing a transparency process of making a part or all of the user object transparent or semi-transparent. When a part of the user object is made transparent or semi-transparent, the remaining part may be opaque. Also, the transparency may vary depending on the part of the user object. Note that the user object may be opaque when no transparency process is performed.

[0045] As described above, the virtual space image generated by the image generation unit 196 is changed from an image from a first-person perspective to an image from a third-person perspective when the movement operation is started, and is changed from an image from a third-person perspective to an image from a first-person perspective when the movement operation ends. In order to make it less likely for the user to feel discomfort during such a perspective change, the image generation unit 196 preferably performs a process for reducing the discomfort.

[0046] As a process for reducing discomfort, for example, when a movement operation for moving the user object in the direction in which the virtual camera is facing is started, the image generation unit 196 moves the user object until the distance between the user object and the virtual camera reaches a predetermined first distance, and generates a virtual space image without moving the virtual camera. After the distance between the user object and the virtual camera reaches the first distance, a process of generating a virtual space image by moving the virtual camera in conjunction with the movement of the user object may be performed.

[0047] Here, the "direction in which the virtual camera is facing" is, for example, the backside direction toward the back of the virtual space with reference to the virtual space image displayed on the display 132. Also, the "first distance" is not particularly limited, but is preferably, for example, the distance between the position of the virtual camera in the first-person view and the position of the virtual camera in the third-person view.

[0048] Also, as a process for reducing discomfort, for example, when a movement operation for moving the user object in the direction opposite to the direction in which the virtual camera is facing is started, the image generation unit 196 moves the user object until the distance between the user object and the virtual camera reaches a predetermined second distance, and moves the virtual camera in the opposite direction at a movement speed faster than the movement speed of the user object to generate a virtual space image. After the distance between the user object and the virtual camera reaches the second distance, the user object is moved based on the movement operation, and a process of generating a virtual space image by moving the virtual camera at the same movement speed as the movement speed of the user object in conjunction with the movement of the user object may be performed.

[0049] Here, the "direction opposite to the direction the virtual camera is facing" is, for example, the front-side direction that heads toward the front side of the virtual space with reference to the virtual space image displayed on the display 132. Also, the "second distance" is not particularly limited, but for example, it is preferably the distance between the position of the virtual camera in the case of a first-person viewpoint and the position of the virtual camera in the case of a third-person viewpoint. The second distance may be the same as or different from the first distance.

[0050] In addition, when a movement operation to move the user object in the lateral direction is started, basically, the same processing as in the case where the movement operation is in the front-side direction may be performed. Specifically, while the virtual camera moves in the front-side direction, it follows the lateral movement of the user object, and after the distance between the virtual camera and the user object reaches a predetermined second distance, the user object is moved based on the movement operation, and the virtual camera is moved in the same direction as the movement direction of the user object and at the same movement speed as the movement speed of the user object so as to be linked to the movement of the user object to generate a virtual space image.

[0051] Also, as a process for reducing discomfort, the image generation unit 196 may perform a fade-in process on the user object from a transparent state to an opaque state to generate a virtual space image until a predetermined time (for example, about 1 second) elapses from the start of the movement of the user object. That is, when changing from a first-person viewpoint to a third-person viewpoint, a process may be performed in which the user object gradually appears while reducing the transparency from a transparent state. Note that the fade-in process may be a process of changing from a transparent state to a semi-transparent state or from a semi-transparent state to an opaque state.

[0052] Also, as a process for reducing discomfort, the image generation unit 196 may generate a virtual space image by performing a fade-out process on the user object from an opaque state to a transparent state until a predetermined time (for example, about 1 second) elapses after the movement of the user object ends. That is, when changing from the third-person view to the first-person view, a process may be performed such that the user object gradually becomes invisible while continuously increasing the transparency from the opaque state. Note that the fade-out process may be a process of changing from opaque to semi-transparent or from semi-transparent to transparent.

[0053] Also, as a process for reducing discomfort, the image generation unit 196 may execute a process of reducing the visibility of the virtual space image until a predetermined time elapses from the start of the movement operation. The process of reducing the visibility is not particularly limited, and examples thereof include a fade-to-black process and a blur process. The image generation unit 196 may perform the same process as described above until a predetermined time elapses from the end of the movement operation.

[0054] The playback unit 197 plays back a video in the video playback area, for example, when the user object is located in the trigger area arranged in the virtual space. Also, the playback unit 197 plays back the video in full-screen display, for example, when an operation of selecting the video playback area is performed. Note that the playback unit 197 may be configured to be able to play back the video in response to an input operation for playing back the video regardless of the trigger area.

[0055] (Configuration of Server) FIG. 3 is a block diagram showing a functional configuration of the server 20 shown in FIG. 1. With reference to FIG. 3, the detailed configuration of the server 20 will be described. The server 20 functions as a communication unit 220, a storage unit 250, and a control unit 290 by operating according to the program 251.

[0056] The communication unit 220 functions as an interface for the server 20 to communicate with an external communication device such as the user terminal 10 via the network 30.

[0057] The storage unit 250 stores various programs and data for operating the server 20. In a certain aspect, the storage unit 250 stores the program 251, the virtual space information 252, and the user information 253.

[0058] The program 251 is a program for providing a virtual space image to the user via the user terminal 10. The program 251 executes various processes on the server 20 side for providing a virtual space image to the user, for example, by referring to the virtual space information 252, the user information 253, and the like.

[0059] The virtual space information 252 includes, for example, information for generating a virtual space and information for generating various virtual objects arranged in the virtual space. At least a part of the virtual space information 252 is information that is the basis of the virtual space information 152. The virtual space information 252 may include information regarding the position and actions of each user object in the virtual space. Also, the virtual space information 252 may include information regarding a video.

[0060] The user information 253 is information regarding each user of each user terminal 10. The user information 253 includes, for example, information for identifying the user terminal 10 or the user of the user terminal 10 and other information.

[0061] By executing the program 251 stored in the storage unit 250, the control unit 290 functions as the transmission / reception unit 291, the server processing unit 292, the data management unit 293, and the timing unit 294.

[0062] The transmission / reception unit 291 receives various information from the user terminal 10 and also transmits various information to the user terminal 10. The user terminal 10 and the server 20 transmit and receive, for example, information regarding the generation of a virtual space and virtual objects, information regarding the movement and other actions of user objects, information regarding the playback of a video, and the like.

[0063] The server processing unit 292 performs various processes necessary in the server 20 to provide a virtual space to the user via the user terminal 10. The server processing unit 292 instructs the transmission / reception unit 291 to transmit various data in response to various requests from the user terminal 10 received by the transmission / reception unit 291. Further, the server processing unit 292 instructs the data management unit 293 to update various data based on various calculation results by the server processing unit 292.

[0064] The data management unit 293 performs a process of adding, deleting, or updating various data stored in the storage unit 250 based on an instruction from the server processing unit 292. The timing unit 294 performs a process of measuring time. Further, the timing unit 294 executes a process of synchronizing information regarding various times in a plurality of user terminals 10, for example.

[0065] (Operation example of the program) Next, with reference to FIGS. 4 to 15, an operation example in the program according to the first embodiment of the present disclosure will be described. Each process described hereinafter is realized by the control unit 190 executing the program 151 and the control unit 290 executing the program 251, respectively. Note that the order of each process constituting each flowchart described in this specification may be arbitrary as long as there is no contradiction or inconsistency in the processing content, and they may be executed in parallel. Also, a part of the processes constituting each flowchart described in this specification may be omitted.

[0066] FIG. 4 is a flowchart showing an example of a process related to the provision of a virtual space according to the first embodiment of the present disclosure. First, in step S410, the control unit 190 refers to the virtual space information 152 and generates a virtual space. Similarly, the control unit 190 generates virtual objects including a virtual camera and user objects. In generating the virtual space and virtual objects, the control unit 190 may receive various information such as virtual space information 252 from the server 20 as necessary.

[0067] In step S420, the control unit 190 refers to the arrangement information included in the virtual space information 152 and arranges virtual objects in the virtual space. The initial position of the virtual camera is, for example, the viewpoint position of the user object.

[0068] In step S430, the control unit 190 performs a process of making at least a part of the user object non-displayed. In step S430, for example, a transparency process of increasing the transparency of a part or all of the user object to make it transparent is executed.

[0069] In step S440, the control unit 190 generates a virtual space image from the first-person perspective. The control unit 190, for example, displays the virtual space image on the display 132. The virtual space image is an image based on the virtual camera and is an image captured from within the virtual space by the virtual camera. The orientation of the virtual camera can be changed based on an input operation for changing the orientation of the virtual camera by the user. Also, the position of the virtual camera can be changed according to the movement of the user object.

[0070] When the control unit 190 does not detect a movement operation by the user ( "No" in step S450), the first-person perspective is maintained, and a series of processes are terminated according to, for example, receiving an input operation for ending the program 151.

[0071] On the other hand, when the control unit 190 detects a movement operation by the user ( "Yes" in step S450), in step S460, the control unit 190 performs a process of changing to the third-person perspective. The process of step S460 will be described in detail in a later paragraph. Note that when the control unit 190 detects a movement operation by the user, information for specifying the position of the user object after the movement can be transmitted to the server 20 as necessary.

[0072] In step S470, the control unit 190 moves the user object. Also, in step S470, the control unit 190 moves the virtual camera at the same moving speed as the user object so as to be linked with the movement of the user object. That is, in step S470, the user object and the virtual camera move while maintaining their relative positional relationship.

[0073] If the control unit 190 does not detect the end of the movement operation (``No'' in step S480), the process returns to step S470, and the process of moving the user object and the virtual camera is continued.

[0074] On the other hand, when the control unit 190 detects the end of the movement operation by the user (``Yes'' in step S480), in step S490, the control unit 190 performs the process of changing to the first-person view point, and ends the series of processes according to receiving an input operation for ending the program 151 or the like. The process of step S490 will be described in detail in a later paragraph.

[0075] Hereinafter, with reference to FIGS. 5 and 6, the virtual space and the virtual space image generated in the series of processes shown in FIG. 4 will be described. FIG. 5 is a schematic diagram showing an example of a virtual space 501 according to the first embodiment of the present disclosure. In FIGS. 5(a) and 5(b), the virtual space 501 is provided with a user object 502, a virtual camera 503, a pillar object 504, and link regions 505a to 505c.

[0076] The user object 502 is an object that can be operated by the user, for example, the user's avatar. The virtual camera 503 is a virtual object that images the virtual space 501. The pillar object 504 is a virtual object fixedly arranged in the virtual space 501. The link regions 505a to 505c are regions linked to other virtual spaces. The user can move the user object 502 to other virtual spaces by moving the user object 502 to the link regions 505a to 505c.

[0077] Figure 5(a) shows the case where the virtual space image is generated from the first-person perspective. That is, Figure 5(a) is an example when no movement operation is performed. In Figure 5(a), the virtual camera 503 is at the viewpoint position of the user object 502. Also, the user object 502 is shown by a dashed line, which indicates that the user object 502 is transparent.

[0078] Figure 5(b) shows the case where the virtual space image is generated from the third-person perspective. That is, Figure 5(b) is an example when a movement operation is performed. In Figure 5(b), the virtual camera 503 is at a position away from the user object 502. Also, the user object 502 is shown by a solid line, which indicates that the user object 502 is opaque.

[0079] Figure 6 is a schematic diagram showing an example of a display screen according to the first embodiment of the present disclosure. Specifically, Figure 6(a) shows the display screen when the virtual space 501 is in the state of Figure 5(a). Figure 6(b) shows the display screen when the virtual space 501 is in the state of Figure 5(b).

[0080] In Figure 6(a), a virtual space image when the virtual space 501 is viewed from the first-person perspective is displayed on the display 132. In Figure 6(a), since the user object 502 is transparent, it is not displayed.

[0081] In addition, in Fig. 6(a), the operator 601 is shown by a dashed line. The operator 601 is a virtual roller displayed to receive an input of a moving operation for moving the user object 502. For example, the user can move the user object 502 in the dragged direction by dragging the circular portion at the center of the operator 601. The operator 601 is an example, and other shapes and input modes may be adopted. From the viewpoint of enhancing the visibility of the virtual space 501, it is preferable that the operator 601 is in a completely transparent state or a state with high transparency but visible until it receives the user's moving operation.

[0082] In the following description, the term "the direction in which the virtual camera faces" or "the backside direction" refers to the direction indicated by the arrow A in Fig. 6(a). Also, the moving operation in the "direction in which the virtual camera faces" or "the backside direction" means that the circular portion is dragged to the area located above the line segment l that divides the operator 601 into upper and lower parts (the arrow A direction side). Further, the term "the direction opposite to the direction in which the virtual camera faces" or "the front side direction" refers to the direction indicated by the arrow B in Fig. 6(a). Also, the moving operation in the "direction opposite to the direction in which the virtual camera faces" or "the front side direction" means that the circular portion is dragged to the area located below the line segment l that divides the operator 601 into upper and lower parts (the arrow B direction side).

[0083] In Fig. 6(b), a virtual space image when the virtual space 501 is viewed from a third-person perspective is displayed on the display 132. In Fig. 6(b), the substantially entire body of the user object 502 is displayed in an opaque state. In a certain situation, the user object 502 may be displayed in a semi-transparent state or at least a part thereof may be displayed in a transparent state.

[0084] In Fig. 6(b), since a moving operation in the back side direction is being performed, the user object 502 is moving in the back side direction. Also, in order to indicate that a moving operation in the back side direction is being performed, the circular portion of the operator 601 is located in the back side direction. Further, in response to the moving operation being performed, the operator 601 is in a state with lower transparency than in the case of Fig. 6(a). During the moving operation, the operator 601 may be opaque, but from the viewpoint of enhancing the visibility of the virtual space 501, it is preferably semi-transparent or transparent.

[0085] Hereinafter, with reference to Fig. 7, the change process to the third-person view point in step S460 of Fig. 4 will be described in detail. In step S461, the control unit 190 starts the fade-in process of the user object 502. By the fade-in process, the transparency of the user object 502 is continuously or stepwise decreased. The fade-in process is completed within, for example, about 1 second after the start of the moving operation. The fade-in process is preferably executed in parallel with a series of processes such as steps S463 to S465 or steps S466 to S468 described later, and starts and ends at the same timing as these series of processes. Note that the fade-in process may be omitted and the view point may be instantaneously switched from the first-person view point to the third-person view point.

[0086] If the moving operation detected in step S450 of Fig. 4 is a moving operation in the back side direction (Yes in step S462), the process proceeds to step S463. In step S463, the control unit 190 moves the user object 502 without moving the virtual camera 503. The direction in which the user object 502 moves is the back side direction specified by the moving operation.

[0087] If the distance between the user object 502 and the virtual camera 503 is less than a predetermined first distance (No in step S464), the process of step S463 is continued.

[0088] When the distance between the user object 502 and the virtual camera 503 becomes equal to or greater than a predetermined first distance (Yes in step S464), in step S465, the control unit 190 moves the virtual camera 503 together with the user object 502. In step S465, for example, the virtual camera 503 is moved so as to be linked (follow) to the movement of the user object 502.

[0089] Here, with reference to FIG. 8, the processes of steps S463 to S465 shown in FIG. 7 will be described in detail. FIG. 8 is a schematic diagram showing the positional relationship between the user object 502 and the virtual camera 503 according to the first embodiment of the present disclosure. Specifically, FIG. 8 shows changes in the positional relationship between the user object 502 and the virtual camera 503 when a moving operation in the back side direction is performed.

[0090] FIG. 8(a) shows the state immediately before the moving operation is performed. In FIG. 8(a), the user object 502 and the virtual camera 503 exist at the point P1. Further, since the user object 502 is in a transparent state, it is shown by a dotted line. Similar to FIG. 6, the direction of arrow A in FIG. 8(a) is the back side direction, and the direction of arrow B in FIG. 8(a) is the front side direction.

[0091] FIG. 8(b) shows the state after the process of step S463, where the distance d1 between the user object 502 and the virtual camera 503 is less than the first distance. In FIG. 8(b), the user object 502 is moving in the back side direction based on the moving operation. On the other hand, the virtual camera 503 does not move and still remains at the point P1.

[0092] Note that the fade-in process is started, and the user object 502 is in a state where its transparency is lower than that in the state of FIG. 8(a). Therefore, in FIG. 8(b), the user object 502 is shown by a solid line.

[0093] Fig. 8(c) shows a state where the distance d2 between the user object 502 and the virtual camera 503 has reached the first distance. In Fig. 8(c), the user object 502 has reached point P2. On the other hand, the virtual camera 503 does not move and still remains at point P1. At this point, it is preferable that the fade-in process has been completed.

[0094] Fig. 8(d) shows a state where the distance d2 between the user object 502 and the virtual camera 503 has reached the first distance and the process of step S465 has been performed. In Fig. 8(d), the user object 502 is moving in the back side direction of point P2. Also, the virtual camera 503 is moving in the back side direction of point P1. As long as the movement operation continues, the virtual camera 503 moves in conjunction with the movement of the user object 502 while maintaining the distance d2.

[0095] Note that the content described with reference to Fig. 8 may also be applied when the movement operation is not in the back side direction. That is, regardless of the direction of the movement operation, the processes of steps S463 to 465 may be executed. When configured in this way, when the movement operation is not in the back side direction, in step S463, it is preferable to move the virtual camera 503 and not move the user object 502.

[0096] Returning to the description of Fig. 7. When the movement operation detected in step S450 of Fig. 4 is not a movement operation in the back side direction (in step S462, "No"), the process proceeds to step S466. The case where "No" is determined in step S462 is a case where a movement operation in the front side direction is performed, and may include a case where a complete movement operation in the left - right direction (the direction on the line segment l shown in Fig. 6) is performed.

[0097] In step S466, the control unit 190 moves both the user object 502 and the virtual camera 503. In step S466, the moving speed of the virtual camera 503 is greater than that of the user object 502. Also, the direction in which the user object 502 moves is the direction specified by the movement operation. The direction in which the virtual camera 503 moves is, for example, the direction obtained by synthesizing the direction specified by the movement operation with the downward direction (the direction orthogonal to the line segment l shown in FIG. 6).

[0098] When the distance between the user object 502 and the virtual camera 503 is less than a predetermined second distance (''No'' in step S467), the process of step S466 is continued.

[0099] Then, when the distance between the user object 502 and the virtual camera 503 becomes equal to or greater than the predetermined second distance (''Yes'' in step S467), in step S468, the control unit 190 moves the user object 502 and the virtual camera 503 in the same moving direction at the same moving speed. In step S468, for example, the virtual camera 503 is moved so as to be linked (follow) to the movement of the user object 502. With the process of step S465 or step S468, the process of changing to the third-person view is completed, and the process proceeds to step S470 in FIG. 4.

[0100] Here, with reference to FIG. 9, the processes of steps S466 to S468 will be described in detail. FIG. 9 is a schematic diagram showing the positional relationship between the user object 502 and the virtual camera 503 according to the first embodiment of the present disclosure. Specifically, FIG. 9 shows the change in the positional relationship between the user object 502 and the virtual camera 503 when a movement operation is performed in a direction other than the back side direction.

[0101] Fig. 9(a) shows the state immediately before the movement operation. In Fig. 9(a), the user object 502 and the virtual camera 503 exist at point P3. Similar to Fig. 6, the direction of arrow A in Fig. 9(a) is the back side direction, and the direction of arrow B in Fig. 9(a) is the front side direction. Also, since the content explained in Fig. 8 can be applied to the fade-in process, it is omitted.

[0102] Fig. 9(b) shows the state after the process of step S466, where the distance d4 between the user object 502 and the virtual camera 503 is less than the second distance. In Fig. 9(b), the user object 502 and the virtual camera 503 are moving in the front side direction based on the movement operation. In the example of Fig. 9, the direction of the movement operation is directly downward.

[0103] In the state of Fig. 9(b), the moving speed of the virtual camera 503 is greater than that of the user object 502. Therefore, the moving distance d4 of the virtual camera 503 is greater than the moving distance d3 of the user object 502.

[0104] Fig. 9(c) shows the state where the distance d8 between the user object 502 and the virtual camera 503 has reached the second distance. In Fig. 9(c), the virtual camera 503 has reached point P4, and the user object 502 has not reached point P4. That is, even at this stage, the moving distance d7 of the virtual camera 503 is greater than the moving distance d6 of the user object 502.

[0105] Fig. 9(d) shows the state where the distance d8 between the user object 502 and the virtual camera 503 has reached the second distance and the process of step S468 has been performed. In Fig. 9(d), since the direction of the movement operation has been changed to the right direction, the user object 502 and the virtual camera 503 are moving to the right of point P4.

[0106] In this way, even if the direction of the movement operation changes, as long as the movement operation continues, the virtual camera 503 moves at the same movement speed in conjunction with the movement of the user object 502 while maintaining the distance d8. The same applies to step S465.

[0107] Note that the content described with reference to FIG. 9 may also be applied when the movement operation is in the back direction. That is, regardless of the direction of the movement operation, the processes of steps S466 to S468 may be executed. When configured in this way, when the movement operation is in the back direction, in step S466, it is preferable to make the movement speed of the virtual camera 503 smaller than the movement speed of the user object 502.

[0108] Hereinafter, with reference to FIG. 10, the process of changing to the first-person view in step S490 of FIG. 4 will be described in detail. In step S491, the control unit 190 ends the movement of the user object 502. Also, in step S492, the control unit 190 starts the fade-out process of the user object 502.

[0109] By the fade-out process, the transparency of the user object 502 is increased continuously or stepwise. The fade-out process is completed within, for example, about 1 second after the movement operation ends. The fade-out process is preferably executed in parallel with the processes of steps S491, S493, and S494 described later, and starts and ends at the same timing as at least a part of these processes. Note that the fade-out process may be omitted and the viewpoint may be instantaneously switched from the third-person view to the first-person view.

[0110] In step S493, as a process for reducing the visibility of the user, the control unit 190 executes, for example, a fade-to-black process or a blur process. Note that a process similar to step S493 may be executed in the process of changing to the third-person view in step S460.

[0111] In step S494, the control unit 190 moves the virtual camera 503 to the viewpoint position of the user object 502. From the viewpoint of reducing the discomfort felt by the user, it is preferable that the virtual camera 503 is moved at a speed similar to the moving speed of the user object 502 immediately before the end of the moving operation.

[0112] Here, with reference to FIG. 11, a case where there are other user objects operated by other users in the virtual space 501 will be described. FIG. 11 is a schematic diagram showing an example of a display screen according to the first embodiment of the present disclosure. In the example of FIG. 11, the virtual space 501 is a space imitating a concert venue. FIG. 11 is, for example, a virtual space image when viewing the auditorium side from the stage direction of the concert venue.

[0113] The virtual space image displayed on the display 132 includes an arena area 1101, a seat object 1102, and other user objects 1103 and 1104. The arena area 1101 is an area where multiple user objects can communicate with each other. The seat object 1102 is a virtual object fixedly arranged in the virtual space 501.

[0114] The other user objects 1103 and 1104 operated by other users are displayed on the display 132 of the user who operates the user object 502 regardless of whether there is a moving operation by other users. For example, although the other user object 1103 is standing still and not moving, it is displayed on the display 132. Note that on the display of the user who operates the other user object 1103, the other user object 1103 is not displayed.

[0115] Here, in FIG. 11, a virtual space image generated from the first-person viewpoint is displayed. That is, no moving operation is input to the operator 601 displayed on the display 132, and the user object 502 is in a transparent state. However, on the displays of other users, the user object 502 is not transparent and is in a displayed state.

[0116] The other user object 1104 is a moving object. When an operation is performed by the user of the other user object 1104 to move or perform other actions on the other user object 1104, information for specifying the position or other actions of the other user object 1104 after the movement is transmitted to the user terminal 10 of the user of the user object 502 via the server 20. Based on the information, the control unit 190 controls the movement and actions of the other user object 1104 in the virtual space 501.

[0117] Hereinafter, the processing related to video playback when a video playback area for playing a video is provided in the virtual space 501 will be described. FIG. 12 is a flowchart showing an example of the processing related to video playback according to the first embodiment of the present disclosure.

[0118] First, in step S1210, the control unit 190 arranges a video playback area (for example, a screen object) in the virtual space 501. Also, in step S1220, the control unit 190 sets a trigger area in the virtual space 501. The trigger area is preferably set in the vicinity of the video playback area.

[0119] When the user object 502 does not enter the trigger area (No in step S1230), a series of processes are terminated in response to receiving an input operation for ending the program 151 or the like.

[0120] When the user object 502 enters the trigger area due to a movement operation (Yes in step S1230), in step S1240, the control unit 190 starts playing the video in the video playback area. The video playback format may be a streaming format in which video information is acquired from the server 20 each time, or a download format in which video information is downloaded in advance to the storage unit 150. The video playback is preferably accompanied by audio output.

[0121] It is preferable that the video playback in the video playback area where the trigger area is set is not synchronized with other users. That is, when the user object 502 has not entered the trigger area, even if another user object of another user has entered the trigger area, it is preferable not to start video playback in the video playback area corresponding to the trigger area. In this case, the video will be played on the display 132 of other users.

[0122] Note that for some videos, the video playback may be synchronized with other users. Some videos are not particularly limited, but for example, they are content that is being implemented, broadcast, or distributed in real time (such as a sports game, etc.). With such a configuration, the video can be enjoyed with a sense of unity with other users.

[0123] When a selection operation (such as a tap operation or a double - tap operation) for selecting a video playback area is performed (Yes in step S1250), in step S1260, the control unit 190 displays the video being played in the selected video playback area in full screen. The process in step S1250 continues until an end condition is satisfied, such as an operation for ending the full - screen display is performed. When the end condition is satisfied, the playback returns to the playback in the video playback area.

[0124] When a selection operation for selecting a video playback area is not performed (No in step S1250), the playback in the video playback area continues. Also, when the user object 502 has not moved outside the trigger area (No in step S1270), the playback in the video playback area continues.

[0125] When the user object 502 moves outside the trigger area (Yes in step S1270), in step S1280, the control unit 190 stops the reproduction of the video in the video reproduction area. Also, in step S1290, the control unit 190 stores the stop position where the reproduction in the video has stopped. When the user object 502 enters the trigger area again, referring to the stored stop position, the reproduction of the video can be started from the previous continuation.

[0126] Hereinafter, with reference to FIGS. 13 to 15, the processing related to video reproduction will be described in detail. FIG. 13 is a schematic diagram showing an example of the virtual space 501 according to the first embodiment of the present disclosure. In the example of FIG. 13, a user object 502, and screen objects 1301a and 1301b are arranged in the virtual space 501, and trigger areas 1302a and 1302b are set.

[0127] The screen objects 1301a and 1301b are an example of a video reproduction area, and are, for example, virtual objects imitating the shape of a screen. The videos reproduced on the screen objects 1301a and 1301b are different from each other.

[0128] The trigger area 1302a is an area corresponding to the screen object 1301a, and the trigger area 1302b is an area corresponding to the screen object 1301b. For example, when the user object 502 enters the trigger area 1302a, the reproduction of the video starts on the screen object 1301a.

[0129] FIG. 14 is a schematic diagram showing an example of the display screen according to the first embodiment of the present disclosure. FIG. 14(a) is a diagram showing a state where the user object 502 is moving within the trigger area 1302a. Based on the user object 502 being located within the trigger area 1302a, the video is being reproduced on the screen object 1301a. Note that in FIG. 14(a), since a movement operation is being performed, the virtual space image displayed on the display 132 is based on a third-person perspective.

[0130] Figure 14(b) is a diagram showing a state where the user object 502 has stopped within the trigger area 1302a. Based on the user object 502 being located within the trigger area 1302a, in the screen object 1301a, the playback of the video continues. Also, in Figure 14(b), since no movement operation is being performed, the virtual space image displayed on the display 132 is changed to be based on a first-person perspective, and the user object 502 is not displayed.

[0131] In the state of Figure 14(a), a part of the screen object 1301a is hidden by the user object 502 and cannot be visually recognized, but by changing to a first-person perspective as in Figure 14(b), the user can visually recognize all of the screen object 1301a.

[0132] Figure 15 is a schematic diagram showing an example of a display screen when the video according to the first embodiment of the present disclosure is displayed in full screen. Figure 15 is, for example, an example when a tap operation is performed on the screen object 1301a in the state shown in Figure 14(b).

[0133] In the example of Figure 15, the video that was being played on the screen object 1301a in the state of Figure 14(b) is displayed in full screen on the display 132. Also, at the bottom of the display 132, a pause button 1501, a fast forward button 1502, a rewind button 1503, and a seek bar 1504 are displayed. These buttons are an example of a video operation UI (User Interface). It is preferable that these operation UIs become transparent after a certain period of time. In the example of Figure 15, when displaying in full screen, the orientation of the display 132 is changed from portrait to landscape, but it is also possible to display in full screen while remaining in portrait orientation. When the end condition for full screen display is satisfied in the state of Figure 15, for example, it returns to the state shown in Figure 14(b).

[0134] Note that the image generation unit 196 is not limited to a configuration that switches the virtual space image between the first-person perspective image and the third-person perspective image according to the presence or absence of the movement operation of the user object 502, and may be configured to perform the switching when other predetermined conditions are satisfied.

[0135] For example, assume that the user object 502 overlaps another object in the virtual space image. In this case, regardless of the presence or absence of the movement operation of the user object 502, the image generation unit 196 may determine that a predetermined condition is satisfied and switch the virtual space image from the third-person perspective image to the first-person perspective image.

[0136] Also, for example, assume that the user object 502 has moved to a specific area in the virtual space image. In this case, regardless of the presence or absence of the movement operation of the user object 502, the image generation unit 196 may determine that a predetermined condition is satisfied and switch the virtual space image from the first-person perspective image to the third-person perspective image.

[0137] The content according to the first embodiment of the present disclosure is listed as follows.

[0138] (Item 1-1) A program executed by a first computer including a processor and a memory, wherein the program causes the processor to generate a virtual space; place a virtual camera and a user object in the virtual space; generate a virtual space image, which is an image of the virtual space captured from the virtual camera based on the virtual camera; move the user object in the virtual space based on the fact that a movement operation for moving the user object has been performed; and in the step of generating the virtual space image, When the moving operation is not being performed, the virtual camera controls its position such that the virtual space image becomes an image from the first-person perspective of the user object. When the moving operation is being performed, the virtual camera controls its position such that the virtual space image becomes an image from the third-person perspective that includes at least a part of the user object. Program. This can make it less likely to cause motion sickness and can suppress a decrease in the sense of immersion in the virtual space and visibility within the virtual space. Specifically, when the user object is moving, it becomes a third-person perspective in which the user object is displayed, so it is less likely to cause motion sickness than in the first-person perspective. Also, when the user object is not moving, it becomes a first-person perspective, so the sense of immersion in the virtual space is improved and the visibility within the virtual space is improved compared to the third-person perspective. In addition, since the switching between the first-person perspective and the third-person perspective is automatically made based on the presence or absence of the moving operation, the convenience for the user is improved.

[0139] (Item 1-2) When the moving operation is not being performed, in the step of generating the virtual space image, the virtual space image is generated with at least a part of the user object being made non-displayed. The program according to Item 1-1. This can improve the visibility of the user in the first-person perspective. Also, by making the entire user object transparent, it is possible to suppress a display that is not possible in reality, such as the interior of the user object being displayed by the virtual camera.

[0140] (Item 1-3) When a moving operation to move the user object in the direction the virtual camera is facing is started, in the step of generating the virtual space image, until the distance between the user object and the virtual camera reaches a predetermined first distance, the user object is moved and the virtual space image is generated without moving the virtual camera. After the distance between the user object and the virtual camera reaches a predetermined first distance, the virtual camera is moved in conjunction with the movement of the user object to generate the virtual space image. The program according to item 1-1 or item 1-2. This can make it less likely for the user to feel discomfort when changing from the first-person perspective to the third-person perspective.

[0141] (Item 1-4) When a movement operation to move the user object in a direction opposite to the direction in which the virtual camera is facing is started, in the step of generating the virtual space image, Until the distance between the user object and the virtual camera reaches a predetermined second distance, the user object is moved, and the virtual camera is moved in the opposite direction at a movement speed faster than the movement speed of the user object to generate the virtual space image. After the distance between the user object and the virtual camera reaches a predetermined second distance, the user object is moved based on the movement operation, and the virtual camera is moved at the same movement speed as the movement speed of the user object in conjunction with the movement of the user object to generate the virtual space image. The program according to any one of items 1-1 to 1-3. This can make it less likely for the user to feel discomfort when changing from the first-person perspective to the third-person perspective.

[0142] (Item 1-5) In the step of generating the virtual space image, Until a predetermined time elapses from the start of the movement of the user object, the user object is faded in from transparent to opaque to generate the virtual space image. Until a predetermined time elapses from the end of the movement of the user object, the user object is faded out from opaque to transparent to generate the virtual space image. The program according to any one of items 1-1 to 1-4. This can make it difficult for the user to feel discomfort before and after the viewpoint change.

[0143] (Item 1-6) In the step of generating the virtual space image, a process of reducing the visibility of the virtual space image is executed until a predetermined time elapses from at least one of the start and end of the movement operation. The program according to any one of items 1-1 to 1-5. This can make it difficult for the user to feel discomfort before and after the viewpoint change. Also, it becomes possible to further suppress motion sickness.

[0144] (Item 1-7) The arranging step further includes arranging a video playback area in the virtual space. In the virtual space, a trigger area for starting the playback of a video is set in the video playback area. The program further causes the processor to When the user object is located in the trigger area, execute the step of playing the video in the video playback area. The program according to any one of items 1-1 to 1-6. As a result, when the user object is located within the trigger area, the video can be automatically played, and when the user object exits the trigger area, the video can be automatically stopped. Therefore, the convenience of the user can be improved. Also, it can be recognized that a video can be viewed within the virtual space, and it becomes easier to determine whether the video is interesting. For example, in the case where a 360-degree space is expanded, if there is no video playback area in the viewpoint in the traveling direction, it is difficult to notice the video. Therefore, it is possible to recognize that video viewing is possible, especially with the accompaniment of sound, through the automatic playback of the video. Also, since the program of item 1-7 assumes a first-person viewpoint when no movement operation is being performed, the visibility of the video can be improved.

[0145] (Item 1-8) When an operation to select the video playback area is performed, in the step of playing back, the video is played back in full-screen display. The program according to Item 1-7. Thereby, the visibility of the video can be further improved. Also, the operability during video viewing can be improved. If the operation UI is arranged within the video playback area, it becomes difficult to select the operation UI depending on the angle at which the virtual camera is facing and the distance from the video playback area. However, by switching to full-screen display, these problems can be solved, and the operability during video viewing can be improved.

[0146] (Item 1-9) The first computer can be communicatively connected to a second computer. The program further causes the processor to execute a step of receiving, from the second computer, other user object information regarding an other user object operated by another user different from the user of the first computer. The step of arranging further includes arranging the other user object in the virtual space based on the other user object information. The program according to any one of Items 1-1 to 1-8. Thereby, communication with other users can be realized. Also, the program of Item 1-9 is configured to use a first-person perspective when no movement operation is being performed as a premise, so the immersion during communication with other users and the visibility of other user objects can be improved. Also, the program of Item 1-9 is configured to use a third-person perspective when a movement operation is being performed as a premise, so the positional relationship between one's own user object and other user objects can be easily grasped, and as a result, it becomes easier to move one's own user object to a desired position.

[0147] (Item 1-10) A method executed by a computer comprising a processor and a memory, wherein: the method causes the processor to: generate a virtual space; place a virtual camera and a user object in the virtual space; generate a virtual space image, which is an image of the virtual space captured from the virtual camera based on the virtual camera; move the user object within the virtual space based on a movement operation being performed to move the user object; and in the step of generating the virtual space image, when the movement operation has not been performed, the virtual camera is controlled to be positioned such that the virtual space image is a first-person view image of the user object; when the movement operation has been performed, the virtual camera is controlled to be positioned such that the virtual space image is a third-person view image including at least a part of the user object. Method. This can make it difficult to cause motion sickness and suppress a sense of immersion in the virtual space and a decrease in visibility within the virtual space.

[0148] (Item 1-11) An information processing apparatus comprising a processor and a memory, wherein: the processor: generates a virtual space; places a virtual camera and a user object in the virtual space; generates a virtual space image, which is an image of the virtual space captured from the virtual camera based on the virtual camera; moves the user object within the virtual space based on a movement operation being performed to move the user object; and the generation of the virtual space image When the movement operation is not performed, the virtual camera is positioned such that the virtual space image becomes an image from the first-person perspective of the user object. When the movement operation is being performed, the position of the virtual camera is controlled such that the virtual space image becomes an image from the third-person perspective including at least a part of the user object. An information processing apparatus. This can make it less likely to cause motion sickness and can suppress a decrease in the sense of immersion in the virtual space and visibility within the virtual space.

[0149] [Second Embodiment] (Description of Comparative Example) FIG. 16 is a schematic diagram showing an example of a display screen according to a comparative example of the second embodiment of the present disclosure. Here, it is assumed that the user terminal according to the comparative example has a configuration in which the virtual space image is switched between an image from the first-person perspective and an image from the third-person perspective according to the presence or absence of a movement operation of the user object 502, similar to the first embodiment.

[0150] For example, it is assumed that the user object 502 has moved in front of the sign object 1302. In this case, in the user terminal according to the comparative example, as shown in FIG. 16(a), an image from the third-person perspective including at least a part of the user object 502 is displayed on the display 132 as the virtual space image. At this time, the virtual camera 503 in the virtual space 501 is located, for example, at a position a predetermined distance behind the user object 502 from the viewpoint position of the user object 502.

[0151] Also, in a situation where the display screen shown in FIG. 16(a) is being displayed on the display 132, it is assumed that the user has ended the movement operation of the user object 502. In this case, in the user terminal according to the comparative example, as shown in FIG. 16(b), an image from the first-person perspective of the user object 502 is displayed on the display 132 as the virtual space image. At this time, the position of the virtual camera 503 in the virtual space 501 is the line-of-sight position of the user object 502.

[0152] As described above, when the virtual space image is switched from a third-person perspective image to a first-person perspective image, the virtual camera 503 in the virtual space 501 moves in the line-of-sight direction of the virtual camera 503. For this reason, the entire virtual space image is enlarged, and other objects other than the user object 502, such as the signboard object 1302, are clearly reflected. However, when the other object is the work of another person, it becomes possible to easily perform duplication or the like of an image in which the work of another person is clearly reflected.

[0153] On the other hand, the control unit 190 in the user terminal 10 according to the second embodiment solves the above problems with a configuration as described below.

[0154] (Configuration of User Terminal) FIG. 17 is a schematic diagram showing an example of a display screen according to the second embodiment of the present disclosure. FIG. 17(a) shows a virtual space image generated when the user object 502 moves in front of the signboard object 1302, similar to FIG. 16(a). FIG. 17(b) shows a virtual space image generated when the user object 502 stops in front of the signboard object 1302.

[0155] Referring to FIG. 17, the control unit 190 according to the second embodiment switches the virtual space image between a first-person perspective image and a third-person perspective image when a predetermined condition is satisfied, in the same manner as the control unit 190 according to the first embodiment.

[0156] Here, as an example, when a movement operation of the user object 502 is being performed, the image generation unit 196 in the control unit 190 generates a third-person perspective image as the virtual space image as shown in FIG. 17(a). Further, when no movement operation of the user object 502 is being performed, the image generation unit 196 generates a first-person perspective image as the virtual space image as shown in FIG. 17(b).

[0157] ​When generating a first-person perspective image, the image generation unit 196 determines whether a specific object is included in the image (hereinafter referred to as the "scheduled generation image").

[0158] More specifically, for example, in the virtual space information 152 shown in FIG. 2, one or more specific objects are registered in advance. Specifically, static objects are registered as specific objects.

[0159] Static objects include characters, patterns, characters or symbols, etc., or objects such as posters, banners, flags, signboards, and objects for posting expressed by combinations thereof. That is, static objects basically do not operate independently except when external stress is applied, and are, for example, attached to buildings or utility poles or placed on the road like a standing signboard.

[0160] Note that specific objects also include static objects attached to dynamic objects. For example, static objects attached to floating objects such as balloons, and static objects attached to robot-type or vehicle-type moving objects controlled to move in a periodic or predetermined route are also included in specific objects. Also, for example, static objects held or equipped by so-called NPCs (non-player characters) are also included in specific objects. It is assumed that the signboard object 1302 shown in FIG. 17 is registered in the virtual space information 152 as a specific object.

[0161] In addition, the user object 502 may include a player object operated by one player and another player object operated by another player or a computer different from the one player. In this case, the other player object may be registered as a specific object.

[0162] The image generation unit 196 performs image processing on the third-person perspective image immediately before switching to the first-person perspective image, and further refers to the virtual space information 152 to determine whether a specific object is included in the third-person perspective image. Then, when the image generation unit 196 determines that a specific object is included in the third-person perspective image, it determines that the specific object is also included in the planned generated image.

[0163] Also, when the image generation unit 196 is not generating a third-person perspective image, it may refer to the arrangement information included in the virtual space information 152 and the position information of the user object 502 to determine whether a specific object is included in the planned generated image.

[0164] Also, when the image generation unit 196 determines that a specific object is included in the planned generated image, it performs a predetermined process on the specific object so that the specific object is displayed in a predetermined display mode in the planned generated image.

[0165] For example, the image generation unit 196 performs a process such that the visibility of a specific object is reduced. Specifically, a mosaic process, a blurring process, a process of changing the image quality, a process of changing the number of pixels, a process of changing the color, a process of changing the brightness, or a process of changing the saturation, etc. are performed as the predetermined process. When the planned generated image includes a plurality of specific objects, the image generation unit 196 performs a predetermined process on each specific object.

[0166] Note that as the predetermined process, the image generation unit 196 may perform a process of replacing at least a part of a specific object with a predetermined other object, or a process of superimposing and displaying a predetermined other object on at least a part of a specific object. The predetermined other object is, for example, a stamp image or a mask image.

[0167] In FIG. 17(b), as an example, an image from a first-person perspective with a mosaic process applied to the signboard object 1302 is displayed on the display 132 as a virtual space image.

[0168] Also, assuming that a movement operation of the user object 502 is started in the situation where the first-person perspective image shown in FIG. 17(b) is being displayed. In this case, as shown in FIG. 17(a), the image generation unit 196 returns the signboard object 1302 to its normal display mode and generates an image from a third-person perspective.

[0169] (Operation example of the program) Next, the operation flow of the program according to the second embodiment will be described. FIG. 18 is a flowchart showing an example of the operation flow of the program according to the second embodiment of the present disclosure. As shown in FIG. 18, first, the control unit 190 refers to the virtual space information 152 and generates the virtual space 501, the virtual camera 503, and virtual objects (step S510).

[0170] Next, the control unit 190 refers to the arrangement information included in the virtual space information 152 and arranges the virtual objects and the virtual camera 503 in the virtual space 501 (step S520). The initial position of the virtual camera 503 is, for example, a position that is a predetermined distance behind the user object 502 from the viewpoint position of the user object 502.

[0171] Next, when a movement operation of the user object 502 is being performed (YES in step S530), the control unit 190 generates a virtual space image from a third-person perspective and displays the generated virtual space image on the display 132 (step S540).

[0172] On the other hand, when a movement operation of the user object 502 is not being performed (NO in step S530), the control unit 190 determines whether a specific object is included in the image to be generated, which is an image from a first-person perspective (step S550).

[0173] When the control unit 190 determines that the planned generation image includes a specific object (in step S550, "YES"), it generates, as a virtual space image, a first-person perspective image obtained by performing a predetermined process on the specific object. Then, the control unit 190 displays the generated virtual space image on the display 132 (step S560).

[0174] On the other hand, when the control unit 190 determines that the planned generation image does not include a specific object (in step S550, "NO"), it generates, as a virtual space image, a normal first-person perspective image without performing a predetermined process. Then, the control unit 190 displays the generated virtual space image on the display 132 (step S570).

[0175] Note that the control unit 190 is not limited to a configuration in which a predetermined process is performed when generating a first-person perspective image. After generating a first-person perspective image without performing a predetermined process, a predetermined process may be performed on a specific object included in the image.

[0176] The content according to the second embodiment of the present disclosure is listed as follows. (Item 2-1) A program executed by a computer, The program causes the computer to function as means for generating a virtual space, means for arranging a virtual camera, a user object, and a specific object in the virtual space, function as means for generating a virtual space image, which is an image of the virtual space, based on the virtual camera, As the means for generating the virtual space image, when a predetermined condition is satisfied, the virtual space image is switched between a first-person perspective image of the user object and a third-person perspective image including at least a part of the user object. When generating the first-person perspective image as the virtual space image, when the specific object is included in the virtual space image, the specific object is displayed in a predetermined display mode. Program. With such a configuration, even when a specific object that is the work of another person is included in the virtual space image, the virtual space image can be generated in a display mode that avoids the clear reflection of the work. Thereby, it is possible to prevent the work of another person from being clearly reflected in the virtual space image.

[0177] (Item 2-2) The program according to Item 2-1, wherein the specific object is a static object. With such a configuration, it is possible to prevent a static object that is likely to be the work of another person from being clearly reflected in the virtual space image.

[0178] (Item 2-3) The user object includes a player object operated by one player and another player object operated by another player different from the one player or the computer. The program according to Item 2-1 or Item 2-2, wherein the specific object is the other player object. With such a configuration, it is possible to prevent another player object that is likely to be the work of another person from being clearly reflected in the virtual space image.

[0179] The program according to any one of Items 2-1 to 2-3, wherein the display in the predetermined display mode reduces the visibility of the specific object. With such a configuration, even when a specific object that is the work of another person is included in the virtual space image, it is possible to prevent the work from being clearly reflected in the virtual space image without performing complicated processing.

[0180] An information processing system including one or more information processing devices, a process of generating a virtual space, a process of arranging a virtual camera, a user object, and a specific object in the virtual space, a process of generating a virtual space image, which is an image of the virtual space, based on the virtual camera, in the process of generating the virtual space image, when a predetermined condition is satisfied, switching the virtual space image between a first-person perspective image of the user object and a third-person perspective image including at least a part of the user object, when generating the first-person perspective image as the virtual space image, when the specific object is included in the virtual space image, displaying the specific object in a predetermined display mode, An information processing system. With such a configuration, even when a specific object that is the work of another person is included in the virtual space image, the virtual space image can be generated in a display mode that avoids the clear reflection of the work. Thereby, it is possible to prevent the work of another person from being clearly reflected in the virtual space image.

[0181] [Third Embodiment] In the above-described second embodiment, when a first-person perspective image is generated as the virtual space image, a specific object included in the virtual space image is displayed in a predetermined display mode. On the other hand, in the third embodiment, the specific object is displayed in a predetermined display mode according to the display size of the specific object in the virtual space image.

[0182] FIG. 19 is a schematic diagram showing an example of a display screen according to the third embodiment of the present disclosure. (a) of FIG. 19 shows a virtual space image generated when the user object 502 has moved in front of the signboard object 1302, similar to (a) of FIG. 17. (b) of FIG. 19 shows a virtual space image generated when the user object 502 has come closer to the signboard object 1302.

[0183] Referring to FIGS. 2 and 19, similar to the image generation unit 196 according to the second embodiment, when generating a virtual space image, the image generation unit 196 according to the third embodiment determines whether a specific object is included in the image to be generated, which is a virtual space image.

[0184] And when the image generation unit 196 determines that a specific object is included in the image to be generated, it determines whether the display size of the specific object in the image to be generated is larger than a predetermined size. Hereinafter, an example of determining whether the display size is larger than a predetermined size will be described in detail.

[0185] (a) Example 1 of determining whether the display size is larger than a predetermined size For example, in the virtual space information 152 shown in FIG. 2, similar to the second embodiment, one or more specific objects are registered. As the specific object, similar to the second embodiment, a static object is registered. It is assumed that the sign object 1302 shown in FIG. 19 is registered in the virtual space information 152 as a specific object. Note that, similar to the second embodiment, other player objects may be registered as specific objects.

[0186] Furthermore, size information of each specific object is registered in the virtual space information 152. Specifically, for each specific object, the height, width, etc. of the specific object in the virtual space 501 are registered as size information.

[0187] The image generation unit 196 refers to the size information, calculates, for example, the display magnification of the specific object in the image to be generated, and determines whether the calculated display magnification is equal to or greater than a second threshold value. And when the calculated display magnification is equal to or greater than the second threshold value, the image generation unit 196 determines that the display size of the specific object is larger than a predetermined size.

[0188] And in this case, the image generation unit 196 performs a predetermined process on the specific object so that the specific object is displayed in a predetermined display mode in the image to be generated. That is, the image generation unit 196 performs a process that reduces the visibility of the specific object, specifically, a mosaic process, a blurring process, a process of changing the image quality, a process of changing the number of pixels, a process of changing the color, a process of changing the brightness, or a process of changing the saturation.

[0189] In the virtual space image shown in FIG. 19(a), assume that the display magnification of the signboard object 1302 is smaller than the second threshold value. In this case, the image generation unit 196 generates a normal virtual space image without performing a predetermined process on the signboard object 1302.

[0190] On the other hand, as shown in FIG. 19(b), assume that the display magnification of the signboard object 1302 becomes equal to or greater than the second threshold value when the user object 502 and the virtual camera 503 move closer to the signboard object 1302. In this case, the image generation unit 196 generates a virtual space image in which a predetermined process is performed on the signboard object 1302.

[0191] Note that the control unit 190 is not limited to a configuration that generates a virtual space image in which a predetermined process is performed when generating a virtual space image including a specific object, and may perform a predetermined process on the specific object included in the virtual space image after generating a virtual space image in which no predetermined process is performed.

[0192] (b) Example 2 of determining whether the display size is larger than a predetermined size The image generation unit 196 may determine whether the display size of the specific object is larger than a predetermined size by determining whether the occupancy rate of the specific object in the image to be generated is equal to or greater than the first threshold value. The first threshold value is, for example, 30%.

[0193] More specifically, when the image generation unit 196 determines that a specific object is included in the virtual space image, for example, it generates a virtual space image without performing a predetermined process. Then, the image generation unit 196 performs image analysis processing on the generated virtual space image and calculates the occupancy rate of the specific object with respect to the virtual space image.

[0194] And when the image generation unit 196 determines that the calculated occupancy rate is equal to or greater than the first threshold value, it determines that the display size of the specific object is larger than a predetermined size. In this case, the image generation unit 196 performs a predetermined process on the specific object in the virtual space image. As a result, a virtual space image as shown in FIG. 19(b) is displayed on the display 132.

[0195] Note that the image generation unit 196 may be configured to perform both determination example 1 and determination example 2, or may be configured to perform either one of them.

[0196] In determination example 1, the closer a specific object is to the user object 502, the more likely the display magnification is equal to or greater than the second threshold value, and the more likely it is determined that the display size is larger than a predetermined size. On the other hand, in determination example 2, the larger a specific object is in the virtual space 501, the more likely the occupancy rate with respect to the virtual space image is equal to or greater than the first threshold value, and the more likely it is determined that the display size is larger than a predetermined size.

[0197] Note that due to the proximity between the user object 502 and a specific object, there may be a case where the display magnification of the specific object is equal to or greater than the second threshold value and the occupancy rate of the specific object with respect to the virtual space image is equal to or greater than the first threshold value. In such a case, in determination example 1 or determination example 2, it is determined that the display size of the specific object is larger than a predetermined size.

[0198] (Operation example of the program) Next, the operation flow of the program according to the third embodiment will be described. FIG. 20 is a flowchart showing an example of the operation flow of the program according to the third embodiment of the present disclosure. Since the operations of steps S610 and S620 shown in FIG. 20 are the same as the operations of steps S510 and S520 shown in FIG. 18, detailed description thereof will not be repeated here.

[0199] Next, the control unit 190 determines whether a specific object is included in the image to be generated, which is a virtual space image (step S630).

[0200] And when the control unit 190 determines that a specific object is included in the image to be generated ( "YES" in step S630), it determines whether the display size of the specific object in the image to be generated is larger than a predetermined size (step S640).

[0201] And when the control unit 190 determines that the display size of the specific object in the image to be generated is larger than the predetermined size ( "YES" in step S640), it generates a virtual space image obtained by performing a predetermined process on the specific object. Then, the control unit 190 displays the generated virtual space image on the display 132 (step S650).

[0202] On the other hand, when the control unit 190 determines that no specific object is included in the image to be generated ( "NO" in step S630), it generates a normal virtual space image without performing a predetermined process. Then, the control unit 190 displays the generated virtual space image on the display 132 (step S660).

[0203] Also, assume that the control unit 190 determines that a specific object is included in the planned generation image and the display size of the specific object in the planned generation image is equal to or less than a predetermined size (\"NO\" in step S640). Similarly, even in this case, the control unit 190 generates a normal virtual space image without performing a predetermined process and displays the generated virtual space image on the display 132 (step S660).

[0204] As described above, the first to third embodiments according to the present disclosure have been described in detail. However, as long as the operation of the program is not hindered, a part of the processing executed by the control unit 190 in the description of each embodiment may be taken over by the control unit 290, or at least a part of the processing executed by the control unit 290 may be taken over by the control unit 190.

[0205] For example, it may be a program that realizes a so-called cloud-type system in which the control unit 290 executes generation of the virtual space 501 and virtual objects and generation of virtual space images. Further, it may be a so-called stand-alone type program without including the server 20. Further, without including the server 20, P2P communication may be performed between user terminals so that a plurality of user objects can exist in the same virtual space 501.

[0206] Also, two or more of the first to third embodiments of the present disclosure may be combined. For example, by combining the second embodiment and the third embodiment, when a specific object is included in the first-person perspective image and the display size of the specific object in the image is larger than a predetermined size, the control unit 190 may perform a predetermined process on the specific object.

[0207] The content according to the third embodiment of the present disclosure is listed as follows. (Item 3-1) A program executed by a computer, wherein the program causes the computer to means for generating a virtual space, Means for arranging a virtual camera, a user object, and a specific object in the virtual space, Function as means for generating a virtual space image, which is an image of the virtual space, based on the virtual camera, As means for generating the virtual space image, When the display size of the specific object in the virtual space image is larger than a predetermined size, display the specific object in a predetermined display mode, Program. With such a configuration, even when a specific object that is the work of another person is shown larger than a predetermined size in the virtual space image, the virtual space image can be generated in a display mode that avoids the clear display of the work. Thereby, it is possible to prevent the work of another person from being clearly reflected in the virtual space image.

[0208] (Item 3-2) As means for generating the virtual space image, When the occupancy rate of the specific object with respect to the virtual space image is equal to or higher than a first threshold value, assuming that the display size of the specific object is larger than the predetermined size, display the specific object in the predetermined display mode, the program according to Item 3-1. With such a configuration, for example, even when there is a work of another person with a large size in the virtual space, the virtual space image can be generated in a display mode that avoids the clear display of the work.

[0209] (Item 3-3) As means for generating the virtual space image, When the display magnification of the specific object in the virtual space image is equal to or higher than a second threshold value, assuming that the display size of the specific object is larger than the predetermined size, display the specific object in the predetermined display mode, the program according to Item 3-1 or Item 3-2. With such a configuration, for example, even when the user object approaches another person's work and the work appears larger than a predetermined size in the virtual space image, the virtual space image can be generated in a display mode that avoids the work being clearly displayed.

[0210] (Item 3-4) The specific object is a static object, and the program according to any one of Items 3-1 to 3-3. With such a configuration, in the virtual space image, it is possible to prevent a static object that is likely to be another person's work from being clearly reflected.

[0211] (Item 3-5) The user object includes a player object operated by one player and another player object operated by another player different from the one player or the computer, The specific object is the other player object, and the program according to any one of Items 3-1 to 3-4. With such a configuration, in the virtual space image, it is possible to prevent another player object that is likely to be another person's work from being clearly reflected.

[0212] (Item 3-6) As the display in the predetermined display mode, the program according to any one of Items 3-1 to 3-5 that reduces the visibility of the specific object. With such a configuration, even when a specific object that is another person's work is included in the virtual space image, it is possible to prevent the work from being clearly reflected in the virtual space image without performing complicated processing.

[0213] An information processing system including one or more information processing devices, A process of generating a virtual space, A process of arranging a virtual camera, a user object, and a specific object in the virtual space, Based on the virtual camera, perform a process of generating a virtual space image which is an image of the virtual space; In the process of generating the virtual space image, When the display size of the specific object in the virtual space image is larger than a predetermined size, display the specific object in a predetermined display mode; An information processing system. With such a configuration, even when a specific object which is the work of others is shown larger than a predetermined size in the virtual space image, the virtual space image can be generated in a display mode that avoids the work being clearly shown. Thereby, it is possible to prevent the work of others from being clearly shown in the virtual space image.

Explanation of Signs

[0214] 1: System, 10: User terminal, 20: Server, 30: Network, 130: Touch screen, 150: Storage unit (of user terminal), 190: Control unit (of user terminal), 250: Storage unit (of server), 290: Control unit (of server), 501: Virtual space, 502: User object, 503: Virtual camera

Claims

1. A program executed by a computer, The program causes the computer to means for generating a virtual space; means for arranging a virtual camera, a user object, and a specific object in the virtual space; function as means for generating a virtual space image, which is an image of the virtual space, based on the virtual camera; As means for generating the virtual space image, when a predetermined condition is satisfied, switch the virtual space image between a first-person perspective image of the user object and a third-person perspective image including at least a part of the user object; when displaying the first-person perspective image as the virtual space image, if the specific object is included in the first-person perspective image, display the first-person perspective image subjected to a predetermined process of replacing at least a part of the specific object with another type of object; if the specific object is not included in the first-person perspective image, display the first-person perspective image not subjected to the predetermined process; Program.

2. The program according to claim 1, wherein the specific object is a static object.

3. The user object includes a player object operated by one player and another player object operated by another player different from the one player or the computer, The program according to claim 1, wherein the specific object is the other player object.

4. An information processing system including one or more information processing devices, a process of generating a virtual space, a process of arranging a virtual camera, a user object, and a specific object in the virtual space, Based on the virtual camera, perform a process of generating a virtual space image that is an image of the virtual space, In the process of generating the virtual space image, When a predetermined condition is satisfied, switch the virtual space image between a first-person perspective image of the user object and a third-person perspective image including at least a part of the user object, When generating the first-person perspective image as the virtual space image, when the specific object is included in the first-person perspective image, generate the first-person perspective image subjected to a predetermined process of replacing at least a part of the specific object with another type of object, and when the specific object is not included in the first-person perspective image, generate the first-person perspective image without the predetermined process being performed, An information processing system.

Images