Information processing system, information processing method, and program

Abstract

To provide a system capable of enhancing user's immersive experience in a virtual space.SOLUTION: An information processing system includes: an information acquisition unit which acquires operation information on an operation input of a first user; and a display processing unit which causes a user terminal of the first user to display a three-dimensional first virtual space and an avatar which moves in the first virtual space based on the operation information. The display processing unit causes the user terminal to display the first virtual space including a first region including a movement plane which is a plane on which the avatar can move, and a second region different from the first region. When the avatar moves from the first region to the second region, the display processing unit displays an omnidirectional image developed in a closed object, including a bottom surface which corresponds to the movement surface, and on which the avatar can move, around the avatar.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] A system has been disclosed that displays an avatar in a virtual space in which a 360-degree omnidirectional image is displayed (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-120336 A Summary of the Invention [Problem to be solved by the invention]

[0004] The system described in Patent Document 1 places an avatar in a virtual space by pasting a background image, which is a 360-degree omnidirectional image, inside the virtual space. The system then places an object on which the avatar stands in the virtual space to mask distortion of the background image in the virtual space. This makes it possible for the distortion of the omnidirectional background image to be invisible to the user, so the user does not lose his or her sense of immersion in the virtual space.

[0005] However, because the virtual space in which the avatar is placed is spherical, the avatar and the base appear to the user as if they are floating in relation to the background image, even though the avatar is placed on a base object. This causes a problem in that the user loses a sense of immersion in the virtual space.

[0006] Therefore, in order to solve the above-mentioned problems, an object of the present invention is to provide a system capable of improving a user's sense of immersion in a virtual space. [Means for solving the problem]

[0007] An information processing system according to one embodiment of the present invention includes an information acquisition unit that acquires operation information related to an operation input of a first user, and a display processing unit that displays, on a user terminal of the first user, a first three-dimensional virtual space and an avatar that moves through the first virtual space based on the operation information. The display processing unit displays, on the user terminal, the first virtual space including a first area including a movement plane that is a plane in which the avatar can move and a second area different from the first area, and when the avatar moves from the first area to the second area, displays around the avatar an omnidirectional image that is expanded into a closed object including a bottom surface in which the avatar can move, which corresponds to the movement plane.

[0008] An information processing method according to one embodiment of the present invention includes a computer that acquires operation information regarding an operation input of a first user, displays a three-dimensional first virtual space and an avatar that moves in the first virtual space based on the operation information on a user terminal of the first user, displays the first virtual space on the user terminal, the first virtual space including a first region including a movement plane that is a plane in which the avatar can move and a second region different from the first region, and, when the avatar moves from the first region to the second region, displays an omnidirectional image that is expanded into a closed object including a bottom surface in which the avatar can move, which corresponds to the movement plane, around the avatar.

[0009] A program according to one embodiment of the present invention causes a computer to acquire operation information regarding an operation input of a first user, display on a user terminal of the first user a first three-dimensional virtual space and an avatar that moves in the first virtual space based on the operation information, display on the user terminal the first virtual space including a first region including a movement plane that is a plane in which the avatar can move and a second region distinct from the first region, and when the avatar moves from the first region to the second region, display around the avatar an omnidirectional image that is expanded into a closed object including a bottom surface in which the avatar can move, which corresponds to the movement plane. Effect of the Invention

[0010] According to the present invention, it is possible to provide a system capable of improving a user's sense of immersion in a virtual space. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a display system 10. [Diagram 2] 1 is a database showing an example of virtual space information. [Diagram 3] 1 is a database showing an example of display object information. [Figure 4] 1 is a database showing an example of avatar information. [Diagram 5] FIG. 2 is a diagram showing an example of a first virtual space. [Figure 6] FIG. 2 is a diagram showing an example of a first virtual space. [Figure 7] FIG. 13 is a diagram showing an example of a display image. [Figure 8] FIG. 13 is a diagram showing an example of an object that develops a display image. [Figure 9] FIG. 11 is a diagram showing an example of a first selection object. [Figure 10] FIG. 11 is a diagram showing an example of a second selection object. [Figure 11]4 is a flowchart showing an example of a processing procedure of the display system 10. [Figure 12] FIG. 2 illustrates an example of a hardware configuration of a computer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] A display system 10 according to an embodiment of the present invention will be described in detail below with reference to the drawings. However, the embodiment described below is merely an example, and is not intended to exclude the application of various modifications and techniques not specifically described below. In other words, the present invention can be implemented by modifying it in various ways or combining each embodiment without departing from the spirit of the invention. In addition, in the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0013] ===Overview of Display System 10=== The display system 10 is a system that displays an avatar that can be operated by a user in a virtual space. The display system 10 executes a display process that does not reduce the user's immersive feeling in the virtual space by using a small amount of information.

[0014] The virtual space is a virtual space configured by images displayed on a terminal device, which is, for example, a non-transparent head-mounted display worn by a user. The virtual space includes a so-called mixed reality space (a space in which real-world information is reflected in a digital space). The image displayed on the display unit of the user terminal 200 is, for example, an image that the user can visually recognize as a three-dimensional image. Hereinafter, among the images displayed on the user terminal 200, an object that the user can visually recognize as an actual object in the virtual space is referred to as an "avatar."

[0015] When an avatar moving through a virtual space is positioned in a specified area, the display system 10 displays an omnidirectional image around the avatar, the image being deployed on an object 1510 having a plane to make the avatar appear to be standing on the ground.

[0016] As a result, while conventional systems display an avatar as if it is floating in the center of a global image (omnidirectional image), the display system can display the avatar as if it is standing on the ground in the omnidirectional image, improving the user's sense of immersion. Also, the display system 10 can provide the data required by the user only with the amount of information in the image data, without moving the user to another virtual space.

[0017] Furthermore, the display system 10 may store in advance the omnidirectional image (360-degree image) deployed on the object 1510 in the user terminal 200. In this way, when an avatar moving in a virtual space is positioned in a predetermined area, the display system 10 can display the omnidirectional image around the avatar in a short time.

[0018] <<Configuration>> An overview of the configuration of a display system 10 will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of the display system 10. As shown in Fig. 1, the display system includes, for example, a display device 100 and a user terminal 200.

[0019] The display device 100 is a device that displays a virtual space and an avatar on a display unit of a user terminal 200. The display device 100 executes various processes in the virtual space based on an operation input by a user to the user terminal 200. The display device 100 is connected to the user terminal 200 so as to be able to communicate with the user terminal 200.

[0020] The display device 100 may be, for example, a cloud computer, a server computer, a personal computer (e.g., a desktop, a laptop, a tablet, etc.), a media computer platform (e.g., a cable, a satellite set-top box, a digital video recorder), a handheld computer device (e.g., a PDA, an email client, etc.), or other types of computers or communication platforms. At least a part of the processing in the display device 100 may be realized by one or more computers (for example, but not limited to, cloud computing configured by one or more computers).

[0021] The user terminal 200 is a device that receives operational input from a user and executes various processes in a virtual space, including, for example, movement of an avatar, entry of comments, and payment processing.

[0022] The user terminal 200 may be, for example, a smartphone, a mobile phone (feature phone), a personal computer (e.g., desktop, laptop, tablet, etc.), a media computing platform (e.g., cable, satellite set-top box, digital video recorder), a handheld computing device (e.g., PDA (Personal Digital Assistant), email client, etc.), a wearable device (glasses-type device, watch-type device, etc.), or another type of computer or communication platform.

[0023] <<Processing>> An overview of the processing of the display system 10 will be described with reference to Fig. 1. For convenience, the virtual space showing the city will be referred to as the "first virtual space 1000" and the virtual space showing the shops in the city will be referred to as the "second virtual space 2000." Note that, hereinafter, when the term "virtual space" is simply used, it refers to a virtual space including the first virtual space 1000 and the second virtual space 2000.

[0024] In step S10, the display device 100 receives a request (hereinafter referred to as a "participation request") from the user terminal 200 indicating that the user will participate in the first virtual space 1000. The first virtual space 1000 includes an area (first area) including a plane (hereinafter referred to as a "movement plane 1110") on which the avatar can move, and an area (second area) distinct from the first area.

[0025] In step S11, the display device 100 transmits to the user terminal 200, for example, information for displaying the first virtual space 1000 corresponding to the participation request on the display unit of the user terminal 200 (hereinafter referred to as "space information").

[0026] The spatial information includes, for example, information indicating the configuration of the first virtual space 1000, an object (hereinafter referred to as a "display object 1200") for displaying a predetermined image in the first virtual space 1000, and information for displaying an avatar. The area in which the display object 1200 is displayed is, for example, the above-mentioned "area distinct from the relevant area."

[0027] In step S12, the display device 100 acquires, from the user terminal 200, information relating to an operational input by the user (hereinafter referred to as "operation information").

[0028] In step S13, the display device 100 moves the avatar in the first virtual space 1000 based on the operation information.

[0029] In step S14, when the display device 100 determines that the avatar has come into contact with the display object 1200 in the first virtual space 1000, the display device 100 displays an omnidirectional image (hereinafter referred to as a "display image 1500") around the avatar on the display unit of the user terminal 200. At this time, the display device 100 transmits, for example, spatial information including the display image 1500 to the user terminal 200.

[0030] The display image 1500 is, for example, an omnidirectional image showing the interior of a shop located in the first virtual space 1000 showing a city. This allows the user to quickly check the items for sale and the internal situation of a specific location without having to transition to, for example, the second virtual space 2000 corresponding to the specific location, thereby improving the user's sense of immersion.

[0031] Moreover, the display image 1500 is an omnidirectional image that is expanded into an object 1510 having a shape that has a bottom surface that makes the avatar appear to be standing as viewed from the virtual camera, and a curved surface that is formed in the direction of the avatar of the bottom surface. Specifically, the display image 1500 is expanded into an object 1510 having a shape that includes, for example, a bottom surface and a part of a sphere that is formed so as to envelop the avatar from the bottom surface.

[0032] In this regard, the conventional system places the avatar in a spherical object in which the omnidirectional image is developed, so that the avatar is displayed as if floating in the omnidirectional image. In contrast, the display system 10 displays the display image 1500 developed on the object 1510 having a bottom surface, so that the avatar appears to be standing in contact with the part of the omnidirectional image that shows the ground, improving the user's sense of immersion. Note that the display image 1500 displayed by the display system 10 generates image distortion in the part that shows the ground. In this regard, even in the conventional system, since it is an omnidirectional image, distortion occurs throughout the image. In consideration of such characteristics of the omnidirectional image, the display system 10 generates image distortion in the part of the ground compared to the conventional system, but improves the sense of immersion by expressing that the avatar is standing in contact with the part of the image that shows the ground, rather than the image distortion that occurs in the conventional system.

[0033] Moreover, the display image 1500 may be an image that is pre-stored in the user terminal 200. This allows the display system 10 to display the omnidirectional image almost simultaneously when the avatar touches the display object 1200, thereby improving the user's immersive feeling in the virtual space.

[0034] In this way, the display system 10 displays an avatar standing in the part of the omnidirectional image showing the second virtual space 2000 that shows the ground, without transitioning from the first virtual space 1000 to the second virtual space 2000, thereby enabling the user to instantly view the omnidirectional image showing the second virtual space 2000 without losing the user's sense of immersion.

[0035] In step S15, when the avatar moves out of the area (second area) of the display object 1200, the display device 100 generates a spatial image in which the display image 1500 displayed around the avatar is erased. At this time, the display device 100 transmits spatial information not including the display image 1500 to the user terminal 200. This allows the display system 10 to display the original virtual space without moving in the virtual space, thereby improving the user's sense of immersion.

[0036] ===Display device 100=== As shown in FIG. 1, display device 100 includes a storage unit 110, an information acquisition unit 120, an avatar control unit 130, an avatar position determination unit 140, a display processing unit 150, and an information transmission unit 160.

[0037] The storage unit 110 includes, for example, virtual space information 111, display object information 112, and avatar information 113.

[0038] The virtual space information 111 will be described with reference to Fig. 2. Fig. 2 is a database showing an example of the virtual space information 111. The virtual space information 111 is a database that is referenced when the display processing unit 150 displays a virtual space on the display unit of the user terminal 200.

[0039] 2, the virtual space information 111 includes items such as [Virtual Space ID], [Space Information], [Participating Users], and [Display Object]. [Virtual Space ID] stores identification information that can uniquely identify the virtual space. [Space Information] stores information for displaying the virtual space on the display unit. [Participating Users] stores user IDs of users participating in the virtual space. [Display Object] stores identification information (identification ID and coordinates) that can uniquely identify the display object 1200 displayed in the virtual space.

[0040] The display object information 112 will be described with reference to Fig. 3. Fig. 3 is a database showing an example of the display object information 112. The display object information 112 is a database referenced when the display processing unit 150 displays the display object 1200 or the display image 1500 on the display unit of the user terminal 200.

[0041] 3, the display object information 112 includes items such as, for example, [display object ID], [display position], [display image], and [corresponding space]. [Display object ID] stores identification information capable of uniquely identifying the display object 1200. [Display position] stores information indicating coordinates (coordinates where the avatar is located) for displaying the display image 1500 on the display unit. [Display image] stores information for displaying the display image 1500 around the avatar. [Corresponding space] stores a virtual space ID capable of uniquely identifying the virtual space corresponding to the display object 1200.

[0042] Avatar information 113 will be described with reference to Fig. 4. Fig. 4 is a database showing an example of avatar information 113. Avatar information 113 is a database that is referenced when display processing unit 150 displays an avatar on the display unit of user terminal 200.

[0043] 4, the avatar information 113 includes items such as [Avatar ID], [User ID], and [Location]. [Avatar ID] stores identification information that can uniquely identify an avatar. [User ID] stores identification information that can uniquely identify a user corresponding to the avatar. [Location] stores location information that indicates the coordinates of the avatar in the virtual space.

[0044] The information acquisition unit 120 acquires a participation request and operation information from the user terminal 200 .

[0045] The avatar control unit 130 moves the avatar 1400 in the virtual space based on the operation information.

[0046] The avatar position determination unit 140 specifies the position in the virtual space of the avatar 1400 moving in the virtual space. For example, the avatar position determination unit 140 may specify the position of the avatar 1400 by referring to the avatar information 113, or may specify the position of the avatar 1400 based on position information that can be specified from operation information in the avatar control unit 130. The avatar position determination unit 140 determines whether or not the avatar 1400 is located in a predetermined area in the virtual space. Specifically, the avatar position determination unit 140 determines whether or not the specified position of the avatar 1400 overlaps with the position of the display object 1200 in the virtual space by referring to, for example, the display object information 112. Hereinafter, for convenience, the result determined by the avatar position determination unit 140 is referred to as a "determination result."

[0047] The display processing unit 150 causes the display unit to display the first virtual space 1000 and the second virtual space 2000. An example of the first virtual space 1000 and the avatar 1400 will be described with reference to Fig. 5 and Fig. 6. Fig. 5 and Fig. 6 are diagrams showing an example of the first virtual space 1000.

[0048] Next, an explanation will be given of the first virtual space 1000. As shown in Fig. 5 and Fig. 6, the first virtual space 1000 includes a field 1100 (first area), a display object 1200, and an object marker 1300.

[0049] The field 1100 includes a movement plane 1110 on which the avatar 1400 can move. Although nothing is displayed on the movement plane 1110 of the field 1100 in Fig. 5 and Fig. 6, for example, a map may be displayed on the movement plane 1110, a guide sign (e.g., a guide sign to the user's destination), or an advertisement may be displayed. This allows each area of ​​the virtual space to be effectively utilized.

[0050] The display object 1200 is an object provided on the moving plane 1110. The display object 1200 is provided, for example, on the surface of a predetermined area (second area) of the moving plane 1110. The display object 1200 may be, for example, an object having a planar shape (see FIG. 5 and FIG. 6), an object having a three-dimensional shape (for example, a door, etc.), or an object pointing to an area (for example, an arrow, etc.). In particular, when the display object 1200 is an object having a planar shape, when the display image 1500 is displayed, the display image 1500 creates an optical illusion for the user as if it were wrapping around the avatar 1400. That is, when the display device 100 configures the display object 1200 as an object having a planar shape, the user's sense of immersion in the virtual space can be improved.

[0051] The area of ​​the display object 1200 may be the same as the area of ​​a bottom surface 1511 of an object 1510 that displays a display image 1500 (described later). This makes it easier to design the system, and allows the user to properly grasp the range in which the display image 1500 is displayed.

[0052] It should be noted that the first virtual space 1000 may include an area (second area) different from the field 1100. The different area may be an area that is visually distinguished from the field 1100.

[0053] The object indicator 1300 is an object that displays information (such as a shop name) that can identify the second virtual space 2000 corresponding to the display object 1200. This allows the display device 100 to easily find the object the user is looking for, thereby reducing the user's inconvenience in using the system and allowing the user to continue their actions in the virtual space.

[0054] The avatar 1400 will be described. As shown in Figs. 5 and 6, the avatar 1400 is an object that displays a moving character such as a person or an animal in three dimensions. Parts (e.g., hair, face, etc.) of the avatar 1400 may be set by a setting operation of the user. The display device 100 operates the avatar 1400 in the first virtual space 1000 based on the operation information. As shown in Fig. 5, the first virtual space 1000 may include, in addition to the user's avatar 1400, an avatar 1401 representing another user (second user).

[0055] The display image 1500 will be described. When the display processing unit 150 acquires a determination result indicating that the avatar 1400 has come into contact with the display object 1200, for example, the display processing unit 150 causes the display unit to display the display image 1500. Note that the display image 1500 may be displayed on the display unit when the display processing unit 150 acquires a determination result indicating that the avatar 1400 is located in the different region described above. An example of the display image 1500 will be described below with reference to Figs. 7 and 8. Fig. 7 is a diagram showing an example of the display image 1500. Fig. 8 is a diagram showing an example of an object 1510 that unfolds the display image 1500.

[0056] As shown in FIG. 7, display image 1500 is an omnidirectional image displayed around avatar 1400, and is an image showing second virtual space 2000. Display image 1500 will be described in detail with reference to FIG. 8. As shown in FIG. 8, display device 100 generates display image 1500 by developing an omnidirectional image on object 1510 that has been deformed so as to form a bottom surface on a part of a spherical object. An image corresponding to the ground surface of the real space shown by the omnidirectional image is developed on bottom surface 1511 of object 1510, and an image of the real space other than the image shown by the omnidirectional image developed on bottom surface 1511 is developed on the part other than bottom surface 1511.

[0057] In detail, the display device 100 generates the display image 1500 by developing an omnidirectional image on an object 1510 enclosed by, for example, a bottom surface 1511 and a curved surface 1512 symmetrical with respect to a virtual line (not shown) extending vertically from the center of the circular bottom surface in a plan view, and adjusting the overall scale. In other words, the display device 100 generates the display image 1500 by developing an omnidirectional image on an object 1510 (region) enclosed by a bottom surface 1511 for making the avatar 1400 appear to be standing in contact with the ground shown in the omnidirectional image, and a curved surface 1512 forming a part of a spherical shape formed from the bottom surface 1511 to the avatar 1400 side, while adjusting the scale. Note that the curved surface 1512 may be, for example, a part of a spherical shape, a hemispherical curved surface, or a curved surface formed so as to bulge from the bottom surface provided below half of the spherical shape. The generated display image 1500 is stored in the storage unit 110.

[0058] As a result, when the avatar 1400 comes into contact with the display object 1200, the display device 100 can display the display image 1500, which has less information compared to the second virtual space 2000, around the avatar 1400 in a short time, without transitioning from the first virtual space 1000 to the second virtual space 2000. In other words, the display device 100 can display only the image showing the second virtual space 2000 to the user, without transitioning to the second virtual space 2000.

[0059] Furthermore, since a global image is displayed on a spherical object in the second virtual space 2000, the avatar located at the center of the spherical object appears to be floating above the ground. That is, compared to transitioning to the second virtual space 2000 and displaying an all-directional image, displaying the display image 1500 improves the user's sense of immersion because the avatar 1400 is displayed in a manner that approximates the real space.

[0060] Note that display image 1500 may display shadow 1410 of avatar 1400 at the feet of avatar 1400. This allows display device 100 to more clearly express the appearance of avatar 1400 standing in contact with the ground, thereby improving the user's sense of immersion.

[0061] The first selection object 1520 and the second selection object 2100 will be described. The display processing unit 150 may display the first selection object 1520 for confirming whether or not to participate in the second virtual space 2000 in a state where the display image 1500 is displayed. The display processing unit 150 may also display the second selection object 2100 for confirming whether or not to return to the first virtual space 1000 in a state where the user has participated in the second virtual space 2000. Hereinafter, an example of the first selection object 1520 and the second selection object 2100 will be described with reference to FIG. 9 and FIG. 10. FIG. 9 is a diagram showing an example of the first selection object 1520. FIG. 10 is a diagram showing an example of the second selection object 2100.

[0062] 9, the first selection object 1520 is, for example, an object that is displayed superimposed on a part of the display image 1500. The first selection object 1520 includes, for example, a participation button 1521 for participating in the second virtual space 2000, and a space display button 1522 for displaying the first virtual space 1000.

[0063] When an operation input to the join button 1521 is received, the display device 100 causes the avatar 1400 to participate in the second virtual space 2000. This enables the user to, for example, move the avatar 1400 around a store in the second virtual space 2000, perform a payment process to purchase products in the store, communicate (converse) with an avatar representing a store clerk participating in the second virtual space 2000, and add a comment to any location in the second virtual space 2000.

[0064] 10, the second selection object 2100 is an object that is displayed superimposed on a part of the second virtual space 2000 displayed on the display unit. The second selection object 2100 includes, for example, a transition button 2110 for returning to the first virtual space 1000. When an operation input to the transition button 2110 is received, the display device 100 causes the avatar 1400 to participate in the first virtual space 1000.

[0065] The information transmitting unit 160 transmits various types of information such as spatial information to the user terminal 200 .

[0066] ===User terminal 200=== Returning to Fig. 1, the configuration of the user terminal 200 will be described. As shown in Fig. 1, the user terminal 200 includes functional units, for example, a storage unit 210, a transmission / reception unit 220, and a display processing unit 230. Each functional unit is a function realized by, for example, a processor 3001 reading out a program stored in a memory 3002.

[0067] The storage unit 210 stores, for example, user information 211. The user information 211 stores a user name, an avatar ID, etc. in association with a user ID as a primary key. The user name is a name registered by the user himself / herself and is arbitrary. The avatar ID is identification information with which an avatar can be identified. The transmission / reception unit 220 transmits and receives various information to and from the display device 100. The various information acquired by the transmission / reception unit 220 is stored in the storage unit 210. The display processing unit 230 causes the display unit to display a virtual space indicated by the spatial information acquired from the display device 100.

[0068] ===Processing Procedure=== The processing procedure of the display system 10 will be described with reference to Fig. 11. Fig. 11 is a flowchart showing an example of the processing procedure of the display system 10. Below, with reference to Figs. 5 to 10, the processing procedure from when the avatar 1400 that has participated in the first virtual space 1000 touches the display object 1200 of a predetermined store until the avatar 1400 participates in the second virtual space 2000 will be described.

[0069] In step S100, the user terminal 200 transmits a request to participate in the first virtual space 1000 to the display device 100.

[0070] In step S101, the display device 100 refers to the virtual space information 111 and the avatar information 113, and transmits to the user terminal 200 space information capable of displaying the first virtual space 1000 shown in FIGS.

[0071] In step S102, the user terminal 200 transmits operation information for operating the avatar 1400 displayed in the first virtual space 1000 to the display device 100.

[0072] In step S103, the display device 100, based on the operation information, refers to the virtual space information 111 to identify the position of the avatar 1400 in the first virtual space 1000. The display device 100, based on the display object information 112, determines whether or not the position of the avatar 1400 overlaps with the position of any one of the display objects 1200 (for example, the area of ​​the bottom surface 1511 of the display object 1200) among the display objects 1200 shown in FIG. 5 and FIG. 6 .

[0073] If it is determined that the avatar 1400 and the display object 1200 do not overlap (step S103: NO), the display device 100 repeats the process from step S101. If it is determined that the avatar 1400 and the display object 1200 overlap (step S103: YES), the display device 100 transitions the process to step S104.

[0074] In step S104, the display device 100 refers to the display object information 112 and transmits the display image 1500 to be displayed around the avatar 1400 to the user terminal 200.

[0075] 7 corresponding to the display object 1200, around the avatar 1400. The user terminal 200 transmits operation information to the display device 100. In step S105, the user terminal 200 displays the display image 1500 shown in FIG.

[0076] In addition, when the display object 1200 is an object corresponding to the second virtual space 2000, the display image 1500 is, for example, an image showing a capture of the second virtual space 2000. This allows the display device 100 to easily and quickly provide the user with the display image 1500 for the user to determine whether or not to transition to the second virtual space 2000. In addition, the display system 10 moves the avatar 1400 on the movement plane 1110 of the first virtual space 1000, and when the avatar 1400 is positioned on the planar display object 1200 displayed on the movement plane 1110, the avatar 1400 is displayed as if it is standing on the omnidirectional image, thereby improving the user's immersion in the virtual space.

[0077] In step S106, the display device 100, based on the operation information, refers to the virtual space information 111 to identify the position of the avatar 1400. Then, the display device 100 determines whether or not the avatar 1400 is located within the range of the bottom surface 1511 (see FIGS. 7 and 8) of the object 1510 on which the display image 1500 is deployed in the first virtual space 1000.

[0078] If it is determined that the avatar 1400 and the display object 1200 do not overlap (step S106: NO), the display device 100 repeats the process from step S101. That is, in this case, the display device 100 erases the display image 1500 from around the avatar 1400, and transmits space information for displaying the first virtual space 1000 to the user terminal 200.

[0079] As a result, if the user is not interested in the display image 1500, the display system 10 can quickly transition the avatar 1400 to the field 1100 of the first virtual space 1000, improving the user's sense of immersion. This is the effect of displaying the display image 1500 around the avatar 1400 in the display system 10 without having the avatar 1400 participate in the second virtual space 2000.

[0080] If it is determined that the avatar 1400 and the display object 1200 overlap each other (step S103: YES), the display device 100 transitions the process to step S107.

[0081] In step S107, the display device 100 determines whether or not a participation request to the second virtual space 2000 has been acquired from the user terminal 200. At this time, the user terminal 200 displays the first selection object 1520 shown in FIG. 9, and when a user operation input to the participation button 1521 of the first selection object 1520 is accepted, the user terminal 200 transmits the participation request to the display device 100.

[0082] If the participation request has not been acquired (step S107: NO), the display device 100 repeats the process from step S106. If the participation request has been acquired (step S107: YES), the display device 100 transitions the process to step S108.

[0083] In step S108, the display device 100 refers to the virtual space information 111 and the avatar information 113, and transmits to the user terminal 200 space information capable of displaying the second virtual space 2000 shown in FIG.

[0084] In step S109, the user terminal 200 transmits operation information for operating the avatar 1400 displayed in the second virtual space 2000 to the display device 100. Then, the user terminal 200 displays the second selection object 2100 shown in FIG. 10, and when a user operation input to the transition button 2110 of the second selection object 2100 is received, the user terminal 200 transmits a participation request to participate in the first virtual space 1000 to the display device 100.

[0085] In step S110, the display device 100 determines whether or not a request to participate in the first virtual space 1000 has been acquired from the user terminal 200.

[0086] If the participation request has not been acquired (step S110: NO), the display device 100 repeats the process from step S108. If the participation request has been acquired (step S110: YES), the display device 100 transmits space information for displaying the first virtual space 1000 to the user terminal 200.

[0087] In step S111, the user terminal 200 displays the first virtual space 1000.

[0088] ===Hardware Configuration=== An example of a hardware configuration for implementing the display device 100 and the user terminal 200 on a computer will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of a hardware configuration of a computer.

[0089] As shown in FIG. 11, a computer 3000 includes a processor 3001, a memory 3002, a storage device 3003, an input I / F unit 3004, a data I / F unit 3005, a communication I / F unit 3006, and a display unit 3007.

[0090] The processor 3001 is a control unit that controls various processes in the computer 3000 by executing programs stored in the memory 3002 .

[0091] The memory 3002 is a storage medium such as a RAM (Random Access Memory), etc. The memory 3002 temporarily stores the program code of the program executed by the processor 3001 and data required when the program is executed.

[0092] The storage device 3003 is a non-volatile storage medium such as a hard disk drive (HDD), a flash memory, etc. The storage device 3003 stores an operating system and various programs for implementing the above-mentioned components.

[0093] The input I / F unit 3004 is a device for receiving input from a user. Specific examples of the input I / F unit 3004 include a keyboard, a mouse, a touch panel, various sensors, a wearable device, etc. The input I / F unit 3004 may be connected to the computer 3000 via an interface such as a USB (Universal Serial Bus).

[0094] The data I / F unit 3005 is a device for inputting data from outside the computer 3000. A specific example of the data I / F unit 3005 is a drive device for reading data stored in various storage media. The data I / F unit 3005 may be provided outside the computer 3000. In this case, the data I / F unit 3005 is connected to the computer 3000 via an interface such as a USB.

[0095] The communication I / F unit 3006 is a device for performing data communication via the Internet N, either wired or wirelessly, with an external device of the computer 3000. The communication I / F unit 3006 may be provided outside the computer 3000. In that case, the communication I / F unit 3006 is connected to the computer 3000 via an interface such as a USB.

[0096] The display unit 3007 is a device for displaying various types of information. Specific examples of the display unit 3007 include a liquid crystal display, an organic EL (Electro-Luminescence) display, a display of a wearable device, and the like. The display unit 3007 may be provided outside the computer 3000. In that case, the display unit 3007 is connected to the computer 3000 via, for example, a display cable. In addition, when a touch panel is adopted as the input I / F unit 3004, the display unit 3007 can be configured integrally with the input I / F unit 3004.

[0097] ===Summary=== <1> The display system 10 in this embodiment includes an information acquisition unit 120 that acquires operation information related to an operation input of a user (first user), and a display processing unit 150 that displays, on a user terminal 200 of the user (first user), a three-dimensional first virtual space 1000 and an avatar 1400 that moves in the first virtual space 1000 based on the operation information. The display processing unit 150 displays a field 1100 (first area) including a movement plane 1110 that is a plane on which the avatar 1400 can move, and a display area 1100 (second area) including a movement plane 1110 that is a plane on which the avatar 1400 can move. A first virtual space 1000 including a field 1100 (first area) and a predetermined area (second area) distinct from the field 1100 (first area) is displayed on the user terminal 200, and when the avatar 1400 moves from the field 1100 (first area) to the predetermined area (second area), an omnidirectional image developed on an object 1510 enclosed by a bottom surface 1511 on which the avatar 1400 can move, which corresponds to a movement plane 1110, and a curved surface 1512 formed in the direction of the avatar 1400 side of the bottom surface 1511, is displayed around the avatar 1400. As a result, the display system 10 moves the avatar 1400 on the movement plane 1110 of the first virtual space 1000, and when the avatar 1400 is positioned on, for example, a display object 1200 displayed on the movement plane 1110, the avatar 1400 is displayed as if it is standing on the omnidirectional image, thereby improving the user's immersion in the virtual space.

[0098] <2> Moreover, the display processing unit 150 of the display system 10 in this embodiment causes the user terminal 200 to display the first virtual space 1000 including a predetermined area (second area) that is visually distinct from the field 1100 (first area). This allows the display system 10 to allow the user to properly grasp the range in which the display image 1500 is displayed.

[0099] <3> Moreover, the display processing unit 150 of the display system 10 in this embodiment displays the display object 1200 having a planar shape in a predetermined region (second region). As a result, when the display system 10 configures the display object 1200 as an object having a planar shape, it is possible to improve the user's immersive feeling in the virtual space.

[0100] <4> Moreover, the display object 1200 displayed by the display system 10 in this embodiment has a planar shape having an area equal to that of the bottom surface 1511. This makes it easier to design the system, and allows the user to properly grasp the range in which the display image 1500 is displayed.

[0101] <5> Furthermore, in a state where an omnidirectional image is displayed around the avatar 1400, when the avatar 1400 is no longer located in a predetermined area (second area), the display processing unit 150 of the display system 10 in this embodiment erases the omnidirectional image from around the avatar 1400. This allows the display system 10 to display the original virtual space without moving in the virtual space, thereby improving the user's sense of immersion.

[0102] <6> Furthermore, when the avatar 1400 moves from the field 1100 (first area) to a predetermined area (second area), the display processing unit 150 of the display system 10 in this embodiment displays an omnidirectional image stored in advance in the user terminal 200 around the avatar 1400. This allows the display system 10 to display the omnidirectional image almost simultaneously when the avatar 1400 comes into contact with the display object 1200, thereby improving the user's sense of immersion in the virtual space.

[0103] <7> In addition, the display processing unit 150 of the display system 10 in this embodiment displays a first selection object 1520 (selection object) for a user (first user) to participate in the second virtual space 2000 in which an omnidirectional image showing a second virtual space 2000 (predetermined place) deployed in a closed object 1510 including a bottom surface 1511 is displayed around the avatar 1400, and in which an omnidirectional image showing a predetermined place different from the first virtual space 1000 is deployed, in which an avatar 1401 of a second user different from the first user can participate. This makes it possible for the display system 10 to move the avatar 1400 in a shop in the second virtual space 2000, for example, when a user who has viewed a captured image of the second virtual space 2000 wishes to enter the second virtual space 2000. [Explanation of symbols]

[0104] 10 display system, 100 display device, 110 storage unit, 120 information acquisition unit, 130 avatar control unit, 140 avatar position determination unit, 150 display processing unit, 160 information transmission unit, 200 user terminal.

Claims

1. an information acquisition unit that acquires operation information related to an operation input by a first user; a display processing unit that displays, on a user terminal of the first user, a three-dimensional first virtual space and an avatar that moves in the first virtual space based on the operation information; Equipped with The display processing unit is displaying, on the user terminal, the first virtual space including a first area including a movement plane that is a plane in which the avatar can move and a second area different from the first area; When the avatar moves from the first area to the second area, an omnidirectional image expanded into a closed object including a bottom surface on which the avatar can move, the bottom surface corresponding to the movement plane, is displayed around the avatar. Information processing system.

2. The display processing unit causes the user terminal to display the first virtual space including the second area that is visually distinguished from the first area. The information processing system according to claim 1 .

3. the display processing unit displays a display object having a planar shape in the second area; The information processing system according to claim 1 .

4. the display object has a planar shape having an area equal to that of the bottom surface; The information processing system according to claim 3 .

5. When the avatar is no longer located in the second area in a state in which the omnidirectional image is displayed around the avatar, the display processing unit erases the omnidirectional image from around the avatar. The information processing system according to claim 3 .

6. When the avatar moves from the first area to the second area, the display processing unit displays the omnidirectional image stored in advance in the user terminal around the avatar. The information processing system according to claim 1 .

7. the display processing unit, in a state in which the omnidirectional image indicating a predetermined place deployed in the closed object including the bottom surface is displayed around the avatar, displays a selection object for the first user to participate in a second virtual space different from the first virtual space, in which the omnidirectional image indicating the predetermined place is deployed and in which an avatar of a second user different from the first user can participate; The information processing system according to claim 1 .

8. The computer acquiring operation information regarding an operation input of a first user; displaying, on a user terminal of the first user, a three-dimensional first virtual space and an avatar that moves in the first virtual space based on the operation information; displaying, on the user terminal, the first virtual space including a first area including a movement plane that is a plane in which the avatar can move, and a second area different from the first area; When the avatar moves from the first area to the second area, an omnidirectional image is displayed around the avatar, the omnidirectional image being expanded into a closed object including a bottom surface on which the avatar can move, the bottom surface corresponding to the movement plane; An information processing method for performing the above.

9. On the computer, acquiring operation information regarding an operation input of a first user; displaying, on a user terminal of the first user, a three-dimensional first virtual space and an avatar that moves in the first virtual space based on the operation information; displaying, on the user terminal, the first virtual space including a first area including a movement plane that is a plane on which the avatar can move, and a second area distinct from the first area; When the avatar moves from the first area to the second area, an omnidirectional image is displayed around the avatar, the omnidirectional image being expanded into a closed object including a bottom surface on which the avatar can move, the bottom surface corresponding to the movement plane; A program that executes the following.

Images