Information processing device, information processing method, and program
By dividing the VR space into reference, peripheral, and distant cells with varying spatial information processing, the method addresses VR network delays and realism issues, enabling more users to engage without lag or unnatural imagery.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- NEC CORP
- Filing Date
- 2022-03-30
- Publication Date
- 2026-05-15
AI Technical Summary
In VR social networks, the increase in avatar information due to multiple users leads to increased processing and communication delays, causing slow movement and impaired realism, which existing techniques fail to adequately address.
The virtual space is divided into reference, peripheral, and distant cells, with varying levels of spatial information processing to reduce overall information load, using two-dimensional or reduced-information images for distant cells to minimize processing load.
This approach reduces overall information processing and transmission, minimizing delays and unnaturalness, allowing more users to participate effectively in the VR space.
Smart Images

Figure 0007859135000001 
Figure 0007859135000002 
Figure 0007859135000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.
Background Art
[0002] There is a spread of a so-called VR social network service (VRSNS) in which a plurality of users can participate and communicate using avatars in a virtual reality (VR) space configured on a computer. In the VRSNS, a plurality of users participate as avatars through the Internet in a VR space that is constructed on a VR server and transmitted to each user's terminal.
[0003] However, as the number of participating avatars increases, the amount of avatar information also increases, so the information processing time of the server or the user's terminal and the communication time between the server and the terminal increase. Then, the movement of the avatar and its background VR space becomes slow or stops, and the sense of reality is impaired. In order to avoid such a state, measures such as limiting the number of users who can participate in the VR space are being taken.
[0004] As a technique for reducing the amount of information transmission and reception, for example, Patent Document 1 discloses a technique for determining a transmission rate for transmitting position information and action information of each other avatar to a terminal device corresponding to an avatar based on the position information of the one avatar and the position information of the other avatars.
[0005] Further, Patent Document 2 discloses a technique for suppressing delay when displaying a high-resolution image. When dividing the image of a frame into a plurality of individual regions and displaying it, when the image of at least one individual region is delayed at the processing timing of the frame, an image of an individual region of a previous frame is applied to generate a composite image. It is said that this can suppress the delay when displaying a high-resolution image.
Prior Art Documents
Patent Documents
[0006] [Patent Document 1] Japanese Patent Publication No. 2018-28789 [Patent Document 2] International application WO2018 / 047730 [Overview of the project] [Problems that the invention aims to solve]
[0007] In the technology described in Patent Document 1, the transmission rate for transmitting location and behavior information of other avatars that meet predetermined conditions and are close to a given avatar is determined to be higher than the transmission rate for transmitting location and behavior information of other avatars that meet predetermined conditions and are farther away from the given avatar. However, since the amount of information transmitted is the same for both avatars that are close to and far from a given avatar, it is not possible to avoid delays occurring for distant avatars.
[0008] Furthermore, in the technology described in Patent Document 2, the image of the individual region where the delay occurred is replaced with a previous image, which may result in an unnatural image in some cases.
[0009] One aspect of the present invention has been made in view of the above-mentioned problems, and one example of its objective is to provide a technology that reduces unnaturalness and suppresses delays in information processing and information communication by reducing the overall amount of information in the VR space to be processed and transmitted. [Means for solving the problem]
[0010] An information processing device according to one aspect of the present invention includes acquisition means for acquiring first spatial information representing the virtual space in a reference cell which is a cell in which a user is located in the virtual space; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells; and processing means for executing a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information which has a lower processing load than the second process.
[0011] An information processing device according to one aspect of the present invention includes a identifying means for identifying a reference cell, which is a cell in which a user is located in a virtual space; a providing means for providing a terminal device to a first spatial information representing the virtual space in the reference cell; a second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and a third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells, wherein the second and third spatial information are configured such that the processing load on the terminal device using the third spatial information is smaller than the processing load on the terminal device using the second spatial information.
[0012] An information processing method according to one aspect of the present invention includes at least one processor acquiring first spatial information representing the virtual space in a reference cell which is a cell in which a user is located in the virtual space, second spatial information representing the virtual space in one or more peripheral cells located around the reference cell, and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells, and executing a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information which has a lower processing load than the second process.
[0013] An information processing method according to one aspect of the present invention includes at least one processor identifying a reference cell which is a cell in which a user is located in a virtual space, and providing a terminal device with first spatial information representing the virtual space in the reference cell, second spatial information representing the virtual space in one or more peripheral cells located around the reference cell, and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells, wherein the second and third spatial information are configured such that the processing load on the terminal device using the third spatial information is smaller than the processing load on the terminal device using the second spatial information.
[0014] A program according to one aspect of the present invention causes a computer to perform the following processes: acquiring first spatial information representing the virtual space in a reference cell, which is a cell in the virtual space where the user is located; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells; and performing a first process using the first spatial information; a second process using the second spatial information; and a third process using the third spatial information which has a lower processing load than the second process.
[0015] A program according to one aspect of the present invention causes a computer to perform the following processes: identify a reference cell, which is a cell in which a user is located in a virtual space; provide a terminal device with first spatial information representing the virtual space in the reference cell; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells, wherein the second and third spatial information are configured such that the processing load on the terminal device using the third spatial information is smaller than the processing load on the terminal device using the second spatial information. [Effects of the Invention]
[0016] According to one aspect of the present invention, by reducing the amount of information in the VR space to be processed and transmitted as a whole, it is possible to reduce unnaturalness and suppress delays in information processing and information communication.
Brief Description of Drawings
[0017] [Figure 1] It is a block diagram showing the configuration of an information processing apparatus 1 according to Exemplary Embodiment 1 of the present invention. [Figure 2] It is a schematic diagram showing an example of the arrangement of cells in a virtual space according to Exemplary Embodiment 1. [Figure 3] It is a flowchart showing the flow of an information processing method S1 according to Exemplary Embodiment 1. [Figure 4] It is a block diagram showing the configuration of an information processing apparatus 2 according to Exemplary Embodiment 2 of the present invention. [Figure 5] It is a flowchart showing the flow of an information processing method S2 according to Exemplary Embodiment 2. [Figure 6] It is a block diagram showing the configuration of an information processing apparatus 2A and an information processing apparatus 1A according to Exemplary Embodiment 3 of the present invention. [Figure 7] It is a schematic diagram of a virtual space in which a plurality of users exist. [Figure 8] It is a schematic diagram showing an example of the hierarchical structure of information generated in a virtual space VS provided by an information processing apparatus 2A to an information processing apparatus 1A. [Figure 9] It is an example of an image displayed on a display unit by an information processing apparatus 1A. [Figure 10] It is a block diagram showing the configuration of an information processing apparatus 1B and an information processing apparatus 2B according to Exemplary Embodiment 4 of the present invention. [Figure 11] It is a configuration diagram for realizing an information processing apparatus by software.
Modes for Carrying Out the Invention
[0018] 〔Exemplary Embodiment 1〕 A first exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is the basic form of the exemplary embodiments described later.
[0019] (Configuration of Information Processing Device 1) The configuration of the information processing device 1 according to this exemplary embodiment will be described with reference to Figures 1 and 2. Figure 1 is a block diagram showing the configuration of the information processing device 1. The information processing device 1 according to this exemplary embodiment 1 is a terminal device used by a user. The terminal device is also referred to as a VR device. The information processing device 1 is a device for a user to participate in a virtual space VS by accessing the operator of the virtual space VS or a virtual space VS that the user has built and saved on a server. Participation means that the user displays an avatar representing themselves in the virtual space VS. Possible examples of the information processing device 1 include a personal computer, a head-mounted display, and glasses-type displays.
[0020] Figure 2 is a schematic cross-sectional diagram showing an example of cell arrangement in the virtual space VS. The virtual space VS is a three-dimensional space on a computer stored on a virtual space server (hereinafter simply referred to as "server"). However, Figure 2 represents a cross-sectional view of the three-dimensional space. Hereafter, the entire constructed virtual space will be referred to as the virtual space VS, and a part of the virtual space VS will be referred to simply as "virtual space" by specifying its location. As shown in Figure 2, the virtual space VS according to this exemplary embodiment 1 is divided into multiple regions.
[0021] In the example shown in Figure 2, the three-dimensional virtual space VS is divided into cubes of the same size. However, the division method is not limited to cubes; it may also be a rectangular prism or other three-dimensional shapes. Furthermore, as will be described later, the dimensions are arbitrary. Moreover, not all of them need to be the same shape; the space may be divided completely by combining three-dimensional figures of different shapes and sizes. Hereafter, each divided spatial region will be referred to as a cell.
[0022] As shown in Figure 2, the virtual space VS according to this exemplary embodiment 1 is divided into a reference cell, surrounding cells, and far-field cells. The reference cell is the cell on the virtual space VS where the user is located. However, the reference cell may include not only the user but also other users. Surrounding cells are cells located around the reference cell. The area around the reference cell may include not only the area directly adjacent to the reference cell but also the area adjacent to the surrounding cells adjacent to the reference cell. Surrounding cells may be areas where some kind of interaction with the user is possible. Far-field cells are cells located further away from the reference cell than the surrounding cells.
[0023] As shown in Figure 1, the information processing device 1 comprises an acquisition unit 11 and a processing unit 12. The acquisition unit 11 acquires first spatial information representing the virtual space in a reference cell, second spatial information representing the virtual space in one or more surrounding cells, and third spatial information representing the virtual space in one or more distant cells. Spatial information representing a virtual space is information indicating the objects that exist in that virtual space and their positions. The spatial information may also include information indicating the participants' avatars and their positions. The acquisition unit 11 accesses the server to acquire the first spatial information, the second spatial information, and the third spatial information.
[0024] The processing unit 12 executes a first process using first spatial information, a second process using second spatial information, and a third process using third spatial information, which has a lower processing load than the second process. The first process using first spatial information is the process of generating an image of an object that exists in the first space, i.e., the reference cell. More specifically, the first process is the process of generating an image of an object in the reference cell that is visible from the location where the user is located. In the following exemplary embodiment, "user" refers to a player who is participating in the virtual space VS using the information processing device 1, and other players are referred to as "other users" or "participants." Sometimes, the user and other users are collectively referred to as "participants."
[0025] The second process using the second spatial information is the process of generating images of objects in the second space, i.e., the surrounding cells. More specifically, the second process is the process of generating images of objects in the surrounding cells that are visible from the user's location.
[0026] The third process using third spatial information is the process of generating images of objects located in the third space, i.e., the far-field cell. More specifically, the third process is the process of generating images of objects in the far-field cell that are visible from the user's location.
[0027] The third process has a lower processing load than the second process. More specifically, the processing load per cell of the third process is lower than that of the second process. For example, the image generated by the third process is a two-dimensional image, while the image generated by the second process is a three-dimensional image. A three-dimensional image is an image that is displayed based on information including not only the front, but also the sides and back. Therefore, if an object rotates, its sides and back will be displayed. In contrast, a two-dimensional image is an image that only contains information viewed from one direction.
[0028] Furthermore, as an example of an image with low processing load, an image in which the object (model) is represented as a polygon may be an image with a reduced number of polygon vertices, or an image with a reduced number of polygons. Alternatively, an image with a reduced number of pixels on the model's surface (texture) may be used. Alternatively, an image with a reduced amount of information on the model's surface such as shading, bumps, and texture (shader) may be used. Alternatively, an image with a reduced amount of information on the real-time rendering of the light (light source) may be used. Note that the above model may be a 2D model or a 3D model.
[0029] For example, the third spatial information may be generated in advance by the server as spatial information with a small amount of information. Alternatively, the information processing device 1 may reduce the amount of information in the third spatial information acquired from the server. This makes the processing load of the third process smaller than that of the second process.
[0030] Furthermore, the second process may have a lower processing load than the first process. In other words, the third process may have a lower processing load than the second process, and the second process may have a lower processing load than the first process.
[0031] The first process may include generating an image of an avatar located in a reference cell. The second process may include generating an image of an avatar located in a surrounding cell. The third process may include generating an image of an avatar located in a distant cell. From the user's perspective, the second space is farther away than the first space, and the third space is farther away than the second space. Objects at a distance appear smaller than objects that are closer, and their movement is also relatively smaller in magnitude and speed. Furthermore, users tend to be less interested in objects at a distance. Therefore, even if the processing load of the second process is smaller than that of the first process, the user will not feel much unnaturalness.
[0032] Furthermore, some or all of the components of the information processing device 1 may be distributed. Also, some or all of the components of the information processing device 1 may be located on the cloud. This is also true in the following exemplary embodiments.
[0033] (Effects of Information Processing Device 1) As described above, the information processing device 1 according to this exemplary embodiment employs a configuration comprising: an acquisition unit 11 that acquires first spatial information representing the virtual space in a reference cell, which is the cell where the user is located in the virtual space VS; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells; and a processing unit 12 that executes a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information which has a lower processing load than the second process. Therefore, according to the information processing device 1 according to this exemplary embodiment, the amount of information in the virtual space VS to be processed and transmitted, i.e., the overall processing load, can be reduced, thereby reducing unnaturalness and suppressing delays in information processing and information communication. Furthermore, according to the information processing device 1 according to this exemplary embodiment, the amount of information to be processed and transmitted per participant can be reduced, thus enabling more participants to take part in the virtual space VS.
[0034] (Information processing method S1 flow) The flow of the information processing method S1 according to this exemplary embodiment will be explained with reference to Figure 3. Figure 3 is a flowchart showing the flow of the information processing method S1.
[0035] As shown in Figure 3, the information processing method S1 includes steps S11 and S12. In step S11, at least one processor (e.g., acquisition unit 11) acquires first spatial information representing the virtual space in a reference cell, which is the cell where the user is located in the virtual space VS; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells. The meanings of the first spatial information, the second spatial information, and the third spatial information are as described above.
[0036] Next, in step S12, at least one processor (for example, processing unit 12) executes a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information, which has a lower processing load than the second process. The meanings of the first process, the second process, and the third process are as described above.
[0037] (Effects of information processing method S1) As described above, in the information processing method S1 according to this exemplary embodiment, at least one processor acquires first spatial information representing the virtual space in a reference cell, which is the cell where the user is located in the virtual space VS; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells. The processor then performs a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information, which has a lower processing load than the second process. Therefore, according to the information processing method S1 according to this exemplary embodiment, the amount of information in the virtual space VS to be processed and transmitted as a whole is reduced, thereby reducing unnaturalness and suppressing delays in information processing and information communication. Furthermore, according to the information processing method S1 according to this exemplary embodiment, the amount of information to be processed and transmitted per participant is reduced, which also has the effect of allowing more participants to participate in the virtual space VS.
[0038] [Exemplary Embodiment 2] A second exemplary embodiment of the present invention will be described in detail with reference to the drawings. Components having the same function as those described in Exemplary Embodiment 1 will be denoted by the same reference numerals, and their descriptions will be omitted as appropriate.
[0039] (Configuration of Information Processing Device 2) Figure 4 is a block diagram showing the configuration of the information processing device 2 according to Exemplary Embodiment 2. The information processing device 2 is, for example, a server that stores a virtual space VS and communicates information with the VR devices (terminal devices) of participants participating in the virtual space VS. An example of the configuration of the virtual space VS is the same as that shown in Figure 2 described in Exemplary Embodiment 1. As shown in Figure 4, the information processing device 2 comprises a specifying unit 21 and a providing unit 22. The specifying unit 21 and the providing unit 22 are forms of the specifying means and providing means described in the claims, respectively.
[0040] The identification unit 21 identifies a reference cell, which is the cell where the user is located in the virtual space VS. The provision unit 22 provides the terminal device with first spatial information representing the virtual space in the reference cell, second spatial information representing the virtual space in one or more surrounding cells located around the reference cell, and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the surrounding cells. The reference cell, surrounding cells, distant cells, and the first to third spatial information representing the virtual space in them are the same as those described in Exemplary Embodiment 1, so their description is omitted here. Spatial information representing a virtual space is information indicating the objects that exist in that virtual space and their locations. In addition, the spatial information may also include information indicating the participant's avatar and its location.
[0041] The second and third spatial information are configured such that the processing load using the third spatial information in the terminal device is smaller than the processing load using the second spatial information in the terminal device. For example, the second spatial information is three-dimensional spatial information, and the third spatial information is two-dimensional spatial information. Alternatively, the second spatial information may be three-dimensional spatial information, and the third spatial information may be three-dimensional spatial information with a reduced amount of information than the second spatial information.
[0042] The processing using the second spatial information, also referred to as the second process, refers to the process of generating images of objects present in surrounding cells. More specifically, the second process is the process of generating images of objects in surrounding cells visible from the user's location. The processing load on the user's terminal device using the second spatial information is also referred to as the processing load of the second process.
[0043] Furthermore, the processing using the third spatial information is also referred to as the third process, and it is the process of generating images of objects located in the far-away cell. More specifically, the third process is the process of generating images of objects in the far-away cell that are visible from the user's location. The processing load on the user's terminal device using the third spatial information is also referred to as the processing load of the third process.
[0044] In other words, in a terminal device, the processing load of the third process per cell is smaller than the processing load of the second process per cell. For example, the image generated by the third process is a two-dimensional image, while the image generated by the second process is a three-dimensional image. This makes the processing load of the third process smaller than that of the second process. The image generated by the third process may be a three-dimensional image with reduced processing load. An example of an image with a low processing load is as described in Exemplary Embodiment 1.
[0045] Furthermore, the second process may have a lower processing load than the first process using the first spatial information. In other words, the third process may have a lower processing load than the second process, and the second process may have a lower processing load than the first process.
[0046] In a terminal device, the first process may include the process of generating an avatar image in a reference cell. Similarly, in a terminal device, the second process may include the process of generating an avatar image in a surrounding cell, and the third process may include the process of generating an avatar image in a distant cell. From the user's perspective, the second space is farther away than the first space, and the third space is farther away than the second space. Objects at a distance appear smaller than objects that are closer, and their magnitude and speed of movement are also relatively smaller. Furthermore, users tend to be less interested in objects at a distance. Therefore, even if the processing load of the second process is smaller than that of the first process, the user will not feel much unnaturalness.
[0047] (Effects of Information Processing Device 2) As described above, in the information processing device 2 according to this exemplary embodiment, the identification unit 21 identifies a reference cell, which is the cell where the user is located in the virtual space VS. The providing unit 22 provides the terminal device with first spatial information representing the virtual space in the reference cell, second spatial information representing the virtual space in one or more surrounding cells located around the reference cell, and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the surrounding cells. The second and third spatial information are configured such that the processing load on the terminal device using the third spatial information is smaller than the processing load on the terminal device using the second spatial information. Therefore, according to the information processing device 2 according to this exemplary embodiment, the amount of information that the server must transmit and the amount of information in the virtual space VS that the user's terminal device must process are reduced overall, thereby reducing unnaturalness and suppressing delays in information processing and information communication. Furthermore, according to the information processing device 2 according to this exemplary embodiment, the amount of information that each participant must process and transmit is reduced, which also allows more participants to participate in the virtual space VS.
[0048] (Information processing method S2 flow) The flow of the information processing method S2 according to this exemplary embodiment will be explained with reference to Figure 5. Figure 5 is a flowchart showing the flow of the information processing method S2.
[0049] As shown in Figure 5, the information processing method S2 includes steps S21 and S22. In step S21, at least one processor (e.g., identification unit 21) identifies a reference cell, which is the cell where the user is located in the virtual space VS.
[0050] Next, in step S22, at least one processor (for example, the providing unit 22) provides the terminal device with first spatial information representing the virtual space in the reference cell, second spatial information representing the virtual space in one or more peripheral cells located around the reference cell, and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells.
[0051] (Effects of information processing method S2) As described above, in the information processing method S2 according to this exemplary embodiment, at least one processor identifies a reference cell, which is the cell where the user is located in the virtual space VS, and provides the terminal device with first spatial information representing the virtual space in the reference cell, second spatial information representing the virtual space in one or more peripheral cells located around the reference cell, and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells. Therefore, according to the information processing method S2 according to this exemplary embodiment, the amount of information that the server must transmit and the amount of information in the virtual space VS that the user's terminal device must process are reduced overall, thereby reducing unnaturalness and suppressing delays in information processing and information communication. Furthermore, according to the information processing method S2 according to this exemplary embodiment, the amount of information that each participant must process and transmit is reduced, which also has the effect of allowing more participants to take part in the virtual space VS.
[0052] [Exemplary Embodiment 3] A third exemplary embodiment of the present invention will be described in detail with reference to the drawings. Components having the same function as those described in exemplary embodiment 1 or 2 will be denoted by the same reference numerals, and their descriptions will not be repeated.
[0053] (Configuration of Information Processing Device 2A) Figure 6 is a block diagram showing the configuration of an information processing device 2A and an information processing device (terminal device) 1A according to exemplary embodiment 3. The information processing device 2A is, for example, a server that stores a virtual space VS and communicates information with the VR devices (terminal devices) 1A of participants joining the virtual space VS. As shown in Figure 6, the information processing device 2A comprises a control unit 20, a storage unit 30, and a communication unit 40. The control unit 20 has the role of overall controlling the information processing device 2A and may comprise a specific unit 21, a provision unit 22, a first generation unit 23, a second generation unit 24, a first acquisition unit 25, a second acquisition unit 26, a first modification unit 27, and a second modification unit 28. The information processing device 2A is connected to the information processing device 1A used by the user via an information communication network N such as the Internet.
[0054] At least some of the components of the information processing device 2A may be distributed. Furthermore, some or all of the components of the information processing device 2A may be located on the cloud.
[0055] The storage unit 30 of the information processing device 2A may include, for example, various types of RAM (Random Access Memory) and ROM (Read Only Memory). Various programs are stored in the ROM, and at least one processor loads the various programs stored in the ROM into the RAM and executes them to realize the functions of each part of the control unit 20. The communication unit 40 communicates information with the information processing device 1A.
[0056] The identification unit 21 of the control unit 20 identifies a reference cell, which is the cell where the user is located in the virtual space VS. The providing unit 22 provides the terminal device with first spatial information representing the virtual space in the reference cell, second spatial information representing the virtual space in one or more surrounding cells located around the reference cell, and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the surrounding cells. The second and third spatial information are configured such that the processing load on the terminal device using the third spatial information is smaller than the processing load on the terminal device using the second spatial information, similar to the information processing device 2 described in Exemplary Embodiment 2.
[0057] In this exemplary embodiment, the first spatial information and the second spatial information are information for generating a stereoscopic image. The third spatial information is information for generating an image that includes at least an image that is not stereoscopic.
[0058] Here, "stereoscopically viewable image" refers to an image generated based on 3D data, and is structured so that the user viewing the image can recognize that it represents a 3D object.
[0059] For example, a "stereoscopic image" can provide users with a three-dimensional impression by viewing it from different viewpoints. Furthermore, when using a display device that can present separate images for the right and left eyes, such as VR goggles, the "stereoscopic image" may be composed of a right-eye image and a left-eye image with parallax between them, providing the user with a sense of depth through this parallax.
[0060] Furthermore, an "image that cannot be viewed in stereoscopically" may, for example, be an image generated based on 2D data. Alternatively, it may be an image that combines pre-prepared template-like 2D images. Also, an "image that cannot be viewed in stereoscopically" may, for example, be an image in which the object (model) is represented as a 2D polygon, and the number of polygon vertices has been reduced, or the number of polygons has been reduced. It may also be an image in which the number of pixels on the surface (texture) of the 2D model has been reduced. It may also be an image in which the amount of information on shading, bumps, and texture (shader) on the surface of the 2D model has been reduced. It may also be an image in which the amount of information on real-time rendering of lights (light sources) has been reduced.
[0061] Furthermore, as an example, the first and second spatial information may be three-dimensional spatial information. Also, as an example, the second spatial information may be information for generating an image that is coarser-grained than the image generated by the first spatial information. A coarser-grained image is, for example, an image with low resolution. In other words, it is an image with a relatively small number of pixels.
[0062] Furthermore, as an example, first to third spatial information may be generated depending on whether or not interaction occurs. For example, the first and second spatial information may include at least one of the avatars of other users that can be interacted with, and at least one of the interactable objects other than avatars. Interacting with an avatar means that it is possible to converse with or touch the avatar. Interacting with an object means that it is possible to touch or manipulate the object. Examples of objects include furniture, home appliances, vehicles, and tools that can be held in the hand. Also, the amount of information in the first and second spatial information may be changed depending on whether or not interaction occurs.
[0063] Furthermore, the third spatial information does not necessarily have to include any avatars of other interactable users or interactable objects. In other words, the third spatial information may only include users or objects that do not interact. And users or objects that do not interact may be generated as images that include at least non-stereoscopic images. This makes it possible to reduce the amount of information in the third spatial information to less than the amount of information in the second spatial information.
[0064] Alternatively, information about other users in distant cells may be displayed as points on a minimap that users can distinguish and see. This allows users to know how other users are moving. A minimap is a small, separate screen that shows the locations of participants within the virtual space VS. Minimaps are particularly useful when the amount of information about objects needs to be significantly reduced. Also, if another user in a distant cell is speaking, the content of the message may not be displayed; only a mark indicating that they are speaking may be shown. This allows users to understand what other users are doing, thus reducing any sense of unease they may feel.
[0065] Returning to Figure 6, the control unit 20 may include a first generation unit 23, a second generation unit 24, a first acquisition unit 25, a second acquisition unit 26, a first modification unit 27, and a second modification unit 28. The first generation unit 23, the second generation unit 24, the first acquisition unit 25, the second acquisition unit 26, the first modification unit 27, and the second modification unit 28 are each one of the first generation means, second generation means, first acquisition means, second acquisition means, first modification means, and second modification means described in the claims.
[0066] The first generation unit 23 generates second spatial information from fourth spatial information, which represents the virtual space in the surrounding cells and has a higher processing load than the second spatial information. The fourth spatial information may, for example, be spatial information of the space corresponding to the surrounding cells from the original virtual space spatial information that the information processing device 2A has previously generated. The first generation unit 23 generates second spatial information with a lower processing load from the fourth spatial information. Alternatively, the fourth spatial information may, for example, be spatial information created by the participant and uploaded to the information processing device 2A. The first generation unit 23 generates second spatial information with a lower processing load from the fourth spatial information, which is spatial information of the space corresponding to the surrounding cells from the spatial information uploaded by the participant. A lower processing load means, for example, a smaller amount of information. For example, the second spatial information is information corresponding to a coarse-grained image.
[0067] The second generation unit 24 generates the third spatial information from the fifth spatial information, which represents the virtual space in the remote cell and has a higher processing load than the third spatial information. The fifth spatial information may, for example, be the spatial information of the space corresponding to the remote cell from the original virtual space spatial information that the information processing device 2A has previously generated. The second generation unit 24 generates the third spatial information, which has a lower processing load, from the fifth spatial information. Alternatively, the fifth spatial information may, for example, be spatial information created by a participant and uploaded to the information processing device 2A. The second generation unit 24 generates the third spatial information, which has a lower processing load, from the fifth spatial information, which is the spatial information of the space corresponding to the remote cell from the spatial information uploaded by the participant. A lower processing load means, for example, that the amount of information is smaller. For example, the third spatial information is information corresponding to a two-dimensional image.
[0068] In the example described above, the first generation unit 23 generates second spatial information from the fourth spatial information and uses the second spatial information to generate a stereoscopic image. However, the first generation unit 23 may directly generate a stereoscopic image using the fourth spatial information. Also, the second generation unit 24 generates third spatial information from the fifth spatial information and uses the third spatial information to generate an image that includes at least one image that is not stereoscopic. However, the second generation unit 24 may directly generate an image that includes at least one image that is not stereoscopic using the fifth spatial information.
[0069] The control unit 20 may also include a first acquisition unit 25 and a first modification unit 27. The first acquisition unit 25 acquires information about the user's movement in the virtual space VS. The first modification unit 27 changes at least one of the size and shape of the area defined by the surrounding cell by referring to the movement information acquired by the first acquisition unit 25. The information about the user's movement may, for example, be at least one of the user's direction of movement and speed of movement.
[0070] Changing the size of an area defined by surrounding cells means, for example, changing the size of the surrounding cells that define that area. Alternatively, changing the size of an area defined by surrounding cells may also mean changing the number of surrounding cells that define that area. For example, this could involve adding cells adjacent to cells adjacent to a reference cell to the list of surrounding cells, thereby increasing the number of surrounding cells.
[0071] Figure 7 is a schematic diagram of a virtual space (VS) containing multiple users. As shown in Figure 7, the virtual space VS is divided into one reference cell where the user resides, one or more surrounding cells, and one or more far-field cells. The area defined by one or more surrounding cells is called the surrounding area. The area defined by one or more far-field cells is called the far-field area. In Figure 7, there is a user and several other users. Each user (participant) has a reference cell and its surrounding cells (surrounding area) set. In the example shown in Figure 7, the size and shape of each cell are shown to be the same. However, the size and shape of each cell do not have to be the same.
[0072] As an example, suppose the first acquisition unit 25 acquires information that a user indicated by a double circle (◎) is approaching another user indicated by a black circle (●), as shown by the arrow in Figure 7. In that case, the first modification unit 27 may enlarge the surrounding area by adding cells indicated by thick lines adjacent to the surrounding cells indicated by diagonal lines in the direction of the arrow in which the user is moving (hereinafter referred to as the "direction of movement").
[0073] The user's direction of movement is the direction in which other users of the user's interest are located. Preferably, the area of interest to the user is a stereoscopic image with high resolution. Therefore, the first modification unit 27 can expand the area with high resolution to a wider range by enlarging the area surrounding the user's direction of movement. Even if the surrounding area is enlarged, the processing load does not increase because the high-resolution image that has been generated can be saved and used.
[0074] Furthermore, if the user is moving at a high speed (hereinafter referred to as "movement speed"), the user will move to a distant area with low image resolution in a short amount of time. Therefore, the first modification unit 27 may increase the size of the surrounding area in the direction of movement according to the movement speed. By widening the surrounding area with high resolution, the resolution of the image at the destination of the user's movement can be prevented from decreasing immediately. In this way, the first modification unit 27 can reduce the amount of information in the image while reducing the unnaturalness of the image presented to the user by changing at least one of the size and shape of the surrounding area by referring to information about movement.
[0075] Furthermore, the first modification unit 27 may divide the surrounding area into multiple stages according to the distance from the user. For example, the surrounding cells in the direction of movement may be divided in the direction of distance. The first modification unit 27 may then change the resolution of the images of the divided surrounding cells so that the resolution of the surrounding cells decreases as the distance from the user increases. By changing the resolution for each of the surrounding cells divided into multiple stages by the first modification unit 27, the image resolution can be changed in a finer manner, thereby reducing the unnaturalness of the image perceived by the user and suppressing delays in information processing and information communication.
[0076] Furthermore, the first modification unit 27 may make at least one of the size and shape of the surrounding area set when an object or another user enters the surrounding area from the far area, and at least one of the size and shape of the surrounding area set when an object or another user leaves the surrounding area from the far area.
[0077] More specifically, the first modification unit 27 may set the surrounding area, which is defined when an object or other user moves away from the surrounding area to the far area, to be larger than the surrounding area, which is defined when an object or other user moves closer to the surrounding area from the far area. If another user or object that has already been interacted with moves away, the user may feel that it is unnatural if these users or objects immediately enter the far area and the resolution drops. Therefore, by setting the surrounding area, which is defined when an object or other user moves away from the surrounding area to the far area, to be larger than when they are approaching, the resolution does not drop immediately. This processing by the first modification unit 27 can reduce the processing load and reduce the unnaturalness perceived by the user. Note that even if the surrounding area is set to be larger, the processing load does not increase because the image generated at high resolution can be saved and used.
[0078] The control unit 20 may also include a second acquisition unit 26 and a second modification unit 28. The second acquisition unit 26 acquires information about the number or density of other users in the virtual space VS. The second modification unit 28 changes the size of the cells in the virtual space VS by referring to the information about the number or density of participants acquired by the second acquisition unit 26.
[0079] For example, cells with a small number or density of other users are expected to attract less user interest, even in peripheral areas. Therefore, the second modification 28 may increase the size of cells in areas with a small number or density of other users. Furthermore, the second modification 28 may reduce the amount of information in those cells. This makes it possible to further reduce the unnaturalness of the image perceived by the user while suppressing delays in information processing and information communication.
[0080] The second acquisition unit 26 may acquire information regarding the number or density of other users sequentially or periodically. Furthermore, the information processing device 2A may change the degree to which the cell size is changed based on the number or density of users, according to its own processing capabilities. Alternatively, the information processing device 2A may be configured so that the user can set or specify such criteria.
[0081] Figure 8 is a schematic diagram showing an example of the layer (hierarchical) structure of information generated in the virtual space VS provided by the information processing device 2A to the information processing device 1A. The horizontal direction in Figure 8 indicates the distance from the reference cell. The vertical direction in Figure 8 indicates the types of multiple information layers.
[0082] As shown in Figure 8, the information layers in the virtual space VS include, for example, a cell location layer, a surrounding user layer, a surrounding object layer, a distant view layer, and a cross-sectional layer. These layers may be divided according to the type of effect they have on the user.
[0083] For example, the cell position layer is an information layer that defines the position or distance of surrounding and distant cells relative to the reference cell, as well as the shape and size of each cell. The surrounding user layer is an information layer that defines the range in which a user can interact, i.e., information about other users present in the reference cell and surrounding cells, and the content of the interaction in those cells. The surrounding object layer is an information layer that reads interactable objects in the reference cell and surrounding cells and defines the content of the interaction with those objects. The distant view layer is an information layer that defines the range and content of reading other users and objects as distant view, i.e., objects in distant cells.
[0084] The information processing of the information defined in the surrounding user layer, surrounding object layer, and distant view layer is as described in the information processing for the reference cell, surrounding cell, and distant cell. Interaction between users and other users or objects has also been explained. Below, we will describe the information defined in the crossover layer and its processing.
[0085] The cross-spatial layer is an information layer that defines spatial information accompanied by a processing load independent of the distance from the reference cell. Examples of spatial information accompanied by a processing load independent of the distance from the reference cell include information about objects flying across the sky between cells, and information about objects moving across cells at a high speed. Spatial information that exerts a cross-spatial effect across the entire virtual space in this way is also called the sixth spatial information.
[0086] The providing unit 22 may further provide the information processing device 1A with the information of the cross-layer described above, in other words, a sixth spatial information accompanied by a processing load that is independent of the distance from the reference cell. Since the sixth spatial information is information about an object in each cell that is accompanied by a constant processing load regardless of the distance from the reference cell, i.e., the user, changing the processing method for each reference cell, surrounding cell, and distant cell would actually increase the processing load. By providing such information to the information processing device 1A as the sixth spatial information, it is possible to suppress an increase in the processing load on the information processing device 1A.
[0087] By having the layered information structure described above, the information processing device 2A can perform predetermined information processing for each layer. For example, in the peripheral layers (peripheral user layer and peripheral object layer), interactive, stereoscopic images can be generated. As mentioned above, in the information processing of the peripheral layers, peripheral cells may be further divided and images may be generated. In addition, in the distant view layer, images can be generated that do not involve interaction and include at least non-stereoscopic images. In the cross-sectional layer, a common image can be generated for each cell. This configuration can reduce the information processing load.
[0088] In this way, by performing information processing in parallel on each layer, the information processing device 2A can reduce the information processing load. Furthermore, the information processing device 1A can acquire information from multiple layers in parallel from the information processing device 2A. As a result, the information processing device 1A can display an image with reduced unnaturalness.
[0089] (Configuration of Information Processing Device 1A) Returning to Figure 6, the configuration of the information processing device (VR device) 1A will be described. The information processing device 1A comprises a control unit 10, a storage unit 30, a communication unit 40, an operation reception unit 50, and a display unit 60.
[0090] The control unit 10 provides overall control of the information processing device 1A. The control unit 10 includes an acquisition unit 11 and a processing unit 12. The acquisition unit 11 acquires information about the virtual space VS and its participants from the information processing device 2A. The processing unit 12 refers to the information acquired from the information processing device 2A, generates an image, and displays it on the display unit 60.
[0091] The storage unit 30, like the storage unit 30 of the information processing device 2A, is equipped with various types of memory and stores necessary information. The communication unit 40 performs information communication with the information processing device 2A. The operation reception unit 50 receives operations from the user, converts them into operation signals, and transmits them to the control unit 10. The control unit 10 transmits operation signals corresponding to the user's operations to the information processing device 2A. The control unit 10 may also transmit spatial information generated by the user to the information processing device 2A.
[0092] With the configuration of the information processing device 2A described above, the information processing device 1A displays an image with reduced processing load while minimizing unnaturalness. Figure 9 is an example of an image displayed by the information processing device 1A on the display unit 60. As shown in Figure 9, other users 902 located in the distant cell are displayed with low resolution and cannot be viewed stereoscopically. Other users 903 located in the reference cell or surrounding cells are displayed with higher resolution than other users 902 located in the distant cell and can be viewed stereoscopically. In addition, the background 901 of the distant cell, such as buildings and the sky, is displayed with low resolution and cannot be viewed stereoscopically.
[0093] Distant backgrounds and other users are of little interest to the user and are rarely observed closely. Furthermore, because they are far away, low resolution and lack of three-dimensionality do not feel unnatural. On the other hand, other users interacting nearby have high resolution and are stereoscopic, creating a sense of realism and satisfying the user. By varying the processing load according to various conditions in this way, it is possible to reduce the overall processing load, thereby minimizing the unnaturalness perceived by the user and suppressing delays in information processing and communication.
[0094] (Configuration of Information Processing Device 2A) As described above, in the information processing apparatus 2A according to this exemplary embodiment, the control unit 20 is configured to include a specific unit 21, a providing unit 22, a first generation unit 23, a second generation unit 24, a first acquisition unit 25, and a first modification unit 27. Therefore, it is possible to change at least one of the size and shape of the surrounding area by referring to information regarding the user's movement. Accordingly, in addition to the effects of the information processing apparatus 2 according to exemplary embodiment 2, it is possible to more effectively reduce unnaturalness and suppress delays in information processing and information communication.
[0095] Furthermore, in the information processing device 2A according to this exemplary embodiment, the control unit 20 is configured to further include a second acquisition unit 26 and a second modification unit 28. Therefore, the size of the cell can be changed according to the number or density of users. Accordingly, in addition to the effects of the information processing device 2 according to exemplary embodiment 2, the effect of more effectively reducing unnaturalness and suppressing delays in information processing and information communication can be obtained.
[0096] [Exemplary Embodiment 4] An information processing apparatus 1B according to a fourth exemplary embodiment of the present invention will be described in detail with reference to the drawings. Components having the same functions as those described in exemplary embodiments 1 to 3 will be denoted by the same reference numerals, and their descriptions will not be repeated.
[0097] (Configuration of Information Processing Unit 1B) Figure 10 is a block diagram showing the configuration of an information processing device (VR device) 1B, which is a terminal device according to exemplary embodiment 4, and an information processing device (server) 2B to which the information processing device 1B is connected. The information processing device 1B is a device used by a user to access and participate in a virtual space VS. The information processing device 2B is, for example, a server that generates a virtual space VS on a computer and communicates information with the information processing device 1B of participants who are participating in that virtual space VS.
[0098] As shown in Figure 10, the information processing device 1B comprises a control unit 10B, a storage unit 30, a communication unit 40, an operation reception unit 50, and a display unit 60. The storage unit 30, communication unit 40, operation reception unit 50, and display unit 60 have the same functions as the storage unit 30, communication unit 40, operation reception unit 50, and display unit 60 described in the information processing device 1A of Exemplary Embodiment 3, so their description is omitted here.
[0099] The control unit 10B provides overall control of the information processing device 1B. The control unit 10B comprises an acquisition unit 11, a processing unit 12, a first generation unit 13, a second generation unit 14, a first modification unit 15, and a second modification unit 16. The first generation unit 13, the second generation unit 14, the first modification unit 15, and the second modification unit 16 are each one of the first generation means, second generation means, first modification means, and second modification means described in the claims.
[0100] The acquisition unit 11 acquires first spatial information, second spatial information, and third spatial information from the information processing device 2B. The contents of the first spatial information, second spatial information, and third spatial information are the same as those described in Exemplary Embodiment 1.
[0101] The processing unit 12 executes a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information, which has a lower processing load than the second process.
[0102] As an example, the first process may generate a first image indicated by the first spatial information, which is a stereoscopic image. The second process may generate a second image indicated by the second spatial information, which is a stereoscopic image. The third process may generate a third image indicated by the third spatial information, which includes at least an image that is not stereoscopic. The first image indicated by the first spatial information is an image of an object in a reference cell that is visible from the user's location. The second image indicated by the second spatial information is an image of an object in a surrounding cell that is visible from the user's location. The third image indicated by the third spatial information is an image of an object in a distant cell that is visible from the user's location. The third image may include at least an image that is not stereoscopic, as an example, but this does not limit this exemplary embodiment. The content of "stereoscopic image" and "stereoscopic image" is as described in exemplary embodiment 3.
[0103] Furthermore, as an example, the first and second images may be three-dimensional images. Also, as an example, the processing unit 12 may generate a coarser-grained image from the second spatial information than the first image. A coarser-grained image is, for example, an image with low resolution. In other words, it is an image with fewer pixels than the image before coarse-graining.
[0104] Furthermore, as an example, the processing unit 12 may generate the first to third images depending on whether or not there is interaction. For example, the first and second images generated by the processing unit 12 may include at least one of the avatars of other users that can be interacted with, and at least one of the interactable objects other than avatars. Interacting with an avatar means that it is possible to converse with or touch the avatar. Interacting with an object means that it is possible to touch or manipulate the object. Also, the amount of information in the first and second images may be changed depending on whether or not there is interaction.
[0105] Furthermore, the third image generated by the processing unit 12 does not necessarily have to include any avatars of other interactable users or interactable objects. In other words, the third image may only contain users or objects that do not interact. The processing unit 12 may also generate images of users or objects that do not interact as non-stereoscopic images. This makes the processing load for generating the third image smaller than that for generating the second image.
[0106] Alternatively, information about other users in distant cells may be displayed as points on a minimap that are easily distinguishable and visible to the user. This allows the user to see how other users are moving. Minimaps are particularly useful when the amount of information displayed on objects needs to be significantly reduced. Furthermore, if another user in a distant cell is speaking, the content of the message may not be displayed; only a marker indicating that they are speaking may be shown. This allows the user to understand what other users are doing, thus reducing any sense of unease they may experience.
[0107] The first generation unit 13 may generate the second spatial information from the fourth spatial information, which represents the virtual space in the surrounding cells and has a higher processing load than the second spatial information. The fourth spatial information may, for example, be the spatial information of the space corresponding to the surrounding cells from the original virtual space spatial information acquired by the information processing device 1B from the information processing device 2B. The first generation unit 13 generates the second spatial information, which has a lower processing load, from the fourth spatial information. Alternatively, the fourth spatial information may, for example, be spatial information created by the user. The first generation unit 13 generates the second spatial information, which has a lower processing load, from the fourth spatial information, which is the spatial information of the space corresponding to the surrounding cells from the spatial information created by the user. A lower processing load means, for example, a smaller amount of information. For example, the second spatial information is information corresponding to a coarse-grained image.
[0108] The second generation unit 14 may generate the third spatial information from the fifth spatial information, which represents the virtual space in the far cell and has a higher processing load than the third spatial information. The fifth spatial information may, for example, be the spatial information of the space corresponding to the far cell from the original virtual space spatial information acquired by the information processing device 1B from the information processing device 2B. The second generation unit 14 generates the third spatial information, which has a lower processing load, from the fifth spatial information. Alternatively, the fifth spatial information may, for example, be spatial information created by the user. The second generation unit 14 generates the third spatial information, which has a lower processing load, from the fifth spatial information, which is the spatial information of the space corresponding to the far cell from the spatial information created by the user. A lower processing load means, for example, that the amount of information is smaller. For example, the third spatial information is information corresponding to a two-dimensional image.
[0109] In the above example, the first generation unit 13 generates second spatial information from the fourth spatial information, and the processing unit 12 generates a stereoscopic image using the second spatial information. However, the processing unit 12 may directly generate a stereoscopic image using the fourth spatial information. Alternatively, the second generation unit 14 generates third spatial information from the fifth spatial information, and the processing unit 12 generates an image that includes at least one non-stereoscopic image using the third spatial information. However, the processing unit 12 may directly generate an image that includes at least one non-stereoscopic image using the fifth spatial information.
[0110] Furthermore, the acquisition unit 11 may acquire information regarding the user's movement in the virtual space VS. In this case, the control unit 10B may include a first modification unit 15. The first modification unit 15 changes at least one of the size and shape of the area defined by the surrounding cell by referring to the movement information acquired by the acquisition unit 11. The information regarding the user's movement may, for example, be at least one of the user's direction of movement and speed of movement.
[0111] Changing the size of an area defined by surrounding cells means, for example, changing the size of the surrounding cells that define that area. Alternatively, changing the size of an area defined by surrounding cells may also mean changing the number of surrounding cells that define that area. For example, this could involve adding cells adjacent to cells adjacent to a reference cell to the list of surrounding cells, thereby increasing the number of surrounding cells. An area defined by one or more surrounding cells is called a surrounding area. An area defined by one or more far-far cells is called a far-far area.
[0112] The processes performed by the acquisition unit 11 and the first modification unit 15 will be explained using Figure 7 mentioned above. As an example, suppose the acquisition unit 11 acquires information that a user indicated by a double circle (◎) is approaching another user indicated by a black circle (●), as shown by the arrow in Figure 7. In that case, the first modification unit 15 may enlarge the surrounding area by adding cells indicated by thick lines adjacent to the surrounding cells indicated by diagonal lines in the direction of movement of the user indicated by the arrow.
[0113] The user's direction of movement is the direction in which other users of the user's interest are located. Preferably, the area of interest to the user is a stereoscopic image with high resolution. Therefore, the first modification unit 15 can expand the area with high resolution to a wider range by enlarging the area surrounding the user's direction of movement. Even if the surrounding area is enlarged, the processing load does not increase because the high-resolution image that has been generated can be saved and used.
[0114] Furthermore, if the user is moving at a high speed, the user will move to a distant area with low image resolution in a short amount of time. In this case, the first modification unit 15 may increase the size of the surrounding area in the direction of movement according to the movement speed. By widening the surrounding area with high resolution, the resolution of the image at the destination where the user is moving can be prevented from decreasing immediately. In this way, the first modification unit 15 can reduce the amount of information in the image while reducing the unnaturalness of the image presented to the user by changing at least one of the size and shape of the surrounding area by referring to information about movement.
[0115] Furthermore, the first modification unit 15 may divide the surrounding area into multiple stages according to the distance from the user. For example, the surrounding cells in the direction of movement may be divided in the direction of distance. The first modification unit 15 may then change the resolution of the images of the divided surrounding cells so that the resolution of the surrounding cells decreases as the distance from the user increases. By changing the resolution for each of the surrounding cells divided into multiple stages by the first modification unit 15, the image resolution can be changed in a finer manner, thereby reducing the unnaturalness of the image perceived by the user and suppressing delays in information processing and information communication.
[0116] Furthermore, the first modification unit 15 may make at least one of the size and shape of the surrounding area set when an object or another user enters the surrounding area from the far area, and at least one of the size and shape of the surrounding area set when an object or another user leaves the surrounding area from the far area.
[0117] More specifically, the first modification unit 15 may set the surrounding area, which is defined when an object or other user moves away from the surrounding area to the far area, to be larger than the surrounding area, which is defined when an object or other user moves closer to the surrounding area from the far area. If another user or object that has already interacted moves away, the user may feel that it is unnatural if these users or objects immediately enter the far area and the resolution drops. Therefore, by setting the surrounding area, which is defined when an object or other user moves away from the surrounding area to the far area, to be larger than when they are approaching, the resolution does not drop immediately. This processing by the first modification unit 27 can reduce the processing load and reduce the unnaturalness perceived by the user. Note that even if the surrounding area is set to be larger, the processing load does not increase because the image generated at high resolution can be saved and used.
[0118] Furthermore, the acquisition unit 11 may acquire information regarding the number or density of other users in the virtual space VS. In that case, the control unit 10B may include a second modification unit 16. The second modification unit 16 changes the size of the cells in the virtual space VS by referring to the information regarding the number or density of other users.
[0119] For example, cells with a small number or density of other users are expected to attract less user interest, even in peripheral areas. Therefore, the second modification 16 may increase the size of cells in areas with a small number or density of other users. Furthermore, the second modification 16 may reduce the amount of information in those cells. This makes it possible to further reduce the unnaturalness of the image perceived by the user while suppressing delays in information processing and information communication.
[0120] The acquisition unit 11 may acquire information about the number or density of other users sequentially or periodically. Furthermore, the information processing device 1B may change the degree to which the cell size is changed based on the number or density of users, according to its own processing capabilities. Alternatively, the information processing device 1B may be configured so that the user can set or specify such criteria.
[0121] Figure 8 is a schematic diagram showing the layer structure of information generated in the virtual space VS provided by the information processing device 2B to the information processing device 1B. The details of this layer structure and its effects have been explained in Exemplary Embodiment 3, so a detailed explanation is omitted here.
[0122] The cross-sectional layer is an information layer that defines spatial information accompanied by a processing load that is independent of the distance from the reference cell. The acquisition unit 11 may further acquire the information of the cross-sectional layer described above, in other words, a sixth spatial information accompanied by a processing load that is independent of the distance from the reference cell, from the information processing device 2B. The sixth spatial information is information about an object in each cell that is accompanied by a constant processing load regardless of the distance from the reference cell, i.e., the user. Therefore, changing the processing method for each reference cell, surrounding cell, and distant cell would actually increase the processing load. By acquiring such information as the sixth spatial information from the information processing device 2B, the acquisition unit 11 can suppress the increase in the processing load on the information processing device 1B.
[0123] By acquiring information with the layer structure described above, the information processing device 1B can perform predetermined information processing for each layer. For example, in the peripheral layers (peripheral user layer and peripheral object layer), an interactive, stereoscopic image can be generated. As mentioned above, in the information processing of the peripheral layers, the peripheral cells may be further divided and images may be generated. In the distant view layer, an image can be generated that does not involve interaction and includes at least an image that is not stereoscopic. In the cross-sectional layer, a common image can be generated for each cell. With this configuration, the information processing device 1B can reduce the information processing load and display images with reduced unnaturalness.
[0124] (Configuration of Information Processing Unit 2B) Returning to Figure 10, the configuration of the server, information processing device 2B, will be described. The information processing device 2B comprises a control unit 20B, a storage unit 30, and a communication unit 40. The configuration of the storage unit 30 and the communication unit 40 is as described in Exemplary Embodiment 3.
[0125] The control unit 20B provides overall control of the information processing device 2B. The control unit 20B includes a identification unit 21 and a provision unit 22. The identification unit 21 identifies a reference cell, which is the cell where the user is located in the virtual space. The provision unit 22 provides the information processing device 1B with first spatial information, second spatial information, and third spatial information. The information processing device 1B can use the first spatial information, second spatial information, and third spatial information acquired from the information processing device 2B to perform the various processes described above to generate an image with reduced processing load, and display it on the display unit 60.
[0126] Figure 9 shows an example of an image generated and displayed by the information processing device 1B. The features of Figure 9 are as described in Exemplary Embodiment 3. Distant backgrounds and other users are of little interest to the user and are rarely looked at closely. Also, because they are far away, even if the resolution is low or they are not three-dimensional, it does not feel unnatural. On the other hand, other users who are interacting nearby have high resolution and are stereoscopic, so they feel realistic and the user can be satisfied. In this way, by changing the processing load according to various conditions, the information processing device 1B can reduce the unnaturalness felt by the user when the overall processing load is reduced, and can also suppress delays in information processing and information communication.
[0127] (Effects of Information Processing Device 1B) As described above, in the information processing apparatus 1B according to this exemplary embodiment, the control unit 10B is configured to include an acquisition unit 11, a processing unit 12, a first generation unit 13, a second generation unit 14, and a first modification unit 15. Therefore, it is possible to change at least one of the size and shape of the surrounding area by referring to information regarding the user's movement. Accordingly, in addition to the effects of the information processing apparatus 1 according to the exemplary embodiment 1, it is possible to more effectively reduce unnaturalness and suppress delays in information processing and information communication.
[0128] Furthermore, in the information processing device 1B according to this exemplary embodiment, the control unit 10B is configured to further include a second modification unit 16. Therefore, the size of the cell can be changed according to the number or density of users. Accordingly, in addition to the effects of the information processing device 1 according to the exemplary embodiment 1, the effect of more effectively reducing unnaturalness and suppressing delays in information processing and information communication can be obtained.
[0129] [Examples of implementation using software] Some or all of the functions of the information processing devices 1, 1A, 1B, 2, 2A, 2B (hereinafter referred to as "information processing devices 1, etc.") may be implemented by hardware such as integrated circuits (IC chips) or by software.
[0130] In the latter case, the information processing device 1, etc., is implemented by a computer that executes instructions for a program, which is software that implements each function. An example of such a computer (hereinafter referred to as computer C) is shown in Figure 11. Computer C comprises at least one processor C1 and at least one memory C2. The memory C2 stores a program P that causes computer C to operate as the information processing device 1, etc. In computer C, the processor C1 reads the program P from the memory C2 and executes it, thereby implementing each function of the information processing device 1, etc.
[0131] Processor C1 can include, for example, a CPU (Central Processing Unit), GPU (Graphic Processing Unit), DSP (Digital Signal Processor), MPU (Micro Processing Unit), FPU (Floating Point Number Processing Unit), PPU (Physics Processing Unit), microcontroller, or a combination thereof. Memory C2 can include, for example, flash memory, HDD (Hard Disk Drive), SSD (Solid State Drive), or a combination thereof.
[0132] Computer C may also be equipped with RAM (Random Access Memory) for loading program P at runtime and for temporarily storing various data. Furthermore, computer C may be equipped with communication interfaces for sending and receiving data with other devices. Additionally, computer C may be equipped with input / output interfaces for connecting input / output devices such as keyboards, mice, displays, and printers.
[0133] Furthermore, program P can be recorded on a non-temporary, tangible recording medium M that is readable by computer C. Such a recording medium M could be, for example, tape, disk, card, semiconductor memory, or programmable logic circuitry. Computer C can acquire program P via such a recording medium M. Program P can also be transmitted via a transmission medium. Such a transmission medium could be, for example, a communication network or broadcast waves. Computer C can also acquire program P via such a transmission medium.
[0134] [Additional Note 1] The present invention is not limited to the embodiments described above, and various modifications are possible within the scope of the claims. For example, embodiments obtained by appropriately combining the technical means disclosed in the embodiments described above are also included in the technical scope of the present invention.
[0135] [Additional Note 2] Some or all of the embodiments described above may also be described as follows. However, the present invention is not limited to the embodiments described below.
[0136] (Note 1) Information processing apparatus comprising: acquisition means for acquiring first spatial information representing the virtual space in a reference cell which is a cell in which a user is located in the virtual space; second spatial information representing the virtual space in one or more surrounding cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the surrounding cells; and processing means for executing a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information which has a lower processing load than the second process.
[0137] According to the above configuration, by reducing the overall amount of information in the VR space that needs to be processed and transmitted, unnaturalness can be reduced, and delays in information processing and communication can be suppressed.
[0138] (Note 2) The processing means generates a first image represented by the first spatial information that is stereoscopically viewable as a first process, generates a second image represented by the second spatial information that is stereoscopically viewable as a second process, and generates an image that includes at least a third image represented by the third spatial information that is not stereoscopically viewable as a third process. The information processing device described in Appendix 1.
[0139] According to the above configuration, by generating an image that includes at least some images that cannot be viewed in stereoscopic 3D, the overall amount of information in the VR space that needs to be processed and transmitted can be reduced.
[0140] (Note 3) The processing means is an information processing device according to Appendix 2, which generates a coarser-grained image than the first image from the second spatial information.
[0141] According to the above configuration, by generating an image that is coarser-grained than the first image, the overall amount of information in the VR space that needs to be processed and transmitted can be reduced.
[0142] (Note 4) The information processing device according to Appendix 2 or 3, wherein the first image and the second image include at least one of an interactable avatar of another user and an interactable object other than an avatar.
[0143] According to the above configuration, the avatars or objects in the first and second images can interact.
[0144] (Note 5) The information processing device described in any one of the appendices 2 to 4, wherein the third image contains neither an avatar of another interactable user nor an interactable object.
[0145] According to the above configuration, the amount of information in the third image can be reduced.
[0146] (Note 6) An information processing apparatus according to any one of the appendices 1 to 5, comprising a first generation means for generating the second spatial information from a fourth spatial information representing the virtual space in the surrounding cell, the fourth spatial information having a greater processing load than the second spatial information.
[0147] According to the above configuration, it is possible to generate a second spatial information with a low processing load from a fourth spatial information with a high processing load.
[0148] (Note 7) An information processing apparatus according to any one of the appendices 1 to 6, comprising a second generation means for generating the third spatial information from a fifth spatial information representing the virtual space in the remote cell, the fifth spatial information having a greater processing load than the third spatial information.
[0149] According to the above configuration, it is possible to generate a third spatial information, which has a low processing load, from a fifth spatial information, which has a high processing load.
[0150] (Note 8) The information processing device according to any one of Appendix 1 to 7, wherein the acquisition means acquires information regarding the user's movement in the virtual space, and the information processing device is further provided with a first modification means that, by referring to the information regarding the movement, changes at least one of the size and shape of the area defined by the surrounding cell.
[0151] According to the above configuration, by referring to information about movement, it is possible to generate images that are less unnatural and have reduced information content more effectively.
[0152] (Note 9) The information processing apparatus according to any one of Appendix 1 to 8, wherein the acquisition means further acquires information regarding the number or density of other users in the virtual space, and the information processing apparatus further comprises a second modification means for changing the size of cells in the virtual space by referring to the information regarding the number or density of other users.
[0153] According to the above configuration, by referring to information about the number or density of other users, it is possible to generate images that are less unnatural and have reduced information content more effectively.
[0154] (Note 10) The information processing apparatus according to any one of the appendices 1 to 9, wherein the acquisition means further acquires a sixth spatial information accompanied by a processing load that is independent of the distance from the reference cell, and the processing means performs processing using the sixth spatial information.
[0155] According to the above configuration, it is possible to generate images of objects or avatars to be used throughout the virtual space.
[0156] (Note 11) Information processing device comprising: identification means for identifying a reference cell, which is a cell in a virtual space where a user is located; providing means for providing a terminal device to a terminal device the following: first spatial information representing the virtual space in the reference cell; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells, wherein the second and third spatial information are configured such that the processing load on the terminal device using the third spatial information is smaller than the processing load on the terminal device using the second spatial information.
[0157] With the above configuration, the same effect as described in Appendix 1 can be obtained.
[0158] (Note 12) The information processing apparatus according to Appendix 11, wherein the first spatial information and the second spatial information are information for generating a stereoscopic image, and the third spatial information is information for generating an image that includes at least an image that is not stereoscopic.
[0159] With the above configuration, the same effect as described in Appendix 2 can be obtained.
[0160] (Note 13) The information processing device according to Appendix 11 or 12, wherein the second spatial information is information for generating an image that is coarser-grained than the image generated by the first spatial information.
[0161] According to the above configuration, the same effect as described in Appendix 3 can be obtained.
[0162] (Note 14) The information processing device according to any one of Appendix 11 to 13, wherein the first spatial information and the second spatial information include at least one of an interactable avatar of another user and an interactable object other than an avatar.
[0163] With the above configuration, the same effect as described in Appendix 4 can be obtained.
[0164] (Note 15) The information processing device described in any one of the appendices 11 to 14, wherein the third spatial information does not include any interactable avatars of other users or interactable objects.
[0165] According to the above configuration, the same effect as described in Appendix 5 can be obtained.
[0166] (Note 16) An information processing apparatus according to any one of the appendices 11 to 15, comprising a first generation means for generating the second spatial information from a fourth spatial information representing the virtual space in the surrounding cell, the fourth spatial information having a greater processing load than the second spatial information.
[0167] According to the above configuration, the same effect as described in Appendix 6 can be obtained.
[0168] (Note 17) An information processing apparatus according to any one of the appendices 11 to 16, comprising a second generation means for generating the third spatial information from a fifth spatial information representing the virtual space in the remote cell, the fifth spatial information having a greater processing load than the third spatial information.
[0169] According to the above configuration, the same effect as described in Appendix 7 can be obtained.
[0170] (Note 18) A first acquisition means for acquiring information regarding the user's movement in the virtual space, An information processing apparatus according to any one of appendices 11 to 17, further comprising a first modification means for changing at least one of the size and shape of the area defined by the surrounding cell, with reference to the aforementioned movement information.
[0171] According to the above configuration, the same effect as described in Appendix 8 can be obtained.
[0172] (Note 19) An information processing apparatus according to any one of Appendix 11 to 18, further comprising: a second acquisition means for acquiring information relating to the number or density of other users in the virtual space; and a second modification means for changing the size of a cell in the virtual space by referring to the information relating to the number or density of other users.
[0173] According to the above configuration, the same effect as described in Appendix 9 can be obtained.
[0174] (Note 20) The information processing apparatus according to any one of appendices 11 to 19, wherein the providing means further provides a sixth spatial information accompanied by a processing load that is independent of the distance from the reference cell.
[0175] According to the above configuration, the same effect as described in Appendix 10 can be obtained.
[0176] (Note 21) An information processing method comprising: at least one processor acquiring first spatial information representing the virtual space in a reference cell which is a cell in the virtual space where a user is located; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells; and executing a first process using the first spatial information; a second process using the second spatial information; and a third process using the third spatial information which has a lower processing load than the second process.
[0177] With the above configuration, the same effect as described in Appendix 1 can be obtained.
[0178] (Note 22) An information processing method comprising: at least one processor identifying a reference cell which is a cell in a virtual space where a user is located; providing a terminal device with first spatial information representing the virtual space in the reference cell; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells, wherein the second and third spatial information are configured such that the processing load on the terminal device using the third spatial information is smaller than the processing load on the terminal device using the second spatial information.
[0179] With the above configuration, the same effect as described in Appendix 1 can be obtained.
[0180] (Note 23) A program for causing a computer to perform the following processes: acquiring first spatial information representing the virtual space in a reference cell, which is the cell in which the user is located in the virtual space; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells; and performing a first process using the first spatial information; a second process using the second spatial information; and a third process using the third spatial information that has a lower processing load than the second process.
[0181] With the above configuration, the same effect as described in Appendix 1 can be obtained.
[0182] (Note 24) A program that causes a computer to perform the following processes: identify a reference cell, which is the cell in which the user is located in a virtual space; provide a terminal device with first spatial information representing the virtual space in the reference cell; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells, wherein the second and third spatial information are configured such that the processing load on the terminal device using the third spatial information is smaller than the processing load on the terminal device using the second spatial information.
[0183] With the above configuration, the same effect as described in Appendix 1 can be obtained.
[0184] (Note 25) An information processing device comprising at least one processor, the processor performing acquisition processing to acquire first spatial information representing the virtual space in a reference cell which is a cell in which a user is located in the virtual space; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells; and execution processing to perform first processing using the first spatial information; second processing using the second spatial information; and third processing using the third spatial information which has a lower processing load than the second processing.
[0185] Furthermore, this information processing device may also be equipped with memory, and this memory may store a program that causes the processor to perform the acquisition process and the execution process. This program may also be recorded on a computer-readable, non-temporary, tangible recording medium.
[0186] (Note 26) Information processing apparatus comprising at least one processor, the processor performing identification processing to identify a reference cell which is a cell in a virtual space where a user is located, and providing processing to a terminal device the first spatial information representing the virtual space in the reference cell, second spatial information representing the virtual space in one or more peripheral cells located around the reference cell, and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells, wherein the second and third spatial information are configured such that the processing load on the terminal device using the third spatial information is smaller than the processing load on the terminal device using the second spatial information.
[0187] Furthermore, this information processing device may also be equipped with memory, and this memory may store a program that causes the processor to execute the specific processing and the provisioning processing. This program may also be recorded on a computer-readable, non-temporary, tangible recording medium. [Explanation of Symbols]
[0188] 1, 1A, 1B, 2, 2A, 2B… Information Processing Devices 11…Acquisition part 12… Processing Unit 13, 23... First generation section 14, 24... Second generation section 15, 27... First change 16, 28... Second change 10, 10B, 20, 20B… Control Unit 21…Specific part 22…Providing Department 25...First acquisition section 26...Second acquisition section 30...Storage section 40... Communications Department 50... Operation reception unit 60...Display section
Claims
1. Acquisition means for acquiring first spatial information representing the virtual space in a reference cell, which is a cell in the virtual space where the user is located; second spatial information representing the virtual space in one or more surrounding cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the surrounding cells. Processing means for performing a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information which has a lower processing load than the second process. An information processing device equipped with, The acquisition means acquires the direction of movement of the user in the virtual space, and the direction of movement is the direction in which other users of the user's interest are located. The information processing device is The system includes a first modification means for changing at least one of the size and shape of the area defined by the peripheral cells in the aforementioned direction of movement. Information processing device.
2. The processing means is As the first process, a first image represented by the first spatial information is generated, which is a stereoscopic image. As the second process, a second image is generated which is a stereoscopic image and is represented by the second spatial information. As the third process, an image is generated which includes at least an image that is not stereoscopic, which is a third image indicated by the third spatial information. The information processing apparatus according to claim 1.
3. The processing means is A coarser-grained image than the first image is generated from the second spatial information. The information processing apparatus according to claim 2.
4. The first and second images include at least one of the following: an interactable avatar of another user, and an interactable object other than an avatar. The information processing apparatus according to claim 2 or 3.
5. The third image described above does not include any other interactable user avatars or interactable objects. The information processing apparatus according to any one of claims 2 to 4.
6. The system includes a first generation means for generating the second spatial information from a fourth spatial information representing the virtual space in the surrounding cells, the fourth spatial information having a greater processing load than the second spatial information. The information processing apparatus according to any one of claims 1 to 5.
7. The system includes a second generation means for generating the third spatial information from a fifth spatial information representing the virtual space in the remote cell, which has a greater processing load than the third spatial information. An information processing apparatus according to any one of claims 1 to 6.
8. The acquisition means further acquires information regarding the number or density of other users in the virtual space, The information processing device is The system further includes a second modification means for changing the size of a cell in the virtual space by referring to information regarding the number or density of other users. The information processing apparatus according to any one of claims 1 to 7.
9. The acquisition means further acquires a sixth spatial information, which is accompanied by a processing load that is independent of the distance from the reference cell. The processing means performs processing using the sixth spatial information. The information processing apparatus according to any one of claims 1 to 8.
10. A means for identifying a reference cell, which is the cell where the user is located in the virtual space, A means for providing a terminal device with: first spatial information representing the virtual space in the reference cell; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells. Equipped with, The second spatial information and the third spatial information are configured such that the processing load using the third spatial information in the terminal device is smaller than the processing load using the second spatial information in the terminal device. A first acquisition means for acquiring the direction of movement of the user in the virtual space, A first modifying means for changing at least one of the size and shape of the area defined by the surrounding cells in the aforementioned direction of movement, Equipped with, The direction of movement of the aforementioned user is the direction in which other users of the aforementioned user's interest are located. Information processing device.
11. The first spatial information and the second spatial information are information for generating a stereoscopic image, The third spatial information is information for generating an image that includes at least an image that cannot be viewed in stereoscopically. The information processing apparatus according to claim 10.
12. The second spatial information is information for generating an image that is coarser-grained than the image generated by the first spatial information. The information processing apparatus according to claim 10 or 11.
13. The first spatial information and the second spatial information include at least one of the avatars of other users that can be interacted with, and at least one of the interactable objects other than avatars. The information processing apparatus according to any one of claims 10 to 12.
14. The third spatial information described above does not include any avatars of other interactable users or any interactable objects. The information processing apparatus according to any one of claims 10 to 13.
15. The system includes a first generation means for generating the second spatial information from a fourth spatial information representing the virtual space in the surrounding cells, the fourth spatial information having a greater processing load than the second spatial information. The information processing apparatus according to any one of claims 10 to 14.
16. The system includes a second generation means for generating the third spatial information from a fifth spatial information representing the virtual space in the remote cell, which has a greater processing load than the third spatial information. An information processing apparatus according to any one of claims 10 to 15.
17. A second acquisition means for acquiring information regarding the number or density of other users in the virtual space, A second modification means for changing the size of a cell in the virtual space by referring to information about the number or density of other users, and An information processing apparatus according to any one of claims 10 to 16, further comprising the above.
18. The providing means further provides a sixth spatial information accompanied by a processing load that is independent of the distance from the reference cell. The information processing apparatus according to any one of claims 10 to 17.
19. At least one processor, To acquire: first spatial information representing the virtual space in a reference cell, which is the cell where the user is located in the virtual space; second spatial information representing the virtual space in one or more surrounding cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the surrounding cells. Execute a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information that has a lower processing load than the second process. It includes, and further, To obtain the direction of movement of the user in the virtual space, To change at least one of the size and shape of the area defined by the surrounding cells in the aforementioned direction of movement. Includes, The aforementioned direction of movement is the direction in which other users of interest to the aforementioned user are located. Information processing methods.
20. At least one processor, Identifying the reference cell, which is the cell where the user is located in the virtual space. The terminal device is provided with: first spatial information representing the virtual space in the reference cell; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells. Includes, The second spatial information and the third spatial information are configured such that the processing load using the third spatial information in the terminal device is smaller than the processing load using the second spatial information in the terminal device. The aforementioned at least one processor further, To obtain the direction of movement of the user in the virtual space, To change at least one of the size and shape of the area defined by the surrounding cells in the aforementioned direction of movement. Includes, The aforementioned direction of movement is the direction in which other users of interest to the aforementioned user are located. Information processing methods.
21. On the computer, A process for acquiring: first spatial information representing the virtual space in a reference cell, which is the cell where the user is located in the virtual space; second spatial information representing the virtual space in one or more surrounding cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the surrounding cells. A process that performs a first process using the first spatial information, a second process using the second spatial information, and a third process using the third spatial information which has a lower processing load than the second process, and further, A process for obtaining the user's movement direction in the virtual space, A process to change at least one of the size and shape of the area defined by the surrounding cells in the aforementioned direction of movement. Make it run, The aforementioned direction of movement is the direction in which other users of interest to the aforementioned user are located. program.
22. On the computer, The process of identifying a reference cell, which is the cell where the user is located in the virtual space, A process of providing a terminal device with: first spatial information representing the virtual space in the reference cell; second spatial information representing the virtual space in one or more peripheral cells located around the reference cell; and third spatial information representing the virtual space in one or more distant cells located further away from the reference cell than the peripheral cells. Make it run, The second spatial information and the third spatial information are configured such that the processing load using the third spatial information in the terminal device is smaller than the processing load using the second spatial information in the terminal device. The aforementioned computer further, A process for obtaining the user's movement direction in the virtual space, A process to change at least one of the size and shape of the area defined by the surrounding cells in the aforementioned direction of movement. Make it run, The aforementioned direction of movement is the direction in which other users of interest to the aforementioned user are located. program.
23. The acquisition means acquires the user's movement speed, The first modification means changes at least one of the size and shape of the area defined by the surrounding cells in the direction of movement, according to the movement speed. The information processing apparatus according to claim 1.
24. The first acquisition means acquires the user's movement speed, The first modification means changes at least one of the size and shape of the area defined by the surrounding cells in the direction of movement, according to the movement speed. The information processing apparatus according to claim 10.